Robot-assisted augmented reality surgical navigation based on optical tracking for mandibular reconstruction surgery

被引:8
|
作者
Shao, Long [1 ]
Li, Xing [2 ]
Fu, Tianyu [2 ,3 ,7 ]
Meng, Fanhao [4 ]
Zhu, Zhihui [2 ]
Zhao, Ruiqi
Huo, Minghao [5 ]
Xiao, Deqiang [6 ]
Fan, Jingfan [6 ]
Lin, Yucong
Zhang, Tao [2 ,8 ]
Yang, Jian [6 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
[2] Chinese Acad Med Sci & Peking Union Med Coll, Peking Union Med Coll Hosp, Dept Stomatol, Beijing, Peoples R China
[3] Beijing Inst Technol, Sch Med Technol, Beijing, Peoples R China
[4] Capital Med Univ, Beijing Friendship Hosp, Dept Stomatol, Beijing, Peoples R China
[5] Chinese Acad Med Sci & Peking Union Med Coll, Peking Union Med Coll Hosp, Dept Radiol, Beijing, Peoples R China
[6] Beijing Inst Technol, Beijing Engn Res Ctr Mixed Real & Adv Display, Sch Opt & Photon, Beijing, Peoples R China
[7] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
[8] Chinese Acad Med Sci & Peking Union Med Coll, Peking Union Med Coll Hosp, Dept Stomatol, Beijing 100730, Peoples R China
基金
美国国家科学基金会;
关键词
augmented reality; mandibular reconstruction; optical tracking; robot-assisted; spatial registration; FIBULA FREE-FLAP; BONE; ACCURACY; REGISTRATION; CALIBRATION; SYSTEM;
D O I
10.1002/mp.16598
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
PurposeThis work proposes a robot-assisted augmented reality (AR) surgical navigation system for mandibular reconstruction. The system accurately superimposes the preoperative osteotomy plan of the mandible and fibula into a real scene. It assists the doctor in osteotomy quickly and safely under the guidance of the robotic arm. MethodsThe proposed system mainly consists of two modules: the AR guidance module of the mandible and fibula and the robot navigation module. In the AR guidance module, we propose an AR calibration method based on the spatial registration of the image tracking marker to superimpose the virtual models of the mandible and fibula into the real scene. In the robot navigation module, the posture of the robotic arm is first calibrated under the tracking of the optical tracking system. The robotic arm can then be positioned at the planned osteotomy after the registration of the computed tomography image and the patient position. The combined guidance of AR and robotic arm can enhance the safety and precision of the surgery. ResultsThe effectiveness of the proposed system was quantitatively assessed on cadavers. In the AR guidance module, osteotomies of the mandible and fibula achieved mean errors of 1.61 & PLUSMN; 0.62 and 1.08 & PLUSMN; 0.28 mm, respectively. The mean reconstruction error of the mandible was 1.36 & PLUSMN; 0.22 mm. In the AR-robot guidance module, the mean osteotomy errors of the mandible and fibula were 1.47 & PLUSMN; 0.46 and 0.98 & PLUSMN; 0.24 mm, respectively. The mean reconstruction error of the mandible was 1.20 & PLUSMN; 0.36 mm. ConclusionsThe cadaveric experiments of 12 fibulas and six mandibles demonstrate the proposed system's effectiveness and potential clinical value in reconstructing the mandibular defect with a free fibular flap.
引用
收藏
页码:363 / 377
页数:15
相关论文
共 50 条
  • [41] Application of visual tracking for robot-assisted laparoscopic surgery
    Zhang, XL
    Payandeh, S
    JOURNAL OF ROBOTIC SYSTEMS, 2002, 19 (07): : 315 - 328
  • [42] Intelligent trajectory tracking control of robot-assisted surgery
    Avazpour, Mohammad Reza
    Piltan, Farzin
    Ghiasi, Hooton
    Mazloom, Mohammad Hadi
    Sahamijoo, Amirzubir
    International Journal of Hybrid Information Technology, 2015, 8 (05): : 73 - 90
  • [43] Characterizing the Effects of Adding Virtual and Augmented Reality in Robot-Assisted Training
    Ai, Xupeng
    Santamaria, Victor
    Agrawal, Sunil K.
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 2709 - 2718
  • [44] Vibrotactile stimuli for augmented haptic feedback in robot-assisted surgery
    Peon, Adrian Ramos
    Pacchierotti, Claudio
    Prattichizzo, Domenico
    2013 WORLD HAPTICS CONFERENCE (WHC), 2013, : 473 - 478
  • [45] Inside-Out Instrument Tracking for Surgical Navigation in Augmented Reality
    Gsaxner, Christina
    Pepe, Antonio
    Schmalstieg, Dieter
    Li, Jianning
    Egger, Jan
    PROCEEDINGS OF 27TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY, VRST 2021, 2021,
  • [46] An Investigation of Errors in Fluoroscopic Navigation for Robot-Assisted Orthopedic Surgery
    Liu, Hongpeng
    Xu, Ying
    Hu, Lei
    Tang, Peifu
    Wang, Lifeng
    PROCEEDINGS OF 2018 8TH INTERNATIONAL CONFERENCE ON BIOSCIENCE, BIOCHEMISTRY AND BIOINFORMATICS (ICBBB 2018), 2018, : 134 - 138
  • [47] Assessment of surgical skills by using surgical navigation in robot-assisted partial nephrectomy
    Kobayashi, Satoshi
    Cho, Byunghyun
    Huaulme, Arnaud
    Tatsugami, Katsunori
    Honda, Hiroshi
    Jannin, Pierre
    Hashizumea, Makoto
    Eto, Masatoshi
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2019, 14 (08) : 1449 - 1459
  • [48] Assessment of surgical skills by using surgical navigation in robot-assisted partial nephrectomy
    Satoshi Kobayashi
    Byunghyun Cho
    Arnaud Huaulmé
    Katsunori Tatsugami
    Hiroshi Honda
    Pierre Jannin
    Makoto Hashizumea
    Masatoshi Eto
    International Journal of Computer Assisted Radiology and Surgery, 2019, 14 : 1449 - 1459
  • [49] Consistency of Performance of Robot-Assisted Surgical Tasks in Virtual Reality
    Suh, I. H.
    Siu, K-C
    Mukherjee, M.
    Monk, E.
    Oleynikov, D.
    Stergiou, N.
    MEDICINE MEETS VIRTUAL REALITY 17 - NEXTMED: DESIGN FOR/THE WELL BEING, 2009, 142 : 369 - 373
  • [50] A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery
    Gao, Yuan
    Zhao, Yuyun
    Xie, Le
    Zheng, Guoyan
    SENSORS, 2021, 21 (09)