Robot-assisted augmented reality surgical navigation based on optical tracking for mandibular reconstruction surgery

被引:8
|
作者
Shao, Long [1 ]
Li, Xing [2 ]
Fu, Tianyu [2 ,3 ,7 ]
Meng, Fanhao [4 ]
Zhu, Zhihui [2 ]
Zhao, Ruiqi
Huo, Minghao [5 ]
Xiao, Deqiang [6 ]
Fan, Jingfan [6 ]
Lin, Yucong
Zhang, Tao [2 ,8 ]
Yang, Jian [6 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
[2] Chinese Acad Med Sci & Peking Union Med Coll, Peking Union Med Coll Hosp, Dept Stomatol, Beijing, Peoples R China
[3] Beijing Inst Technol, Sch Med Technol, Beijing, Peoples R China
[4] Capital Med Univ, Beijing Friendship Hosp, Dept Stomatol, Beijing, Peoples R China
[5] Chinese Acad Med Sci & Peking Union Med Coll, Peking Union Med Coll Hosp, Dept Radiol, Beijing, Peoples R China
[6] Beijing Inst Technol, Beijing Engn Res Ctr Mixed Real & Adv Display, Sch Opt & Photon, Beijing, Peoples R China
[7] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
[8] Chinese Acad Med Sci & Peking Union Med Coll, Peking Union Med Coll Hosp, Dept Stomatol, Beijing 100730, Peoples R China
基金
美国国家科学基金会;
关键词
augmented reality; mandibular reconstruction; optical tracking; robot-assisted; spatial registration; FIBULA FREE-FLAP; BONE; ACCURACY; REGISTRATION; CALIBRATION; SYSTEM;
D O I
10.1002/mp.16598
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
PurposeThis work proposes a robot-assisted augmented reality (AR) surgical navigation system for mandibular reconstruction. The system accurately superimposes the preoperative osteotomy plan of the mandible and fibula into a real scene. It assists the doctor in osteotomy quickly and safely under the guidance of the robotic arm. MethodsThe proposed system mainly consists of two modules: the AR guidance module of the mandible and fibula and the robot navigation module. In the AR guidance module, we propose an AR calibration method based on the spatial registration of the image tracking marker to superimpose the virtual models of the mandible and fibula into the real scene. In the robot navigation module, the posture of the robotic arm is first calibrated under the tracking of the optical tracking system. The robotic arm can then be positioned at the planned osteotomy after the registration of the computed tomography image and the patient position. The combined guidance of AR and robotic arm can enhance the safety and precision of the surgery. ResultsThe effectiveness of the proposed system was quantitatively assessed on cadavers. In the AR guidance module, osteotomies of the mandible and fibula achieved mean errors of 1.61 & PLUSMN; 0.62 and 1.08 & PLUSMN; 0.28 mm, respectively. The mean reconstruction error of the mandible was 1.36 & PLUSMN; 0.22 mm. In the AR-robot guidance module, the mean osteotomy errors of the mandible and fibula were 1.47 & PLUSMN; 0.46 and 0.98 & PLUSMN; 0.24 mm, respectively. The mean reconstruction error of the mandible was 1.20 & PLUSMN; 0.36 mm. ConclusionsThe cadaveric experiments of 12 fibulas and six mandibles demonstrate the proposed system's effectiveness and potential clinical value in reconstructing the mandibular defect with a free fibular flap.
引用
收藏
页码:363 / 377
页数:15
相关论文
共 50 条
  • [31] Augmented Reality Toolkit for a Smart Robot-Assisted MIS Platform
    Zampokas, Georgios
    Tsiolis, Konstantinos
    Peleka, Georgia
    Topalidou-Kyniazopoulou, Angeliki
    Mariolis, Ioannis
    Malasiotis, Sotiris
    Tzovaras, Dimitrios
    XV MEDITERRANEAN CONFERENCE ON MEDICAL AND BIOLOGICAL ENGINEERING AND COMPUTING - MEDICON 2019, 2020, 76 : 1536 - 1544
  • [32] Enhancing Spatial Navigation in Robot-Assisted Surgery: An Application
    Gribaudo, Marco
    Moos, Sandro
    Piazzolla, Pietro
    Porpiglia, Francesco
    Vezzetti, Enrico
    Violante, Maria Grazia
    DESIGN TOOLS AND METHODS IN INDUSTRIAL ENGINEERING, ADM 2019, 2020, : 95 - 105
  • [33] Robot-assisted surgery - Surgical and anesthesiological implications
    Ender, J
    Autschbach, R
    Falk, V
    Rauch, T
    Petry, A
    Mohr, FW
    ANASTHESIOLOGIE INTENSIVMEDIZIN NOTFALLMEDIZIN SCHMERZTHERAPIE, 2001, 36 (02): : 118 - 122
  • [34] Feasibility of a Robot-Assisted Surgical Navigation System for Mandibular Distraction Osteogenesis in Hemifacial Microsomia: A Model Experiment
    Kim, Byeong Seop
    Zhang, Ziwei
    Sun, Mengzhe
    Han, Wenqing
    Chen, Xiaojun
    Yan, Yingjie
    Shi, Yunyong
    Xu, Haisong
    Lin, Li
    Chai, Gang
    JOURNAL OF CRANIOFACIAL SURGERY, 2023, 34 (02) : 525 - 531
  • [35] Vision-based augmented reality computer assisted surgery navigation system
    Sun, Lei
    Chen, Xin
    Xu, Kebin
    Li, Xin
    Xu, Wei
    MIPPR 2007: MEDICAL IMAGING, PARALLEL PROCESSING OF IMAGES, AND OPTIMIZATION TECHNIQUES, 2007, 6789
  • [36] Vision-Based Markerless Tracking for Continuum Surgical Instruments in Robot-Assisted Minimally Invasive Surgery
    Wang, Longfei
    Zhou, Chang
    Cao, Yuzhen
    Zhao, Ren
    Xu, Kai
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (11) : 7202 - 7209
  • [37] Robot-Assisted Teleoperation Ultrasound System Based on Fusion of Augmented Reality and Predictive Force
    Fu, Yongqing
    Lin, Weiyang
    Yu, Xinghu
    Rodriguez-Andina, Juan J. J.
    Gao, Huijun
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2023, 70 (07) : 7449 - 7456
  • [38] Adjacent surface trajectory planning of robot-assisted tooth preparation based on augmented reality
    Jiang, Jingang
    Guo, Yafeng
    Huang, Zhiyuan
    Zhang, Yongde
    Wu, Dianhao
    Liu, Yi
    ENGINEERING SCIENCE AND TECHNOLOGY-AN INTERNATIONAL JOURNAL-JESTECH, 2022, 27
  • [39] Surgical navigation-assisted mandibular reconstruction with fibula flaps
    Shang, X. -F.
    Chen, H. -M.
    Liang, J.
    Huang, J. -W.
    Zhang, L.
    Cai, Z. -G.
    Guo, Chuanbin
    INTERNATIONAL JOURNAL OF ORAL AND MAXILLOFACIAL SURGERY, 2016, 45 (04) : 448 - 453
  • [40] Safety Protection Based on Electromagnetic Navigation in Robot-assisted Vascular Interventional Surgery
    Tao, Li
    Xie, Hongzhi
    Zhang, Shuyang
    Gu, Lixu
    2017 10TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI), 2017,