Robot-assisted augmented reality surgical navigation based on optical tracking for mandibular reconstruction surgery

被引:8
|
作者
Shao, Long [1 ]
Li, Xing [2 ]
Fu, Tianyu [2 ,3 ,7 ]
Meng, Fanhao [4 ]
Zhu, Zhihui [2 ]
Zhao, Ruiqi
Huo, Minghao [5 ]
Xiao, Deqiang [6 ]
Fan, Jingfan [6 ]
Lin, Yucong
Zhang, Tao [2 ,8 ]
Yang, Jian [6 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
[2] Chinese Acad Med Sci & Peking Union Med Coll, Peking Union Med Coll Hosp, Dept Stomatol, Beijing, Peoples R China
[3] Beijing Inst Technol, Sch Med Technol, Beijing, Peoples R China
[4] Capital Med Univ, Beijing Friendship Hosp, Dept Stomatol, Beijing, Peoples R China
[5] Chinese Acad Med Sci & Peking Union Med Coll, Peking Union Med Coll Hosp, Dept Radiol, Beijing, Peoples R China
[6] Beijing Inst Technol, Beijing Engn Res Ctr Mixed Real & Adv Display, Sch Opt & Photon, Beijing, Peoples R China
[7] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
[8] Chinese Acad Med Sci & Peking Union Med Coll, Peking Union Med Coll Hosp, Dept Stomatol, Beijing 100730, Peoples R China
基金
美国国家科学基金会;
关键词
augmented reality; mandibular reconstruction; optical tracking; robot-assisted; spatial registration; FIBULA FREE-FLAP; BONE; ACCURACY; REGISTRATION; CALIBRATION; SYSTEM;
D O I
10.1002/mp.16598
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
PurposeThis work proposes a robot-assisted augmented reality (AR) surgical navigation system for mandibular reconstruction. The system accurately superimposes the preoperative osteotomy plan of the mandible and fibula into a real scene. It assists the doctor in osteotomy quickly and safely under the guidance of the robotic arm. MethodsThe proposed system mainly consists of two modules: the AR guidance module of the mandible and fibula and the robot navigation module. In the AR guidance module, we propose an AR calibration method based on the spatial registration of the image tracking marker to superimpose the virtual models of the mandible and fibula into the real scene. In the robot navigation module, the posture of the robotic arm is first calibrated under the tracking of the optical tracking system. The robotic arm can then be positioned at the planned osteotomy after the registration of the computed tomography image and the patient position. The combined guidance of AR and robotic arm can enhance the safety and precision of the surgery. ResultsThe effectiveness of the proposed system was quantitatively assessed on cadavers. In the AR guidance module, osteotomies of the mandible and fibula achieved mean errors of 1.61 & PLUSMN; 0.62 and 1.08 & PLUSMN; 0.28 mm, respectively. The mean reconstruction error of the mandible was 1.36 & PLUSMN; 0.22 mm. In the AR-robot guidance module, the mean osteotomy errors of the mandible and fibula were 1.47 & PLUSMN; 0.46 and 0.98 & PLUSMN; 0.24 mm, respectively. The mean reconstruction error of the mandible was 1.20 & PLUSMN; 0.36 mm. ConclusionsThe cadaveric experiments of 12 fibulas and six mandibles demonstrate the proposed system's effectiveness and potential clinical value in reconstructing the mandibular defect with a free fibular flap.
引用
收藏
页码:363 / 377
页数:15
相关论文
共 50 条
  • [21] Robot-assisted Occlusion Avoidance for Surgical Instrument Optical Tracking System
    Wang, Jiaole
    Qi, Lin
    Meng, Max Q. -H.
    2015 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION, 2015, : 375 - 380
  • [22] Augmented reality and optical navigation assisted orbital surgery: a novel integrated workflow
    Tonchev, Nikolay
    Renieri, Giulia
    Stein, Klaus-Peter
    Neyazi, Belal
    Willgerodt, Max
    Thieme, Hagen
    Sandalcioglu, I. Erol
    Hartmann, Karl
    INNOVATIVE SURGICAL SCIENCES, 2024,
  • [23] Robot-assisted mandibular angle osteotomy using electromagnetic navigation
    Sun, Mengzhe
    Lin, Li
    Chen, Xiaojun
    Xu, Cheng
    Zin, Mar Aung
    Han, Wenqing
    Chai, Gang
    ANNALS OF TRANSLATIONAL MEDICINE, 2021, 9 (07)
  • [24] Virtual Reality Simulators for Robot-assisted Surgery
    Breda, Alberto
    Territo, Angelo
    EUROPEAN UROLOGY, 2016, 69 (06) : 1081 - 1082
  • [25] Endoscopic Vision-Based Tracking of Multiple Surgical Instruments During Robot-Assisted Surgery
    Ryu, Jiwon
    Choi, Jaesoon
    Kim, Hee Chan
    ARTIFICIAL ORGANS, 2013, 37 (01) : 107 - 112
  • [26] Robot-Assisted Cardiac Surgery: Reality or Fiction?
    Reuthebuch, O.
    Schurr, U.
    Genoni, M.
    JOURNAL FUR KARDIOLOGIE, 2007, 14 (11-12): : 316 - 322
  • [27] ROBOT-ASSISTED RADICAL PROSTATECTOMY WITH 3D-BASED AUGMENTED REALITY
    Porpiglia, Francesco
    Bertolo, Riccardo
    Checcucci, Enrico
    Amparore, Daniele
    Fiori, Cristian
    JOURNAL OF UROLOGY, 2018, 199 (04): : E820 - E820
  • [28] Impact of optical navigation variables on the accuracy of robot-assisted surgery: a study of the TIANJI Robot system
    Shi, Zhan
    Li, Zu-Chang
    Fan, Ming-Xing
    Wang, Qi-Long
    Liu, Bo
    Lang, Zhao
    He, Da
    Tian, Wei
    JOURNAL OF ROBOTIC SURGERY, 2024, 18 (01)
  • [29] The Current Status and Challenges in Augmented-Reality Navigation System for Robot-Assisted Laparoscopic Partial Nephrectomy
    Hamada, Akihiro
    Sawada, Atsuro
    Kono, Jin
    Koeda, Masanao
    Onishi, Katsuhiko
    Kobayashi, Takashi
    Yamasaki, Toshinari
    Inoue, Takahiro
    Noborio, Hiroshi
    Ogawa, Osamu
    HUMAN-COMPUTER INTERACTION. MULTIMODAL AND NATURAL INTERACTION, HCI 2020, PT II, 2020, 12182 : 620 - 629
  • [30] Augmented Reality Robot-assisted Radical Prostatectomy: Preliminary Experience
    Porpiglia, Francesco
    Fiori, Cristian
    Checcucci, Enrico
    Amparore, Daniele
    Bertolo, Riccardo
    UROLOGY, 2018, 115 : 184 - 184