Robot-assisted augmented reality surgical navigation based on optical tracking for mandibular reconstruction surgery

被引:6
|
作者
Shao, Long [1 ]
Li, Xing [2 ]
Fu, Tianyu [2 ,3 ,7 ]
Meng, Fanhao [4 ]
Zhu, Zhihui [2 ]
Zhao, Ruiqi
Huo, Minghao [5 ]
Xiao, Deqiang [6 ]
Fan, Jingfan [6 ]
Lin, Yucong
Zhang, Tao [2 ,8 ]
Yang, Jian [6 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
[2] Chinese Acad Med Sci & Peking Union Med Coll, Peking Union Med Coll Hosp, Dept Stomatol, Beijing, Peoples R China
[3] Beijing Inst Technol, Sch Med Technol, Beijing, Peoples R China
[4] Capital Med Univ, Beijing Friendship Hosp, Dept Stomatol, Beijing, Peoples R China
[5] Chinese Acad Med Sci & Peking Union Med Coll, Peking Union Med Coll Hosp, Dept Radiol, Beijing, Peoples R China
[6] Beijing Inst Technol, Beijing Engn Res Ctr Mixed Real & Adv Display, Sch Opt & Photon, Beijing, Peoples R China
[7] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
[8] Chinese Acad Med Sci & Peking Union Med Coll, Peking Union Med Coll Hosp, Dept Stomatol, Beijing 100730, Peoples R China
基金
美国国家科学基金会;
关键词
augmented reality; mandibular reconstruction; optical tracking; robot-assisted; spatial registration; FIBULA FREE-FLAP; BONE; ACCURACY; REGISTRATION; CALIBRATION; SYSTEM;
D O I
10.1002/mp.16598
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
PurposeThis work proposes a robot-assisted augmented reality (AR) surgical navigation system for mandibular reconstruction. The system accurately superimposes the preoperative osteotomy plan of the mandible and fibula into a real scene. It assists the doctor in osteotomy quickly and safely under the guidance of the robotic arm. MethodsThe proposed system mainly consists of two modules: the AR guidance module of the mandible and fibula and the robot navigation module. In the AR guidance module, we propose an AR calibration method based on the spatial registration of the image tracking marker to superimpose the virtual models of the mandible and fibula into the real scene. In the robot navigation module, the posture of the robotic arm is first calibrated under the tracking of the optical tracking system. The robotic arm can then be positioned at the planned osteotomy after the registration of the computed tomography image and the patient position. The combined guidance of AR and robotic arm can enhance the safety and precision of the surgery. ResultsThe effectiveness of the proposed system was quantitatively assessed on cadavers. In the AR guidance module, osteotomies of the mandible and fibula achieved mean errors of 1.61 & PLUSMN; 0.62 and 1.08 & PLUSMN; 0.28 mm, respectively. The mean reconstruction error of the mandible was 1.36 & PLUSMN; 0.22 mm. In the AR-robot guidance module, the mean osteotomy errors of the mandible and fibula were 1.47 & PLUSMN; 0.46 and 0.98 & PLUSMN; 0.24 mm, respectively. The mean reconstruction error of the mandible was 1.20 & PLUSMN; 0.36 mm. ConclusionsThe cadaveric experiments of 12 fibulas and six mandibles demonstrate the proposed system's effectiveness and potential clinical value in reconstructing the mandibular defect with a free fibular flap.
引用
收藏
页码:363 / 377
页数:15
相关论文
共 50 条
  • [1] Augmented Reality Navigation in Robot-Assisted Surgery with a Teleoperated Robotic Endoscope
    Penza, Veronica
    Neri, Alberto
    Koskinopoulou, Maria
    Turco, Enrico
    Soriero, Domenico
    Scabini, Stefano
    Prattichizzo, Domenico
    Mattos, Leonardo S.
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, IROS, 2023, : 4621 - 4626
  • [2] Robot-Assisted Augmented Reality (AR)-Guided Surgical Navigation for Periacetabular Osteotomy
    Ding, Haoyan
    Sun, Wenyuan
    Zheng, Guoyan
    SENSORS, 2024, 24 (14)
  • [3] Augmented Reality supports robot-assisted Kidney Surgery
    Lorenz, Judith
    AKTUELLE UROLOGIE, 2024, 55 (04) : 286 - 286
  • [4] Augmented reality and haptic interfaces for robot-assisted surgery
    Yamamoto, Tomonori
    Abolhassani, Niki
    Jung, Sung
    Okamura, Allison M.
    Judkins, Timothy N.
    INTERNATIONAL JOURNAL OF MEDICAL ROBOTICS AND COMPUTER ASSISTED SURGERY, 2012, 8 (01): : 45 - 56
  • [5] Augmented Reality Navigation System for Robot-Assisted Laparoscopic Partial Nephrectomy
    Sengiku, Atsushi
    Koeda, Masanao
    Sawada, Atsuro
    Kono, Jin
    Terada, Naoki
    Yamasaki, Toshinari
    Mizushino, Kiminori
    Kunii, Takahiro
    Onishi, Katsuhiko
    Noborio, Hiroshi
    Ogawa, Osamu
    DESIGN, USER EXPERIENCE, AND USABILITY: DESIGNING PLEASURABLE EXPERIENCES, DUXU 2017, PT II, 2017, 10289 : 575 - 584
  • [6] Applications for Augmented and Virtual Reality in Robot-Assisted Spine Surgery
    Karen Eliahu
    Jason Liounakos
    Michael Y. Wang
    Current Robotics Reports, 2022, 3 (2): : 33 - 37
  • [7] Supervised Control for Robot-Assisted Surgery Using Augmented Reality
    Ho, Tzu-Hsuan
    Song, Kai-Tai
    2020 20TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2020, : 329 - 334
  • [8] Augmented Reality supports robot-assisted Kidney Surgery Comment
    Haney, Caelan Max
    Kowalewski, Karl-Friedrich
    AKTUELLE UROLOGIE, 2024, 55 (04)
  • [9] Dynamic augmented reality for sensory substitution in robot-assisted surgical systems
    Akinbiyi, Takintope
    Reiley, Carol E.
    Saha, Sunipa
    Burschka, Darius
    Hasser, Christopher J.
    Yuh, David D.
    Okamura, Allison M.
    2006 28TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-15, 2006, : 3090 - +
  • [10] Mandibular angle split osteotomy based on a novel augmented reality navigation using specialized robot-assisted arms-A feasibility study
    Lin, Li
    Shi, Yunyong
    Tan, Andy
    Bogari, Melia
    Zhu, Ming
    Xin, Yu
    Xu, Haisong
    Zhang, Yan
    Xie, Le
    Chai, Gang
    JOURNAL OF CRANIO-MAXILLOFACIAL SURGERY, 2016, 44 (02) : 215 - 223