Robot-Assisted Augmented Reality (AR)-Guided Surgical Navigation for Periacetabular Osteotomy

被引:0
|
作者
Ding, Haoyan [1 ]
Sun, Wenyuan [1 ]
Zheng, Guoyan [1 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Med Robot, Sch Biomed Engn, Shanghai 200240, Peoples R China
基金
国家重点研发计划; 美国国家科学基金会;
关键词
augmented reality; robot-assisted; surgical navigation; periacetabular osteotomy; computer-assisted orthopedic surgery; ACETABULAR OSTEOTOMY; SYSTEM;
D O I
10.3390/s24144754
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Periacetabular osteotomy (PAO) is an effective approach for the surgical treatment of developmental dysplasia of the hip (DDH). However, due to the complex anatomical structure around the hip joint and the limited field of view (FoV) during the surgery, it is challenging for surgeons to perform a PAO surgery. To solve this challenge, we propose a robot-assisted, augmented reality (AR)-guided surgical navigation system for PAO. The system mainly consists of a robot arm, an optical tracker, and a Microsoft HoloLens 2 headset, which is a state-of-the-art (SOTA) optical see-through (OST) head-mounted display (HMD). For AR guidance, we propose an optical marker-based AR registration method to estimate a transformation from the optical tracker coordinate system (COS) to the virtual space COS such that the virtual models can be superimposed on the corresponding physical counterparts. Furthermore, to guide the osteotomy, the developed system automatically aligns a bone saw with osteotomy planes planned in preoperative images. Then, it provides surgeons with not only virtual constraints to restrict movement of the bone saw but also AR guidance for visual feedback without sight diversion, leading to higher surgical accuracy and improved surgical safety. Comprehensive experiments were conducted to evaluate both the AR registration accuracy and osteotomy accuracy of the developed navigation system. The proposed AR registration method achieved an average mean absolute distance error (mADE) of 1.96 +/- 0.43 mm. The robotic system achieved an average center translation error of 0.96 +/- 0.23 mm, an average maximum distance of 1.31 +/- 0.20 mm, and an average angular deviation of 3.77 +/- 0.85 degrees. Experimental results demonstrated both the AR registration accuracy and the osteotomy accuracy of the developed system.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Augmented reality-guided periacetabular osteotomy—proof of concept
    Pascal Kiarostami
    Cyrill Dennler
    Simon Roner
    Reto Sutter
    Philipp Fürnstahl
    Mazda Farshad
    Stefan Rahm
    Patrick O. Zingg
    [J]. Journal of Orthopaedic Surgery and Research, 15
  • [2] The technique of augmented reality guided periacetabular osteotomy -feasibility experiments
    Kiarostami, Pascal
    Dennler, Cyrill
    Roner, Simon
    Sutter, Reto
    Furnstahl, Philipp
    Farshad, Mazda
    Zingg, Patrick
    [J]. SWISS MEDICAL WEEKLY, 2019, 149 : 24S - 25S
  • [3] Robot-assisted augmented reality surgical navigation based on optical tracking for mandibular reconstruction surgery
    Shao, Long
    Li, Xing
    Fu, Tianyu
    Meng, Fanhao
    Zhu, Zhihui
    Zhao, Ruiqi
    Huo, Minghao
    Xiao, Deqiang
    Fan, Jingfan
    Lin, Yucong
    Zhang, Tao
    Yang, Jian
    [J]. MEDICAL PHYSICS, 2024, 51 (01) : 363 - 377
  • [4] Augmented Reality Navigation System for Robot-Assisted Laparoscopic Partial Nephrectomy
    Sengiku, Atsushi
    Koeda, Masanao
    Sawada, Atsuro
    Kono, Jin
    Terada, Naoki
    Yamasaki, Toshinari
    Mizushino, Kiminori
    Kunii, Takahiro
    Onishi, Katsuhiko
    Noborio, Hiroshi
    Ogawa, Osamu
    [J]. DESIGN, USER EXPERIENCE, AND USABILITY: DESIGNING PLEASURABLE EXPERIENCES, DUXU 2017, PT II, 2017, 10289 : 575 - 584
  • [5] Augmented Reality Navigation in Robot-Assisted Surgery with a Teleoperated Robotic Endoscope
    Penza, Veronica
    Neri, Alberto
    Koskinopoulou, Maria
    Turco, Enrico
    Soriero, Domenico
    Scabini, Stefano
    Prattichizzo, Domenico
    Mattos, Leonardo S.
    [J]. 2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, IROS, 2023, : 4621 - 4626
  • [6] Augmented reality-guided periacetabular osteotomy-proof of concept
    Kiarostami, Pascal
    Dennler, Cyrill
    Roner, Simon
    Sutter, Reto
    Fuernstahl, Philipp
    Farshad, Mazda
    Rahm, Stefan
    Zingg, Patrick O.
    [J]. JOURNAL OF ORTHOPAEDIC SURGERY AND RESEARCH, 2020, 15 (01)
  • [7] Dynamic augmented reality for sensory substitution in robot-assisted surgical systems
    Akinbiyi, Takintope
    Reiley, Carol E.
    Saha, Sunipa
    Burschka, Darius
    Hasser, Christopher J.
    Yuh, David D.
    Okamura, Allison M.
    [J]. 2006 28TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-15, 2006, : 3090 - +
  • [8] Mandibular angle split osteotomy based on a novel augmented reality navigation using specialized robot-assisted arms-A feasibility study
    Lin, Li
    Shi, Yunyong
    Tan, Andy
    Bogari, Melia
    Zhu, Ming
    Xin, Yu
    Xu, Haisong
    Zhang, Yan
    Xie, Le
    Chai, Gang
    [J]. JOURNAL OF CRANIO-MAXILLOFACIAL SURGERY, 2016, 44 (02) : 215 - 223
  • [9] Hand gesture guided robot-assisted surgery based on a direct augmented reality interface
    Wen, Rong
    Tay, Wei-Liang
    Nguyen, Binh P.
    Chng, Chin-Boon
    Chui, Chee-Kong
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2014, 116 (02) : 68 - 80
  • [10] Augmented Reality supports robot-assisted Kidney Surgery
    Lorenz, Judith
    [J]. AKTUELLE UROLOGIE, 2024, 55 (04) : 286 - 286