MARIN: an open-source mobile augmented reality interactive neuronavigation system

被引:27
|
作者
Leger, Etienne [1 ]
Reyes, Jonatan [1 ]
Drouin, Simon [2 ]
Popa, Tiberiu [1 ,3 ]
Hall, Jeffery A. [4 ]
Collins, D. Louis [5 ]
Kersten-Oertel, Marta [1 ,3 ]
机构
[1] Concordia Univ, Dept Comp Sci & Software Engn, 1455 Boul Maisonneuve 0, Montreal, PQ H3G 1M8, Canada
[2] Ecole Technol Super, Dept Software Engn & Informat Technol, 1100 Notre Dame St W, Montreal, PQ H3G 1K3, Canada
[3] Concordia Univ, PERFORM Ctr, 1455 Boul Maisonneuve 0, Montreal, PQ H3G 1M8, Canada
[4] McGill Univ, Montreal Neurol Inst, Dept Neurol & Neurosurg, 3801 Univ St, Montreal, PQ H3A 2B4, Canada
[5] McGill Univ, McConnell Brain Imaging Ctr, Montreal Neurol Inst, 3801 Univ St, Montreal, PQ H3A 2B4, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Image-guided intervention; Mobile; Augmented reality; Neuronavigation; Interactive;
D O I
10.1007/s11548-020-02155-6
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Purpose Neuronavigation systems making use of augmented reality (AR) have been the focus of much research in the last couple of decades. In recent years, there has been considerable interest in using mobile devices for AR in the operating room (OR). We propose a complete system that performs real-time AR video augmentation on a mobile device in the context of image-guided neurosurgery. Methods MARIN (mobile augmented reality interactive neuronavigation system) improves upon the state of the art in terms of performance, allowing real-time augmentation, and interactivity by allowing users to interact with the displayed data. The system was tested in a user study with 17 subjects for qualitative and quantitative evaluation in the context of target localization and brought into the OR for preliminary feasibility tests, where qualitative feedback from surgeons was obtained. Results The results of the user study showed that MARIN performs significantly better in terms of both time (p<0.0004 and accuracy (p<0.04 ) for the task of target localization in comparison with a traditional image-guided neurosurgery (IGNS) navigation system. Further, MARIN AR visualization was found to be more intuitive and allowed users to estimate target depth more easily. Conclusion MARIN improves upon previously proposed mobile AR neuronavigation systems with its real-time performance, higher accuracy, full integration in the normal workflow and greater interactivity and customizability of the displayed information. The improvement in efficiency and usability over previous systems will facilitate bringing AR into the OR.
引用
收藏
页码:1013 / 1021
页数:9
相关论文
共 50 条
  • [31] Mobile Augmented Reality Shopping System
    Roche, Colter
    Hamam, Abdelwehab
    [J]. SOUTHEASTCON 2023, 2023, : 704 - 705
  • [32] IMARISS: Story Creation Tools - Inspiration Mobile Augmented Reality Interactive Story System
    Yu, Yaojiong
    Phillips, Mike
    [J]. DESIGN, USER EXPERIENCE, AND USABILITY, DUXU 2024, PT IV, 2024, 14715 : 98 - 117
  • [33] Mobile Augmented Reality Based Interactive Teaching & Learning System with Low Computation Approach
    Prasad, Shitala
    Peddoju, Sateesh K.
    Ghosh, Debashis
    [J]. PROCEEDINGS OF THE 2013 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE IN CONTROL AND AUTOMATION (CICA), 2013, : 97 - 103
  • [34] Augmented Mirror: Interactive Augmented Reality System Based on Kinect
    Vera, Lucia
    Gimeno, Jesus
    Coma, Inmaculada
    Fernandez, Marcos
    [J]. HUMAN-COMPUTER INTERACTION - INTERACT 2011, PT IV, 2011, 6949 : 483 - 486
  • [35] An Interactive Augmented Reality System for Exposure Treatment
    Corbett-Davies, Sam
    Duenser, Andreas
    Clark, Adrian
    [J]. 2012 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR) - ARTS, MEDIA, AND HUMANITIES, 2012,
  • [36] An interactive augmented reality system for engineering education
    Liarokapis, F
    Mourkoussis, N
    Petridis, P
    Rumsey, S
    Lister, PF
    White, M
    [J]. 3RD GLOBAL CONGRESS ON ENGINEERING EDUCATION, CONGRESS PROCEEDINGS, 2002, : 334 - 337
  • [37] Designing an Open-Source Interactive Simulation of Stokes' Law
    Crowley, Shane V. V.
    [J]. JOURNAL OF CHEMICAL EDUCATION, 2023, 100 (09) : 3626 - 3633
  • [38] BlenderVR: Open-source Framework for Interactive and Immersive VR
    Katz, Brian F. G.
    Felinto, Dalai Q.
    Touraine, Damien
    Poirier-Quinot, David
    Bourdot, Patrick
    [J]. 2015 IEEE VIRTUAL REALITY CONFERENCE (VR), 2015, : 203 - 204
  • [39] MyVision AIR : An Augmented Interactive Reality Book Mobile Application
    Al-Ali, Hamda
    Bazzaza, Mhd Wael
    Zemerly, M. Jamal
    Ng, Jason W. P.
    [J]. PROCEEDINGS OF 2016 IEEE GLOBAL ENGINEERING EDUCATION CONFERENCE (EDUCON2016), 2016, : 741 - 745
  • [40] Mobile tele-instruction using interactive augmented reality
    Park, J
    [J]. HUMAN-COMPUTER INTERACTION WITH MOBILE DEVICES AND SERVICES, 2003, 2795 : 461 - 465