MARIN: an open-source mobile augmented reality interactive neuronavigation system

被引:27
|
作者
Leger, Etienne [1 ]
Reyes, Jonatan [1 ]
Drouin, Simon [2 ]
Popa, Tiberiu [1 ,3 ]
Hall, Jeffery A. [4 ]
Collins, D. Louis [5 ]
Kersten-Oertel, Marta [1 ,3 ]
机构
[1] Concordia Univ, Dept Comp Sci & Software Engn, 1455 Boul Maisonneuve 0, Montreal, PQ H3G 1M8, Canada
[2] Ecole Technol Super, Dept Software Engn & Informat Technol, 1100 Notre Dame St W, Montreal, PQ H3G 1K3, Canada
[3] Concordia Univ, PERFORM Ctr, 1455 Boul Maisonneuve 0, Montreal, PQ H3G 1M8, Canada
[4] McGill Univ, Montreal Neurol Inst, Dept Neurol & Neurosurg, 3801 Univ St, Montreal, PQ H3A 2B4, Canada
[5] McGill Univ, McConnell Brain Imaging Ctr, Montreal Neurol Inst, 3801 Univ St, Montreal, PQ H3A 2B4, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Image-guided intervention; Mobile; Augmented reality; Neuronavigation; Interactive;
D O I
10.1007/s11548-020-02155-6
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Purpose Neuronavigation systems making use of augmented reality (AR) have been the focus of much research in the last couple of decades. In recent years, there has been considerable interest in using mobile devices for AR in the operating room (OR). We propose a complete system that performs real-time AR video augmentation on a mobile device in the context of image-guided neurosurgery. Methods MARIN (mobile augmented reality interactive neuronavigation system) improves upon the state of the art in terms of performance, allowing real-time augmentation, and interactivity by allowing users to interact with the displayed data. The system was tested in a user study with 17 subjects for qualitative and quantitative evaluation in the context of target localization and brought into the OR for preliminary feasibility tests, where qualitative feedback from surgeons was obtained. Results The results of the user study showed that MARIN performs significantly better in terms of both time (p<0.0004 and accuracy (p<0.04 ) for the task of target localization in comparison with a traditional image-guided neurosurgery (IGNS) navigation system. Further, MARIN AR visualization was found to be more intuitive and allowed users to estimate target depth more easily. Conclusion MARIN improves upon previously proposed mobile AR neuronavigation systems with its real-time performance, higher accuracy, full integration in the normal workflow and greater interactivity and customizability of the displayed information. The improvement in efficiency and usability over previous systems will facilitate bringing AR into the OR.
引用
收藏
页码:1013 / 1021
页数:9
相关论文
共 50 条
  • [21] Interactive Augmented Reality Authoring System using Mobile Device as Input Method
    Yang, Yoonsik
    Shim, Jinwook
    Chae, Seungho
    Han, Tack-Don
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2016, : 1429 - 1432
  • [22] OpenUVR: an Open-Source System Framework for Untethered Virtual Reality Applications
    Rohloff, Alec
    Allen, Zackary
    Lin, Kung-Min
    Okrend, Joshua
    Nie, Chengyi
    Liu, Yu-Chia
    Tseng, Hung-Wei
    [J]. 2021 IEEE 27TH REAL-TIME AND EMBEDDED TECHNOLOGY AND APPLICATIONS SYMPOSIUM (RTAS 2021), 2021, : 223 - 236
  • [23] Mobile Augmented Reality Interactive Systems for Urban Tourism
    Samardzija, Ana Coric
    [J]. CENTRAL EUROPEAN CONFERENCE ON INFORMATION AND INTELLIGENT SYSTEMS, 2015, 2015, : 129 - 134
  • [24] Development of an Interactive Book with Augmented Reality for Mobile Learning
    Correa, Ana Grasielle D.
    Tahira, Andre
    Ribeiro, Joao B., Jr.
    Kitamura, Rodrigo K.
    Inoue, Tiago Y.
    Ficheman, Irene Karaguilla
    [J]. PROCEEDINGS OF THE 2013 8TH IBERIAN CONFERENCE ON INFORMATION SYSTEMS AND TECHNOLOGIES (CISTI 2013), 2013,
  • [25] Mobile Application of Interactive Remote Toys with Augmented Reality
    Lin, Chi-Fu
    Pa, Pai-Shan
    Fuh, Chiou-Shann
    [J]. 2013 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2013,
  • [26] Interactive Authoring Tool for Mobile Augmented Reality Content
    Jeon, Jiyoung
    Hong, Min
    Yi, Manhui
    Chun, Jiyoon
    Kim, Ji Sim
    Choi, Yoo-Joo
    [J]. JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2016, 12 (04): : 612 - 630
  • [27] Mobile Technologies and Augmented Reality in Open Education
    Kilinc, Hakan
    [J]. TURKISH ONLINE JOURNAL OF DISTANCE EDUCATION, 2019, 20 (02): : 219 - 222
  • [28] An Interactive Augmented Reality Volume Rendering Mobile Application
    Mady, Amr S.
    Abou El-Seoud, Samir
    [J]. INTERNET OF THINGS, INFRASTRUCTURES AND MOBILE APPLICATIONS, 2021, 1192 : 888 - 896
  • [29] Open-Source IoT Framework for Mobile Household Water Reuse System
    Dotson, Aaron D.
    Cenek, Martin
    Michaelson, Gregory
    [J]. 2019 IEEE GLOBAL HUMANITARIAN TECHNOLOGY CONFERENCE (GHTC), 2019, : 476 - 480
  • [30] AN OPEN-SOURCE ARCHIVING SYSTEM
    Rappaport, T. S.
    Murdock, J. N.
    Michelson, D. G.
    Shapiro, R.
    [J]. IEEE VEHICULAR TECHNOLOGY MAGAZINE, 2011, 6 (02): : 24 - 32