MARIN: an open-source mobile augmented reality interactive neuronavigation system

被引:27
|
作者
Leger, Etienne [1 ]
Reyes, Jonatan [1 ]
Drouin, Simon [2 ]
Popa, Tiberiu [1 ,3 ]
Hall, Jeffery A. [4 ]
Collins, D. Louis [5 ]
Kersten-Oertel, Marta [1 ,3 ]
机构
[1] Concordia Univ, Dept Comp Sci & Software Engn, 1455 Boul Maisonneuve 0, Montreal, PQ H3G 1M8, Canada
[2] Ecole Technol Super, Dept Software Engn & Informat Technol, 1100 Notre Dame St W, Montreal, PQ H3G 1K3, Canada
[3] Concordia Univ, PERFORM Ctr, 1455 Boul Maisonneuve 0, Montreal, PQ H3G 1M8, Canada
[4] McGill Univ, Montreal Neurol Inst, Dept Neurol & Neurosurg, 3801 Univ St, Montreal, PQ H3A 2B4, Canada
[5] McGill Univ, McConnell Brain Imaging Ctr, Montreal Neurol Inst, 3801 Univ St, Montreal, PQ H3A 2B4, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Image-guided intervention; Mobile; Augmented reality; Neuronavigation; Interactive;
D O I
10.1007/s11548-020-02155-6
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Purpose Neuronavigation systems making use of augmented reality (AR) have been the focus of much research in the last couple of decades. In recent years, there has been considerable interest in using mobile devices for AR in the operating room (OR). We propose a complete system that performs real-time AR video augmentation on a mobile device in the context of image-guided neurosurgery. Methods MARIN (mobile augmented reality interactive neuronavigation system) improves upon the state of the art in terms of performance, allowing real-time augmentation, and interactivity by allowing users to interact with the displayed data. The system was tested in a user study with 17 subjects for qualitative and quantitative evaluation in the context of target localization and brought into the OR for preliminary feasibility tests, where qualitative feedback from surgeons was obtained. Results The results of the user study showed that MARIN performs significantly better in terms of both time (p<0.0004 and accuracy (p<0.04 ) for the task of target localization in comparison with a traditional image-guided neurosurgery (IGNS) navigation system. Further, MARIN AR visualization was found to be more intuitive and allowed users to estimate target depth more easily. Conclusion MARIN improves upon previously proposed mobile AR neuronavigation systems with its real-time performance, higher accuracy, full integration in the normal workflow and greater interactivity and customizability of the displayed information. The improvement in efficiency and usability over previous systems will facilitate bringing AR into the OR.
引用
收藏
页码:1013 / 1021
页数:9
相关论文
共 50 条
  • [1] MARIN: an open-source mobile augmented reality interactive neuronavigation system
    Étienne Léger
    Jonatan Reyes
    Simon Drouin
    Tiberiu Popa
    Jeffery A. Hall
    D. Louis Collins
    Marta Kersten-Oertel
    [J]. International Journal of Computer Assisted Radiology and Surgery, 2020, 15 : 1013 - 1021
  • [2] A Neuronavigation System Using a Mobile Augmented Reality Solution
    de Almeida, Antonio Guilherme C.
    Santos, Bruno Fernandes de Oliveira
    Oliveira, Joselina L. M.
    [J]. WORLD NEUROSURGERY, 2022, 167 : E1261 - E1267
  • [3] An accessible, open-source mobile application for macromolecular visualization using augmented reality
    Lee, Ning Yuan
    Tucker-Kellogg, Greg
    [J]. BIOCHEMISTRY AND MOLECULAR BIOLOGY EDUCATION, 2020, 48 (03) : 297 - 303
  • [4] Mobile phone as an interactive device in augmented reality system
    Kostak, Milan
    Jezek, Bruno
    [J]. DIVAI 2018: 12TH INTERNATIONAL SCIENTIFIC CONFERENCE ON DISTANCE LEARNING IN APPLIED INFORMATICS, 2018, : 461 - 471
  • [5] TrainAR: An Open-Source Visual Scripting-Based Authoring Tool for Procedural Mobile Augmented Reality Trainings
    Blattgerste, Jonas
    Behrends, Jan
    Pfeiffer, Thies
    [J]. INFORMATION, 2023, 14 (04)
  • [6] OPEN AUGMENTED REALITY SYSTEM FOR MOBILE MARKERLESS TRACKING
    Maidi, Madjid
    Lehiani, Yassine
    Preda, Marius
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2591 - 2595
  • [7] Mobile Commerce System Integrated with Augmented Reality and Interactive Multimedia
    Liu, Shuo Fang
    Lee, Meng Hsuan
    [J]. PRZEGLAD ELEKTROTECHNICZNY, 2012, 88 (9B): : 100 - 103
  • [8] ASMIM: Augmented Reality Authoring System for Mobile Interactive Manuals
    Nguyen, Tam, V
    Mirza, Bilal
    Tan, Dorothy
    Sepulveda, Jose
    [J]. PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON UBIQUITOUS INFORMATION MANAGEMENT AND COMMUNICATION (IMCOM 2018), 2018,
  • [9] Cloud Computing Based Mobile Augmented Reality Interactive System
    Chiu, Pei-Hsuan
    Tseng, Po-Hsuan
    Feng, Kai-Ten
    [J]. 2014 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2014, : 3320 - 3325
  • [10] Mobile Augmented Reality for Interactive Catalogue
    El-firjani, Naser F. Mohamed
    Maatuk, Abdelsalam M.
    [J]. 2016 INTERNATIONAL CONFERENCE ON ENGINEERING & MIS (ICEMIS), 2016,