Feasibility of a Real-Time Clinical Augmented Reality and Artificial Intelligence Framework for Pain Detection and Localization From the Brain

被引:26
|
作者
Hu, Xiao-Su [1 ,2 ]
Nascimento, Thiago D. [1 ]
Bender, Mary C. [1 ]
Hall, Theodore [3 ]
Petty, Sean [3 ]
O'Malley, Stephanie [3 ]
Ellwood, Roger P. [4 ]
Kaciroti, Niko [1 ,2 ,5 ]
Maslowski, Eric [6 ]
DaSilva, Alexandre F. [1 ,2 ]
机构
[1] Univ Michigan, Sch Dent, Biol & Mat Sci Dept, Headache & Orofacial Pain Effort Lab, 1011 N Univ Ave, Ann Arbor, MI 48109 USA
[2] Univ Michigan, Ctr Human Growth & Dev, Ann Arbor, MI 48109 USA
[3] Univ Michigan, 3D Lab, Digital Media Commons, Ann Arbor, MI 48109 USA
[4] Colgate Palmol, Clin Method Dev, Piscataway, NJ USA
[5] Univ Michigan, Sch Publ Hlth, Dept Biostat, Ann Arbor, MI 48109 USA
[6] Moxytech Inc, Ann Arbor, MI USA
关键词
pain; spectroscopy; near-infrared; virtual reality; artificial intelligence; NEAR-INFRARED SPECTROSCOPY;
D O I
10.2196/13594
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Background: For many years, clinicians have been seeking for objective pain assessment solutions via neuroimaging techniques, focusing on the brain to detect human pain. Unfortunately, most of those techniques are not applicable in the clinical environment or lack accuracy. Objective: This study aimed to test the feasibility of a mobile neuroimaging-based clinical augmented reality (AR) and artificial intelligence (AI) framework, CLARAi, for objective pain detection and also localization direct from the patient's brain in real time. Methods: Clinical dental pain was triggered in 21 patients by hypersensitive tooth stimulation with 20 consecutive descending cold stimulations (32 degrees C-0 degrees C). We used a portable optical neuroimaging technology, functional near-infrared spectroscopy, to gauge their cortical activity during evoked acute clinical pain. The data were decoded using a neural network (NN)-based AI algorithm to classify hemodynamic response data into pain and no-pain brain states in real time. We tested the performance of several networks (NN with 7 layers, 6 layers, 5 layers, 3 layers, recurrent NN, and long short-term memory network) upon reorganized data features on pain diction and localization in a simulated real-time environment. In addition, we also tested the feasibility of transmitting the neuroimaging data to an AR device, HoloLens, in the same simulated environment, allowing visualization of the ongoing cortical activity on a 3-dimensional brain template virtually plotted on the patients' head during clinical consult. Results: The artificial neutral network (3-layer NN) achieved an optimal classification accuracy at 80.37% (126,000/156,680) for pain and no pain discrimination, with positive likelihood ratio (PLR) at 2.35. We further explored a 3-class localization task of left/right side pain and no-pain states, and convolutional NN-6 (6-layer NN) achieved highest classification accuracy at 74.23% (1040/1401) with PLR at 2.02. Conclusions: Additional studies are needed to optimize and validate our prototype CLARAi framework for other pains and neurologic disorders. However, we presented an innovative and feasible neuroimaging-based AR/AI concept that can potentially transform the human brain into an objective target to visualize and precisely measure and localize pain in real time where it is most needed: in the doctor's office.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] An augmented reality microscope with real-time artificial intelligence integration for cancer diagnosis
    Chen, Po-Hsuan Cameron
    Gadepalli, Krishna
    MacDonald, Robert
    Liu, Yun
    Kadowaki, Shiro
    Nagpal, Kunal
    Kohlberger, Timo
    Dean, Jeffrey
    Corrado, Greg S.
    Hipp, Jason D.
    Mermel, Craig H.
    Stumpe, Martin C.
    [J]. NATURE MEDICINE, 2019, 25 (09) : 1453 - +
  • [2] An augmented reality microscope with real-time artificial intelligence integration for cancer diagnosis
    Po-Hsuan Cameron Chen
    Krishna Gadepalli
    Robert MacDonald
    Yun Liu
    Shiro Kadowaki
    Kunal Nagpal
    Timo Kohlberger
    Jeffrey Dean
    Greg S. Corrado
    Jason D. Hipp
    Craig H. Mermel
    Martin C. Stumpe
    [J]. Nature Medicine, 2019, 25 : 1453 - 1457
  • [3] CLINICAL APPLICATION OF THE REAL-TIME ARTIFICIAL INTELLIGENCE IN THE DETECTION OF HEMORRHAGIC STROKE
    Salokhiddinov, M.
    Nuruddinov, R.
    Khaqberdiev, J.
    Nazarov, A.
    [J]. INTERNATIONAL JOURNAL OF STROKE, 2022, 17 (3_SUPPL) : 268 - 268
  • [4] Virtual visual servoing: a framework for real-time augmented reality
    Marchand, T
    Chaumette, F
    [J]. COMPUTER GRAPHICS FORUM, 2002, 21 (03) : 289 - +
  • [5] Real-Time Shadow Detection From Live Outdoor Videos for Augmented Reality
    Liu, Yanli
    Zou, Xingming
    Xu, Songhua
    Xing, Guanyu
    Wei, Housheng
    Zhang, Yanci
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (07) : 2748 - 2763
  • [6] Real-time detection of acromegaly from facial images with artificial intelligence
    Kizilgul, Muhammed
    Karakis, Rukiye
    Dogan, Nurettin
    Bostan, Hayri
    Yapici, Muhammed Mutlu
    Gul, Umran
    Ucan, Bekir
    Duman, Elvan
    Duger, Hakan
    Cakal, Erman
    Akin, Omer
    [J]. EUROPEAN JOURNAL OF ENDOCRINOLOGY, 2023, 188 (01) : 158 - 165
  • [7] Development of a Real-Time Detection System for Augmented Reality Driving
    Hsu, Kuei-Shu
    Wang, Chia-Sui
    Jiang, Jinn-Feng
    Wei, Hung-Yuan
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2015, 2015
  • [8] Real-Time Detection and Tracking for Augmented Reality on Mobile Phones
    Wagner, Daniel
    Reitmayr, Gerhard
    Mulloni, Alessandro
    Drummond, Tom
    Schmalstieg, Dieter
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2010, 16 (03) : 355 - 368
  • [9] A Real-Time Markerless Augmented Reality Framework Based on SLAM Technique
    Chen, Chien-Wen
    Chen, Wen-Zheng
    Peng, Jain-Wei
    Cheng, Bo-Xun
    Pan, Tse-Yu
    Kuo, Hsu-Chan
    Hu, Min-Chun
    [J]. 2017 14TH INTERNATIONAL SYMPOSIUM ON PERVASIVE SYSTEMS, ALGORITHMS AND NETWORKS & 2017 11TH INTERNATIONAL CONFERENCE ON FRONTIER OF COMPUTER SCIENCE AND TECHNOLOGY & 2017 THIRD INTERNATIONAL SYMPOSIUM OF CREATIVE COMPUTING (ISPAN-FCST-ISCC), 2017, : 127 - 132
  • [10] A Framework for Real-Time Gestural Recognition and Augmented Reality for Industrial Applications
    Torres, Winnie
    Santos, Lilian
    Melo, Gustavo
    Oliveira, Andressa
    Nascimento, Pedro
    Carvalho, Geovane
    Neves, Tacito
    Martins, Allan
    Araujo, Icaro
    [J]. SENSORS, 2024, 24 (08)