Visual and haptic feedback in detecting motor imagery within a wearable brain-computer interface

被引:10
|
作者
Arpaia, Pasquale [1 ,2 ,3 ]
Coyle, Damien [4 ]
Donnarumma, Francesco [1 ,5 ]
Esposito, Antonio [1 ,6 ]
Natalizio, Angela [1 ,6 ]
Parvis, Marco [6 ]
机构
[1] Augmented Real Hlth Monitoring Lab ARHeMLab, Naples, Italy
[2] Univ Napoli Federico II, Dept Elect Engn & Informat Technol DIETI, Naples, Italy
[3] Univ Napoli Federico II, Ctr Interdipartimentale Ric Management Sanit & Inn, Naples, Italy
[4] Univ Ulster, Intelligent Syst Res Ctr, Derry, North Ireland
[5] Natl Res Council ISTC CNR, Inst Cognit Sci & Technol, Rome, Italy
[6] Politecn Torino, Dept Elect & Telecommun DET, Turin, Italy
基金
英国工程与自然科学研究理事会;
关键词
Brain-computer interface; Motor imagery; Electroencephalography; Extended reality; Haptic; Neurofeedback;
D O I
10.1016/j.measurement.2022.112304
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
This paper presents a wearable brain-computer interface relying on neurofeedback in extended reality for the enhancement of motor imagery training. Visual and vibrotactile feedback modalities were evaluated when presented either singularly or simultaneously. Only three acquisition channels and state-of-the-art vibrotactile chest-based feedback were employed. Experimental validation was carried out with eight subjects participating in two or three sessions on different days, with 360 trials per subject per session. Neurofeedback led to statistically significant improvement in performance over the two/three sessions, thus demonstrating for the first time functionality of a motor imagery-based instrument even by using an utmost wearable electroencephalograph and a commercial gaming vibrotactile suit. In the best cases, classification accuracy exceeded 80% with more than 20% improvement with respect to the initial performance. No feedback modality was generally preferable across the cohort study, but it is concluded that the best feedback modality may be subject-dependent.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Binarization Methods for Motor-Imagery Brain-Computer Interface Classification
    Hersche, Michael
    Benini, Luca
    Rahimi, Abbas
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2020, 10 (04) : 567 - 577
  • [42] Implementation of a brain-computer interface based on three states of motor imagery
    Wang, Yijun
    Hong, Bo
    Gao, Xiaorong
    Gao, Shangkai
    2007 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-16, 2007, : 5059 - 5062
  • [43] Execution, assessment and improvement methods of motor imagery for brain-computer interface
    Tian G.
    Chen J.
    Ding P.
    Gong A.
    Wang F.
    Luo J.
    Dong Y.
    Zhao L.
    Dang C.
    Fu Y.
    Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2021, 38 (03): : 434 - 446
  • [44] A Neurofeedback training paradigm for motor imagery based Brain-Computer Interface
    Xia, Bin
    Zhang, Qingmei
    Xie, Hong
    Li, Jie
    2012 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2012,
  • [45] Development of a Wearable Motor-Imagery-Based Brain–Computer Interface
    Bor-Shing Lin
    Jeng-Shyang Pan
    Tso-Yao Chu
    Bor-Shyh Lin
    Journal of Medical Systems, 2016, 40
  • [46] Effects of Peripheral Haptic Feedback on Intracortical Brain-Computer Interface Control and Associated Sensory Responses in Motor Cortex
    Deo, Darrel R.
    Rezaii, Paymon
    Hochberg, Leigh R.
    Okamura, Allison M.
    Shenoy, Krishna, V
    Henderson, Jaimie M.
    IEEE TRANSACTIONS ON HAPTICS, 2021, 14 (04) : 762 - 775
  • [47] Exploring the Visual Guidance of Motor Imagery in Sustainable Brain-Computer Interfaces
    Yang, Cheng
    Kong, Lei
    Zhang, Zhichao
    Tao, Ye
    Chen, Xiaoyu
    SUSTAINABILITY, 2022, 14 (21)
  • [48] Effective Motor Imagery Training with Visual Feedback for Non-Invasive Brain Computer Interface
    Choi, Jin Woo
    Jo, Sungho
    2018 6TH INTERNATIONAL CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2018, : 153 - 156
  • [49] Towards Improving Motor Imagery Brain-Computer Interface Using Multimodal Speech Imagery
    Tong, Jigang
    Xing, Zhengxing
    Wei, Xiaoying
    Yue, Chao
    Dong, Enzeng
    Du, Shengzhi
    Sun, Zhe
    Sole-Casals, Jordi
    Caiafa, Cesar F.
    JOURNAL OF MEDICAL AND BIOLOGICAL ENGINEERING, 2023, 43 (03) : 216 - 226
  • [50] Effect of instructive visual stimuli on neurofeedback training for motor imagery-based brain-computer interface
    Kondo, Toshiyuki
    Saeki, Midori
    Hayashi, Yoshikatsu
    Nakayashiki, Kosei
    Takata, Yohei
    HUMAN MOVEMENT SCIENCE, 2015, 43 : 239 - 249