Embodied VR environment facilitates motor imagery brain-computer interface training

被引:42
|
作者
Skola, Filip [1 ]
Liarokapis, Fotis [1 ]
机构
[1] Masaryk Univ, Fac Informat, Bot 68a, Brno, Czech Republic
来源
COMPUTERS & GRAPHICS-UK | 2018年 / 75卷
关键词
Motor imagery; Brain-Computer interfaces; Virtual reality; Embodiment; Rubber hand illusion; Body transfer illusion; BODY OWNERSHIP ILLUSION; RUBBER HAND ILLUSION; SINGLE-TRIAL EEG; ILLUSORY OWNERSHIP; VIRTUAL BODY; COMMUNICATION; FEEDBACK; VISUOTACTILE; REAL; TIME;
D O I
10.1016/j.cag.2018.05.024
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Motor imagery (MI) is the predominant control paradigm for brain-computer interfaces (BCIs). After sufficient effort is invested to the training, the accuracy of commands mediated by mental imagery of bodily movements grows to a satisfactory level. However, many issues with the MI-BCIs persist; e.g., low bit transfer rate, BCI illiteracy, sub-optimal training procedure. Especially the training process for the MI-BCIs requires improvements. Currently, the training has an inappropriate form, resulting in a high mental and temporal demand on the users (weeks of training are required for the control). This study aims at addressing the issues with the MI-BCI training. To support the learning process, an embodied training environment was created. Participants were placed into a virtual reality environment observed from a first-person view of a human-like avatar, and their rehearsal of MI actions was reflected by the corresponding movements performed by the avatar. Leveraging extension of the sense of ownership, agency, and self-location towards a non-body object (principles known from the rubber hand illusion and the body transfer illusions) has already been proven to help in producing stronger EEG correlates of Ml. These principles were used to facilitate the MI-BCI training process for the first time. Performance of 30 healthy participants after two sessions of training was measured using an on-line BCI scenario. The group trained using our embodied VR environment gained significantly higher average accuracy for BCI actions (58.3%) than the control group, trained with a standard MI-BCI training protocol (52.9%). (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:59 / 71
页数:13
相关论文
共 50 条
  • [41] Phase-Locking Factor in a Motor Imagery Brain-Computer Interface
    Carreiras, Carlos
    de Almeida, Luis Borges
    Miguel Sanches, J.
    2012 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2012, : 2877 - 2880
  • [42] Performance variation in motor imagery brain-computer interface: A brief review
    Ahn, Minkyu
    Jun, Sung Chan
    JOURNAL OF NEUROSCIENCE METHODS, 2015, 243 : 103 - 110
  • [43] Genetic Programming for Feature Extraction in Motor Imagery Brain-Computer Interface
    de Souza, Gabriel Henrique
    Bernardino, Heder Soares
    Vieira, Alex Borges
    Correa Barbosa, Helio Jose
    PROGRESS IN ARTIFICIAL INTELLIGENCE (EPIA 2021), 2021, 12981 : 227 - 238
  • [44] Binarization Methods for Motor-Imagery Brain-Computer Interface Classification
    Hersche, Michael
    Benini, Luca
    Rahimi, Abbas
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2020, 10 (04) : 567 - 577
  • [45] Implementation of a brain-computer interface based on three states of motor imagery
    Wang, Yijun
    Hong, Bo
    Gao, Xiaorong
    Gao, Shangkai
    2007 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-16, 2007, : 5059 - 5062
  • [46] Execution, assessment and improvement methods of motor imagery for brain-computer interface
    Tian G.
    Chen J.
    Ding P.
    Gong A.
    Wang F.
    Luo J.
    Dong Y.
    Zhao L.
    Dang C.
    Fu Y.
    Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2021, 38 (03): : 434 - 446
  • [47] Towards Improving Motor Imagery Brain-Computer Interface Using Multimodal Speech Imagery
    Tong, Jigang
    Xing, Zhengxing
    Wei, Xiaoying
    Yue, Chao
    Dong, Enzeng
    Du, Shengzhi
    Sun, Zhe
    Sole-Casals, Jordi
    Caiafa, Cesar F.
    JOURNAL OF MEDICAL AND BIOLOGICAL ENGINEERING, 2023, 43 (03) : 216 - 226
  • [48] Phase Transition in previous Motor Imagery affects Efficiency of Motor Imagery based Brain-computer Interface
    Jung, Min-Kyung
    Lee, Seho
    Wang, In-Nea
    Song, Ha-Yoon
    Kim, Hakseung
    Kim, Dong-Joo
    2021 9TH IEEE INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2021, : 333 - 336
  • [49] Cortical effects of user training in a motor imagery based brain-computer interface measured by fNIRS and EEG
    Kaiser, Vera
    Bauernfeind, Guenther
    Kreilinger, Alex
    Kaufmann, Tobias
    Kuebler, Andrea
    Neuper, Christa
    Mueller-Putz, Gernot R.
    NEUROIMAGE, 2014, 85 : 432 - 444
  • [50] Examination of effectiveness of kinaesthetic haptic feedback for motor imagery-based brain-computer interface training
    Sakamaki, Isao
    Tavakoli, Mahdi
    Wiebe, Sandra
    Adams, Kim
    BRAIN-COMPUTER INTERFACES, 2023, 10 (01) : 16 - 37