Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking

被引:3
|
作者
Quiles, Vicente [1 ,2 ]
Ferrero, Laura [1 ,2 ,3 ]
Ianez, Eduardo [1 ,2 ]
Ortiz, Mario [1 ,2 ,3 ]
Gil-Agudo, Angel [4 ]
Azorin, Jose M. [1 ,2 ,3 ,5 ]
机构
[1] Univ Miguel Hernandez Elche, Brain Machine Interface Syst Lab, Elche, Spain
[2] Univ Miguel Hernandez Elche, Inst Invest Ingn Elche I3E, Elche, Spain
[3] European Univ Brain & Technol NeurotechEU, European Union, Solna, Sweden
[4] Biomech Unit Natl Parapleg Hosp, Toledo, Spain
[5] ValGRAI Valencian Grad Sch, Res Network Artificial Intelligence, Valencia, Spain
关键词
BMI; stopping intention; exoskeleton; EEG; transfer-learning; closed-loop;
D O I
10.3389/fnins.2023.1154480
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
IntroductionBrain-machine interfaces (BMIs) attempt to establish communication between the user and the device to be controlled. BMIs have great challenges to face in order to design a robust control in the real field of application. The artifacts, high volume of training data, and non-stationarity of the signal of EEG-based interfaces are challenges that classical processing techniques do not solve, showing certain shortcomings in the real-time domain. Recent advances in deep-learning techniques open a window of opportunity to solve some of these problems. In this work, an interface able to detect the evoked potential that occurs when a person intends to stop due to the appearance of an unexpected obstacle has been developed. Material and methodsFirst, the interface was tested on a treadmill with five subjects, in which the user stopped when an obstacle appeared (simulated by a laser). The analysis is based on two consecutive convolutional networks: the first one to discern the intention to stop against normal walking and the second one to correct false detections of the previous one. Results and discussionThe results were superior when using the methodology of the two consecutive networks vs. only the first one in a cross-validation pseudo-online analysis. The false positives per min (FP/min) decreased from 31.8 to 3.9 FP/min and the number of repetitions in which there were no false positives and true positives (TP) improved from 34.9% to 60.3% NOFP/TP. This methodology was tested in a closed-loop experiment with an exoskeleton, in which the brain-machine interface (BMI) detected an obstacle and sent the command to the exoskeleton to stop. This methodology was tested with three healthy subjects, and the online results were 3.8 FP/min and 49.3% NOFP/TP. To make this model feasible for non-able bodied patients with a reduced and manageable time frame, transfer-learning techniques were applied and validated in the previous tests, and were then applied to patients. The results for two incomplete Spinal Cord Injury (iSCI) patients were 37.9% NOFP/TP and 7.7 FP/min.
引用
收藏
页数:13
相关论文
共 26 条
  • [21] Improved Spike-Based Brain-Machine Interface Using Bayesian Adaptive Kernel Smoother and Deep Learning
    Ahmadi, Nur
    Adiono, Trio
    Purwarianti, Ayu
    Constandinou, Timothy G.
    Bouganis, Christos-Savvas
    IEEE ACCESS, 2022, 10 : 29341 - 29356
  • [22] Sensory Integration in Human Movement: A New Brain-Machine Interface Based on Gamma Band and Attention Level for Controlling a Lower-Limb Exoskeleton
    Ortiz, Mario
    Ferrero, Laura
    Ianez, Eduardo
    Azorin, Jose M.
    Contreras-Vidal, Jose L.
    FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2020, 8 (08):
  • [23] Intermediate Sensory Feedback Assisted Multi-Step Neural Decoding for Reinforcement Learning Based Brain-Machine Interfaces
    Shen, Xiang
    Zhang, Xiang
    Huang, Yifan
    Chen, Shuhang
    Yu, Zhuliang
    Wang, Yiwen
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2022, 30 : 2834 - 2844
  • [24] Intermediate Sensory Feedback Assisted Multi-Step Neural Decoding for Reinforcement Learning Based Brain-Machine Interfaces
    Shen, Xiang
    Zhang, Xiang
    Huang, Yifan
    Chen, Shuhang
    Yu, Zhuliang
    Wang, Yiwen
    IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2022, 30 : 2834 - 2844
  • [25] Brain–machine interface based on deep learning to control asynchronously a lower-limb robotic exoskeleton: a case-of-study
    Laura Ferrero
    Paula Soriano-Segura
    Jacobo Navarro
    Oscar Jones
    Mario Ortiz
    Eduardo Iáñez
    José M. Azorín
    José L. Contreras-Vidal
    Journal of NeuroEngineering and Rehabilitation, 21
  • [26] Deep Learning-Based Markerless Hand Tracking for Freely Moving Non-Human Primates in Brain-Machine Interface Applications
    Liu, Yuhang
    Wang, Miao
    Hou, Shuaibiao
    Wang, Xiao
    Shi, Bing
    ELECTRONICS, 2025, 14 (05):