Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking

被引:3
|
作者
Quiles, Vicente [1 ,2 ]
Ferrero, Laura [1 ,2 ,3 ]
Ianez, Eduardo [1 ,2 ]
Ortiz, Mario [1 ,2 ,3 ]
Gil-Agudo, Angel [4 ]
Azorin, Jose M. [1 ,2 ,3 ,5 ]
机构
[1] Univ Miguel Hernandez Elche, Brain Machine Interface Syst Lab, Elche, Spain
[2] Univ Miguel Hernandez Elche, Inst Invest Ingn Elche I3E, Elche, Spain
[3] European Univ Brain & Technol NeurotechEU, European Union, Solna, Sweden
[4] Biomech Unit Natl Parapleg Hosp, Toledo, Spain
[5] ValGRAI Valencian Grad Sch, Res Network Artificial Intelligence, Valencia, Spain
关键词
BMI; stopping intention; exoskeleton; EEG; transfer-learning; closed-loop;
D O I
10.3389/fnins.2023.1154480
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
IntroductionBrain-machine interfaces (BMIs) attempt to establish communication between the user and the device to be controlled. BMIs have great challenges to face in order to design a robust control in the real field of application. The artifacts, high volume of training data, and non-stationarity of the signal of EEG-based interfaces are challenges that classical processing techniques do not solve, showing certain shortcomings in the real-time domain. Recent advances in deep-learning techniques open a window of opportunity to solve some of these problems. In this work, an interface able to detect the evoked potential that occurs when a person intends to stop due to the appearance of an unexpected obstacle has been developed. Material and methodsFirst, the interface was tested on a treadmill with five subjects, in which the user stopped when an obstacle appeared (simulated by a laser). The analysis is based on two consecutive convolutional networks: the first one to discern the intention to stop against normal walking and the second one to correct false detections of the previous one. Results and discussionThe results were superior when using the methodology of the two consecutive networks vs. only the first one in a cross-validation pseudo-online analysis. The false positives per min (FP/min) decreased from 31.8 to 3.9 FP/min and the number of repetitions in which there were no false positives and true positives (TP) improved from 34.9% to 60.3% NOFP/TP. This methodology was tested in a closed-loop experiment with an exoskeleton, in which the brain-machine interface (BMI) detected an obstacle and sent the command to the exoskeleton to stop. This methodology was tested with three healthy subjects, and the online results were 3.8 FP/min and 49.3% NOFP/TP. To make this model feasible for non-able bodied patients with a reduced and manageable time frame, transfer-learning techniques were applied and validated in the previous tests, and were then applied to patients. The results for two incomplete Spinal Cord Injury (iSCI) patients were 37.9% NOFP/TP and 7.7 FP/min.
引用
收藏
页数:13
相关论文
共 26 条
  • [1] Detecting Fatigue during Exoskeleton-Assisted Trunk Flexion Tasks: A Machine Learning Approach
    Kuber, Pranav Madhav
    Godbole, Hrushikesh
    Rashedi, Ehsan
    APPLIED SCIENCES-BASEL, 2024, 14 (09):
  • [2] Feature-Selection-Based Transfer Learning for Intracortical Brain-Machine Interface Decoding
    Zhang, Peng
    Li, Wei
    Ma, Xuan
    He, Jiping
    Huang, Jian
    Li, Qiang
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2021, 29 : 60 - 73
  • [3] Neuronal Tuning in a Brain-Machine Interface during Reinforcement Learning
    Mahmoudi, Babak
    DiGiovanna, Jack
    Principe, Jose C.
    Sanchez, Justin C.
    2008 30TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-8, 2008, : 4491 - +
  • [4] A Brain-Machine Interface Based on ERD/ERS for an Upper-Limb Exoskeleton Control
    Tang, Zhichuan
    Sun, Shouqian
    Zhang, Sanyuan
    Chen, Yumiao
    Li, Chao
    Chen, Shi
    SENSORS, 2016, 16 (12)
  • [5] Covariant Cluster Transfer for Kernel Reinforcement Learning in Brain-Machine Interface
    Zhang, Xiang
    Wang, Yiwen
    42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 3086 - 3089
  • [6] Brain-Machine Interface and Visual Compressive Sensing-Based Teleoperation Control of an Exoskeleton Robot
    Qiu, Shiyuan
    Li, Zhijun
    He, Wei
    Zhang, Longbin
    Yang, Chenguang
    Su, Chun-Yi
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2017, 25 (01) : 58 - 69
  • [7] Brain-machine interface based on deep learning to control asynchronously a lower-limb robotic exoskeleton: a case-of-study
    Ferrero, Laura
    Soriano-Segura, Paula
    Navarro, Jacobo
    Jones, Oscar
    Ortiz, Mario
    Ianez, Eduardo
    Azorin, Jose M.
    Contreras-Vidal, Jose L.
    JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2024, 21 (01)
  • [8] Using a brain-machine interface to control a hybrid upper limb exoskeleton during rehabilitation of patients with neurological conditions
    Enrique Hortal
    Daniel Planelles
    Francisco Resquin
    José M. Climent
    José M. Azorín
    José L. Pons
    Journal of NeuroEngineering and Rehabilitation, 12
  • [9] Using a brain-machine interface to control a hybrid upper limb exoskeleton during rehabilitation of patients with neurological conditions
    Hortal, Enrique
    Planelles, Daniel
    Resquin, Francisco
    Climent, Jose M.
    Azorin, Jose M.
    Pons, Jose L.
    JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2015, 12
  • [10] Transitioning from global to local computational strategies during brain-machine interface learning
    Bridges, Nathaniel R.
    Stickle, Matthew
    Moxon, Karen A.
    FRONTIERS IN NEUROSCIENCE, 2024, 18