Brain-machine interface based on deep learning to control asynchronously a lower-limb robotic exoskeleton: a case-of-study

被引:5
|
作者
Ferrero, Laura [1 ,2 ,3 ,4 ,6 ]
Soriano-Segura, Paula [1 ,2 ,3 ]
Navarro, Jacobo [4 ,5 ,6 ]
Jones, Oscar [4 ,6 ]
Ortiz, Mario [1 ,2 ,3 ]
Ianez, Eduardo [1 ,2 ,3 ]
Azorin, Jose M. [1 ,2 ,3 ,7 ,8 ]
Contreras-Vidal, Jose L. [4 ,6 ]
机构
[1] Miguel Hernandez Univ Elche, Brain Machine Interface Syst Lab, Elche, Spain
[2] Miguel Hernandez Univ Elche, Inst Invest Ingn Elche I3E, Elche, Spain
[3] Miguel Hernandez Univ Elche, Int Affiliate NSF IUCRC BRAIN Site, Elche, Spain
[4] Univ Houston, NSF IUCRC BRAIN, Houston, TX 77204 USA
[5] Tecnol Monterrey, Int Affiliate NSF IUCRC BRAIN Site, Monterrey, Mexico
[6] Univ Houston, Noninvas Brain Machine Interface Syst, Houston, TX 77204 USA
[7] Valencian Grad Sch, Valencia, Spain
[8] Res Network Artificial Intelligence ValgrAI, Valencia, Spain
关键词
Brain-machine interface; EEG; Exoskeleton; Deep learning; Transfer learning; IMAGERY; BCI;
D O I
10.1186/s12984-024-01342-9
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Background This research focused on the development of a motor imagery (MI) based brain-machine interface (BMI) using deep learning algorithms to control a lower-limb robotic exoskeleton. The study aimed to overcome the limitations of traditional BMI approaches by leveraging the advantages of deep learning, such as automated feature extraction and transfer learning. The experimental protocol to evaluate the BMI was designed as asynchronous, allowing subjects to perform mental tasks at their own will.Methods A total of five healthy able-bodied subjects were enrolled in this study to participate in a series of experimental sessions. The brain signals from two of these sessions were used to develop a generic deep learning model through transfer learning. Subsequently, this model was fine-tuned during the remaining sessions and subjected to evaluation. Three distinct deep learning approaches were compared: one that did not undergo fine-tuning, another that fine-tuned all layers of the model, and a third one that fine-tuned only the last three layers. The evaluation phase involved the exclusive closed-loop control of the exoskeleton device by the participants' neural activity using the second deep learning approach for the decoding.Results The three deep learning approaches were assessed in comparison to an approach based on spatial features that was trained for each subject and experimental session, demonstrating their superior performance. Interestingly, the deep learning approach without fine-tuning achieved comparable performance to the features-based approach, indicating that a generic model trained on data from different individuals and previous sessions can yield similar efficacy. Among the three deep learning approaches compared, fine-tuning all layer weights demonstrated the highest performance.Conclusion This research represents an initial stride toward future calibration-free methods. Despite the efforts to diminish calibration time by leveraging data from other subjects, complete elimination proved unattainable. The study's discoveries hold notable significance for advancing calibration-free approaches, offering the promise of minimizing the need for training trials. Furthermore, the experimental evaluation protocol employed in this study aimed to replicate real-life scenarios, granting participants a higher degree of autonomy in decision-making regarding actions such as walking or stopping gait.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Brain–machine interface based on deep learning to control asynchronously a lower-limb robotic exoskeleton: a case-of-study
    Laura Ferrero
    Paula Soriano-Segura
    Jacobo Navarro
    Oscar Jones
    Mario Ortiz
    Eduardo Iáñez
    José M. Azorín
    José L. Contreras-Vidal
    Journal of NeuroEngineering and Rehabilitation, 21
  • [2] Design of a brain-machine interface for reducing false activations of a lower-limb exoskeleton based on error related potential
    Soriano-Segura, P.
    Ortiz, M.
    Ianez, E.
    Azorin, J. M.
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2024, 255
  • [3] Brain-machine interfaces for controlling lower-limb powered robotic systems
    He, Yongtian
    Eguren, David
    Azorin, Jose M.
    Grossman, Robert G.
    Trieu Phat Luu
    Contreras-Vidal, Jose L.
    JOURNAL OF NEURAL ENGINEERING, 2018, 15 (02)
  • [4] A Brain-Machine Interface Architecture to Control an Upper Limb Rehabilitation Exoskeleton
    Ubeda, Andres
    Planelles, Daniel
    Hortal, Enrique
    Resquin, Francisco
    Koutsou, Aikaterini D.
    Maria Azorin, Jose
    Luis Pons, Jose
    REPLACE, REPAIR, RESTORE, RELIEVE - BRIDGING CLINICAL AND ENGINEERING SOLUTIONS IN NEUROREHABILITATION, 2014, 7 : 795 - 803
  • [5] A Brain-Machine Interface Based on ERD/ERS for an Upper-Limb Exoskeleton Control
    Tang, Zhichuan
    Sun, Shouqian
    Zhang, Sanyuan
    Chen, Yumiao
    Li, Chao
    Chen, Shi
    SENSORS, 2016, 16 (12)
  • [6] Implementation of Brain-computer Interface Based on SSVEP for Control of a Lower-limb Exoskeleton
    Wang, Zhouyang
    Wang, Can
    Lv, Qinsang
    Wu, Guizhong
    Zhang, Ting
    Wu, Xinyu
    2016 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION (ICIA), 2016, : 1882 - 1886
  • [7] Sensory Integration in Human Movement: A New Brain-Machine Interface Based on Gamma Band and Attention Level for Controlling a Lower-Limb Exoskeleton
    Ortiz, Mario
    Ferrero, Laura
    Ianez, Eduardo
    Azorin, Jose M.
    Contreras-Vidal, Jose L.
    FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2020, 8 (08):
  • [8] Deep Learning Approaches for Enhanced Lower-Limb Exoskeleton Control: A Review
    Belal, Mohammad
    Alsheikh, Nael
    Aljarah, Ahmad
    Hussain, Irfan
    IEEE ACCESS, 2024, 12 : 143883 - 143907
  • [9] Towards a Brain-Computer Interface Based on Unsupervised Methods to Command a Lower-Limb Robotic Exoskeleton
    Delisle-Rodriguez, Denis
    Cecilia Villa-Parra, Ana
    Bastos, Teodiano
    2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 1099 - 1104
  • [10] A Nonlinear Optimal Control Approach for a Lower-Limb Robotic Exoskeleton
    Rigatos, G.
    Abbaszadeh, M.
    Pomares, J.
    Wira, P.
    INTERNATIONAL JOURNAL OF HUMANOID ROBOTICS, 2020, 17 (05)