Brain-machine interface based on deep learning to control asynchronously a lower-limb robotic exoskeleton: a case-of-study

被引:5
|
作者
Ferrero, Laura [1 ,2 ,3 ,4 ,6 ]
Soriano-Segura, Paula [1 ,2 ,3 ]
Navarro, Jacobo [4 ,5 ,6 ]
Jones, Oscar [4 ,6 ]
Ortiz, Mario [1 ,2 ,3 ]
Ianez, Eduardo [1 ,2 ,3 ]
Azorin, Jose M. [1 ,2 ,3 ,7 ,8 ]
Contreras-Vidal, Jose L. [4 ,6 ]
机构
[1] Miguel Hernandez Univ Elche, Brain Machine Interface Syst Lab, Elche, Spain
[2] Miguel Hernandez Univ Elche, Inst Invest Ingn Elche I3E, Elche, Spain
[3] Miguel Hernandez Univ Elche, Int Affiliate NSF IUCRC BRAIN Site, Elche, Spain
[4] Univ Houston, NSF IUCRC BRAIN, Houston, TX 77204 USA
[5] Tecnol Monterrey, Int Affiliate NSF IUCRC BRAIN Site, Monterrey, Mexico
[6] Univ Houston, Noninvas Brain Machine Interface Syst, Houston, TX 77204 USA
[7] Valencian Grad Sch, Valencia, Spain
[8] Res Network Artificial Intelligence ValgrAI, Valencia, Spain
关键词
Brain-machine interface; EEG; Exoskeleton; Deep learning; Transfer learning; IMAGERY; BCI;
D O I
10.1186/s12984-024-01342-9
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Background This research focused on the development of a motor imagery (MI) based brain-machine interface (BMI) using deep learning algorithms to control a lower-limb robotic exoskeleton. The study aimed to overcome the limitations of traditional BMI approaches by leveraging the advantages of deep learning, such as automated feature extraction and transfer learning. The experimental protocol to evaluate the BMI was designed as asynchronous, allowing subjects to perform mental tasks at their own will.Methods A total of five healthy able-bodied subjects were enrolled in this study to participate in a series of experimental sessions. The brain signals from two of these sessions were used to develop a generic deep learning model through transfer learning. Subsequently, this model was fine-tuned during the remaining sessions and subjected to evaluation. Three distinct deep learning approaches were compared: one that did not undergo fine-tuning, another that fine-tuned all layers of the model, and a third one that fine-tuned only the last three layers. The evaluation phase involved the exclusive closed-loop control of the exoskeleton device by the participants' neural activity using the second deep learning approach for the decoding.Results The three deep learning approaches were assessed in comparison to an approach based on spatial features that was trained for each subject and experimental session, demonstrating their superior performance. Interestingly, the deep learning approach without fine-tuning achieved comparable performance to the features-based approach, indicating that a generic model trained on data from different individuals and previous sessions can yield similar efficacy. Among the three deep learning approaches compared, fine-tuning all layer weights demonstrated the highest performance.Conclusion This research represents an initial stride toward future calibration-free methods. Despite the efforts to diminish calibration time by leveraging data from other subjects, complete elimination proved unattainable. The study's discoveries hold notable significance for advancing calibration-free approaches, offering the promise of minimizing the need for training trials. Furthermore, the experimental evaluation protocol employed in this study aimed to replicate real-life scenarios, granting participants a higher degree of autonomy in decision-making regarding actions such as walking or stopping gait.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] EMG-Based Kinematic Impedance Control of a Lower-Limb Exoskeleton
    Luna, Lourdes
    Garcia, Itzel
    Mendoza, Marco
    Dorantes-Mendez, Guadalupe
    Mejia-Rodriguez, Aldo
    Bonilla, Isela
    VIII LATIN AMERICAN CONFERENCE ON BIOMEDICAL ENGINEERING AND XLII NATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING, 2020, 75 : 1494 - 1501
  • [32] DEVELOPMENT OF A COMPACT LOWER-LIMB EXOSKELETON FOR WALKING ASSISTANCE: A CASE STUDY
    Zheng, Tianjiao
    Liu, Gangfeng
    Wang, Tianshuo
    Zhang, Yu
    Zhao, Jie
    Zhu, Yanhe
    JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2019, 19 (07)
  • [33] Real-Time EEG-EMG Human-Machine Interface-Based Control System for a Lower-Limb Exoskeleton
    Gordleeva, Susanna Yu
    Lobov, Sergey A.
    Grigorev, Nikita A.
    Savosenkov, Andrey O.
    Shamshin, Maxim O.
    Lukoyanov, Maxim, V
    Khoruzhko, Maxim A.
    Kazantsev, Victor B.
    IEEE ACCESS, 2020, 8 : 84070 - 84081
  • [34] Learning to control a brain-machine interface for reaching and grasping by primates
    Carmena, JM
    Lebedev, MA
    Crist, RE
    O'Doherty, JE
    Santucci, DM
    Dimitrov, DF
    Patil, PG
    Henriquez, CS
    Nicolelis, MAL
    PLOS BIOLOGY, 2003, 1 (02) : 193 - 208
  • [35] Brain Symmetry Analysis during the Use of a BCI Based on Motor Imagery for the Control of a Lower-Limb Exoskeleton
    Ferrero, Laura
    Ortiz, Mario
    Quiles, Vicente
    Ianez, Eduardo
    Flores, Jose A.
    Azorin, Jose M.
    SYMMETRY-BASEL, 2021, 13 (09):
  • [36] Enhancing brain-machine interface (BMI) control of a hand exoskeleton using electrooculography (EOG)
    Witkowski, Matthias
    Cortese, Mario
    Cempini, Marco
    Mellinger, Juergen
    Vitiello, Nicola
    Soekadar, Surjo R.
    JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2014, 11
  • [37] Enhancing brain-machine interface (BMI) control of a hand exoskeleton using electrooculography (EOG)
    Matthias Witkowski
    Mario Cortese
    Marco Cempini
    Jürgen Mellinger
    Nicola Vitiello
    Surjo R Soekadar
    Journal of NeuroEngineering and Rehabilitation, 11
  • [38] A study on EMG-based control of exoskeleton robots for human lower-limb motion assist
    He, H.
    Kiguchi, K.
    2007 6TH INTERNATIONAL SPECIAL TOPIC CONFERENCE ON INFORMATION TECHNOLOGY APPLICATIONS IN BIOMEDICINE, 2007, : 199 - 202
  • [39] Control of an Ambulatory Exoskeleton with a Brain-Machine Interface for Spinal Cord Injury Gait Rehabilitation
    Lopez-Larraz, Eduardo
    Trincado-Alonso, Fernando
    Rajasekaran, Vijaykumar
    Perez-Nombela, Soraya
    del-Ama, Antonio J.
    Aranda, Joan
    Minguez, Javier
    Gil-Agudo, Angel
    Montesano, Luis
    FRONTIERS IN NEUROSCIENCE, 2016, 10
  • [40] A Supplementary System for a Brain-Machine Interface Based on Jaw Artifacts for the Bidimensional Control of a Robotic Arm
    Costa, Alvaro
    Hortal, Enrique
    Ianez, Eduardo
    Azorin, Jose M.
    PLOS ONE, 2014, 9 (11):