Brain-machine interface based on deep learning to control asynchronously a lower-limb robotic exoskeleton: a case-of-study

被引:5
|
作者
Ferrero, Laura [1 ,2 ,3 ,4 ,6 ]
Soriano-Segura, Paula [1 ,2 ,3 ]
Navarro, Jacobo [4 ,5 ,6 ]
Jones, Oscar [4 ,6 ]
Ortiz, Mario [1 ,2 ,3 ]
Ianez, Eduardo [1 ,2 ,3 ]
Azorin, Jose M. [1 ,2 ,3 ,7 ,8 ]
Contreras-Vidal, Jose L. [4 ,6 ]
机构
[1] Miguel Hernandez Univ Elche, Brain Machine Interface Syst Lab, Elche, Spain
[2] Miguel Hernandez Univ Elche, Inst Invest Ingn Elche I3E, Elche, Spain
[3] Miguel Hernandez Univ Elche, Int Affiliate NSF IUCRC BRAIN Site, Elche, Spain
[4] Univ Houston, NSF IUCRC BRAIN, Houston, TX 77204 USA
[5] Tecnol Monterrey, Int Affiliate NSF IUCRC BRAIN Site, Monterrey, Mexico
[6] Univ Houston, Noninvas Brain Machine Interface Syst, Houston, TX 77204 USA
[7] Valencian Grad Sch, Valencia, Spain
[8] Res Network Artificial Intelligence ValgrAI, Valencia, Spain
关键词
Brain-machine interface; EEG; Exoskeleton; Deep learning; Transfer learning; IMAGERY; BCI;
D O I
10.1186/s12984-024-01342-9
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Background This research focused on the development of a motor imagery (MI) based brain-machine interface (BMI) using deep learning algorithms to control a lower-limb robotic exoskeleton. The study aimed to overcome the limitations of traditional BMI approaches by leveraging the advantages of deep learning, such as automated feature extraction and transfer learning. The experimental protocol to evaluate the BMI was designed as asynchronous, allowing subjects to perform mental tasks at their own will.Methods A total of five healthy able-bodied subjects were enrolled in this study to participate in a series of experimental sessions. The brain signals from two of these sessions were used to develop a generic deep learning model through transfer learning. Subsequently, this model was fine-tuned during the remaining sessions and subjected to evaluation. Three distinct deep learning approaches were compared: one that did not undergo fine-tuning, another that fine-tuned all layers of the model, and a third one that fine-tuned only the last three layers. The evaluation phase involved the exclusive closed-loop control of the exoskeleton device by the participants' neural activity using the second deep learning approach for the decoding.Results The three deep learning approaches were assessed in comparison to an approach based on spatial features that was trained for each subject and experimental session, demonstrating their superior performance. Interestingly, the deep learning approach without fine-tuning achieved comparable performance to the features-based approach, indicating that a generic model trained on data from different individuals and previous sessions can yield similar efficacy. Among the three deep learning approaches compared, fine-tuning all layer weights demonstrated the highest performance.Conclusion This research represents an initial stride toward future calibration-free methods. Despite the efforts to diminish calibration time by leveraging data from other subjects, complete elimination proved unattainable. The study's discoveries hold notable significance for advancing calibration-free approaches, offering the promise of minimizing the need for training trials. Furthermore, the experimental evaluation protocol employed in this study aimed to replicate real-life scenarios, granting participants a higher degree of autonomy in decision-making regarding actions such as walking or stopping gait.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Using a brain-machine interface to control a hybrid upper limb exoskeleton during rehabilitation of patients with neurological conditions
    Hortal, Enrique
    Planelles, Daniel
    Resquin, Francisco
    Climent, Jose M.
    Azorin, Jose M.
    Pons, Jose L.
    JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2015, 12
  • [22] Sensing Pressure Distribution on a Lower-Limb Exoskeleton Physical Human-Machine Interface
    De Rossi, Stefano Marco Maria
    Vitiello, Nicola
    Lenzi, Tommaso
    Ronsse, Renaud
    Koopman, Bram
    Persichetti, Alessandro
    Vecchi, Fabrizio
    Ijspeert, Auke Jan
    van der Kooij, Herman
    Carrozza, Maria Chiara
    SENSORS, 2011, 11 (01) : 207 - 227
  • [23] Deep Rehabilitation Gait Learning for Modeling Knee Joints of Lower-limb Exoskeleton
    Liu, Du-Xin
    Du, Wenbin
    Wu, Xinyu
    Wang, Can
    Qiao, Yu
    2016 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2016, : 1058 - 1063
  • [24] DEEP NEURAL NETWORK BASED SATURATED ADAPTIVE CONTROL OF MUSCLES IN A LOWER-LIMB HYBRID EXOSKELETON
    Ting, Jonathan A.
    Basyal, Sujata
    Allen, Brendon C.
    PROCEEDINGS OF ASME 2023 INTERNATIONAL MECHANICAL ENGINEERING CONGRESS AND EXPOSITION, IMECE2023, VOL 6, 2023,
  • [25] Brain-Machine Interface and Visual Compressive Sensing-Based Teleoperation Control of an Exoskeleton Robot
    Qiu, Shiyuan
    Li, Zhijun
    He, Wei
    Zhang, Longbin
    Yang, Chenguang
    Su, Chun-Yi
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2017, 25 (01) : 58 - 69
  • [26] Deep-Learning Estimation of Weight Distribution Using Joint Kinematics for Lower-Limb Exoskeleton Control
    Lhoste, Clement
    Kucuktabak, Emek Baris
    Vianello, Lorenzo
    Amato, Lorenzo
    Short, Matthew R.
    Lynch, Kevin M.
    Pons, Jose L.
    IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2025, 7 (01): : 20 - 26
  • [27] Brain-machine interface control via reinforcement learning
    DiGiovanna, Jack
    Mahmoudi, Babak
    Mitzelfelt, Jeremiah
    Sanchez, Justin C.
    Principe, Jose C.
    2007 3RD INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING, VOLS 1 AND 2, 2007, : 530 - +
  • [28] EEG Based Brain-Machine Interface for Navigation of Robotic Device
    Mahmud, Mufti
    Hawellek, David
    Bertoldo, Alessandra
    2010 3RD IEEE RAS AND EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL ROBOTICS AND BIOMECHATRONICS, 2010, : 168 - 172
  • [29] Transfer Learning with CNN Models for Brain-Machine Interfaces to command lower-limb exoskeletons: A Solution for Limited Data
    Ferrero, L.
    Quiles, V.
    Soriano-Segura, P.
    Ortiz, M.
    Ianez, E.
    Contreras-Vidal, J. L.
    Azorin, J. M.
    2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [30] Computer Vision and Deep Learning for Environment-Adaptive Control of Robotic Lower-Limb Exoskeletons
    Laschowski, Brokoslaw
    McNally, William
    Wong, Alexander
    McPhee, John
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 4631 - 4635