Deep Learning for EMG-based Human-Machine Interaction: A Review

被引:179
|
作者
Xiong, Dezhen [1 ,2 ,3 ]
Zhang, Daohui [1 ,2 ]
Zhao, Xingang [1 ,2 ]
Zhao, Yiwen [1 ,2 ]
机构
[1] Chinese Acad Sci, Shenyang Inst Automat, Inst Robot, State Key Lab Robot, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Inst Intelligent Mfg, Shenyang 110016, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Accuracy; deep learning; electromyography (EMG); human-machine interaction (HMI); robustness; UPPER-LIMB PROSTHESES; SURFACE-EMG; PATTERN-RECOGNITION; GESTURE RECOGNITION; NEURAL-NETWORKS; SIGNALS; CLASSIFICATION; EXTRACTION; MOTION; ANGLES;
D O I
10.1109/JAS.2021.1003865
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Electromyography (EMG) has already been broadly used in human-machine interaction (HMI) applications. Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgently need a solution. Recently, many EMG pattern recognition tasks have been addressed using deep learning methods. In this paper, we analyze recent papers and present a literature review describing the role that deep learning plays in EMG-based HMI. An overview of typical network structures and processing schemes will be provided. Recent progress in typical tasks such as movement classification, joint angle prediction, and force/torque estimation will be introduced. New issues, including multimodal sensing, inter-subject/inter-session, and robustness toward disturbances will be discussed. We attempt to provide a comprehensive analysis of current research by discussing the advantages, challenges, and opportunities brought by deep learning. We hope that deep learning can aid in eliminating factors that hinder the development of EMG-based HMI systems. Furthermore, possible future directions will be presented to pave the way for future research.
引用
收藏
页码:512 / 533
页数:22
相关论文
共 50 条
  • [31] Harnessing Machine Learning and Physiological Knowledge for a Novel EMG-Based Neural-Machine Interface
    Berman, Joseph
    Hinson, Robert
    Lee, I-Chieh
    Huang, He
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2023, 70 (04) : 1125 - 1136
  • [32] Robust EMG pattern recognition to muscular fatigue effect for human-machine interaction
    Song, Jae-Hoon
    Jung, Jin-Woo
    Bien, Zeungnam
    [J]. MICAI 2006: ADVANCES IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2006, 4293 : 1190 - +
  • [33] A jaw based human-machine interface with machine learning
    Busch, Tobias
    Zeilfelder, Jennifer
    Zhou, Kai
    Stork, Wilhelm
    [J]. 2019 IEEE SENSORS APPLICATIONS SYMPOSIUM (SAS), 2019,
  • [34] Human-Machine Interaction Based on Augmented Reality
    Pozsegovics, Peter
    Vamossy, Zoltan
    [J]. 14TH IEEE INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND INFORMATICS (CINTI), 2013, : 153 - 158
  • [35] Continuous Human Action Recognition for Human-machine Interaction: A Review
    Gammulle, Harshala
    Ahmedt-Aristizabal, David
    Denman, Simon
    Tychsen-Smith, Lachlan
    Petersson, Lars
    Fookes, Clinton
    [J]. ACM COMPUTING SURVEYS, 2023, 55 (13S)
  • [36] Human-machine interfaces based on EMG and EEG applied to robotic systems
    Andre Ferreira
    Wanderley C Celeste
    Fernando A Cheein
    Teodiano F Bastos-Filho
    Mario Sarcinelli-Filho
    Ricardo Carelli
    [J]. Journal of NeuroEngineering and Rehabilitation, 5
  • [37] Interaction force modeling and analysis of the human-machine kinematic chain based on the human-machine deviation
    Zhou, Xin
    Duan, Zhisheng
    [J]. SCIENTIFIC REPORTS, 2023, 13 (01)
  • [38] Human-machine interfaces based on EMG and EEG applied to robotic systems
    Ferreira, Andre
    Celeste, Wanderley C.
    Cheein, Fernando A.
    Bastos-Filho, Teodiano F.
    Sarcinelli-Filho, Mario
    Carelli, Ricardo
    [J]. JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2008, 5 (1)
  • [39] Human-Machine Interaction Sensing Technology Based on Hand Gesture Recognition: A Review
    Guo, Lin
    Lu, Zongxing
    Yao, Ligang
    [J]. IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2021, 51 (04) : 300 - 309
  • [40] Decoupled Temperature-Pressure Sensing System for Deep Learning Assisted Human-Machine Interaction
    Chen, Zhaoyang
    Liu, Shun
    Kang, Pengyuan
    Wang, Yalong
    Liu, Hu
    Liu, Chuntai
    Shen, Changyu
    [J]. ADVANCED FUNCTIONAL MATERIALS, 2024,