Fusion inception and transformer network for continuous estimation of finger kinematics from surface electromyography

被引:2
|
作者
Lin, Chuang [1 ]
Zhang, Xiaobing [1 ]
机构
[1] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian, Peoples R China
来源
关键词
surface electromyography; human-computer interaction; continuous estimation; finger kinematics; deep learning; MOTION;
D O I
10.3389/fnbot.2024.1305605
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Decoding surface electromyography (sEMG) to recognize human movement intentions enables us to achieve stable, natural and consistent control in the field of human computer interaction (HCI). In this paper, we present a novel deep learning (DL) model, named fusion inception and transformer network (FIT), which effectively models both local and global information on sequence data by fully leveraging the capabilities of Inception and Transformer networks. In the publicly available Ninapro dataset, we selected surface EMG signals from six typical hand grasping maneuvers in 10 subjects for predicting the values of the 10 most important joint angles in the hand. Our model's performance, assessed through Pearson's correlation coefficient (PCC), root mean square error (RMSE), and R-squared (R2) metrics, was compared with temporal convolutional network (TCN), long short-term memory network (LSTM), and bidirectional encoder representation from transformers model (BERT). Additionally, we also calculate the training time and the inference time of the models. The results show that FIT is the most performant, with excellent estimation accuracy and low computational cost. Our model contributes to the development of HCI technology and has significant practical value.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Multijoint Continuous Motion Estimation for Human Lower Limb Based on Surface Electromyography
    Han, Yonglin
    Tao, Qing
    Zhang, Xiaodong
    SENSORS, 2025, 25 (03)
  • [32] Neural network committees for finger joint angle estimation from surface EMG signals
    Nikhil A Shrirao
    Narender P Reddy
    Durga R Kosuri
    BioMedical Engineering OnLine, 8
  • [33] Neural network committees for finger joint angle estimation from surface EMG signals
    Shrirao, Nikhil A.
    Reddy, Narender P.
    Kosuri, Durga R.
    BIOMEDICAL ENGINEERING ONLINE, 2009, 8
  • [34] A Bi-Directional LSTM Network for Estimating Continuous Upper Limb Movement From Surface Electromyography
    Ma, Chenfei
    Lin, Chuang
    Samuel, Oluwarotimi Williams
    Guo, Weiyu
    Zhang, Hang
    Greenwald, Steve
    Xu, Lisheng
    Li, Guanglin
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04): : 7217 - 7224
  • [35] Continuous Prediction of Wrist Joint Kinematics Using Surface Electromyography From the Perspective of Muscle Anatomy and Muscle Synergy Feature Extraction
    Wei, Zijun
    Li, Meiju
    Zhang, Zhi-Qiang
    Xie, Sheng Quan
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2025, 29 (01) : 43 - 55
  • [36] Continuous Surface Electromyography and Bioimpedance Sensing from the Same Electrodes
    Maji, Soumyajyoti
    Martinez, Sebastian Roubert
    Howe, Robert D.
    2023 IEEE SENSORS APPLICATIONS SYMPOSIUM, SAS, 2023,
  • [37] A Neural Network Estimation of Ankle Torques From Electromyography and Accelerometry
    Siu, Ho Chit
    Sloboda, Jennifer
    McKindles, Ryan J.
    Stirling, Leia A.
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2021, 29 : 1624 - 1633
  • [38] Hand Posture and Force Estimation Using Surface Electromyography and an Artificial Neural Network
    Wang, Mengcheng
    Zhao, Chuan
    Barr, Alan
    Fan, Hao
    Yu, Suihuai
    Kapellusch, Jay
    Harris Adamson, Carisa
    HUMAN FACTORS, 2023, 65 (03) : 382 - 402
  • [39] Landmark-free head pose estimation using fusion inception deep neural network
    Hu, Wei
    Guan, Yepeng
    JOURNAL OF ELECTRONIC IMAGING, 2020, 29 (04)
  • [40] Continuous Estimation of Finger Joint Angles using Muscle Activation Inputs from Surface EMG Signals
    Ngeo, Jimson
    Tamei, Tomoya
    Shibata, Tomohiro
    2012 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2012, : 2756 - 2759