A Global and Local Feature fused CNN architecture for the sEMG-based hand gesture recognition

被引:19
|
作者
Xiong, Baoping [1 ]
Chen, Wensheng [1 ]
Niu, Yinxi [1 ]
Gan, Zhenhua [1 ]
Mao, Guojun [1 ]
Xu, Yong [1 ]
机构
[1] Fujian Univ Technol, Comp Sci & Math, Fuzhou 350116, Fujian, Peoples R China
关键词
sEMG; Hand gestures classification; CNN; Global and local feature fusion; Feature map; EMG; CLASSIFICATION; INFORMATION; ROBUST;
D O I
10.1016/j.compbiomed.2023.107497
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Deep learning methods have been widely used for the classification of hand gestures using sEMG signals. Existing deep learning architectures only captures local spatial information and has limitations in extracting global temporal dependency to enhance the model's performance. In this paper, we propose a Global and Local Feature fused CNN (GLF-CNN) model that extracts features both globally and locally from sEMG signals to enhance the performance of hand gestures classification. The model contains two independent branches extracting local and global features each and fuses them to learn more diversified features and effectively improve the stability of gesture recognition. Besides, it also exhibits lower computational cost compared to the present approaches. We conduct experiments on five benchmark databases, including the NinaPro DB4, NinaPro DB5, BioPatRec DB1-DB3, and the Mendeley Data. The proposed model achieved the highest average accuracy of 88.34% on these databases, with a 9.96% average accuracy improvement and a 50% reduction in variance compared to the models with the same number of parameters. Moreover, the classification accuracies for the BioPatRec DB1, BioPatRec DB3 and Mendeley Data are 91.4%, 91.0% and 88.6% respectively, corresponding to an improvement of 13.2%, 41.5% and 12.2% over the respective state-of-the-art models. The experimental results demonstrate that the proposed model effectively enhances robustness, with improved gesture recognition performance and generalization ability. It contributes a new way for prosthetic control and human-machine interaction.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Research on sEMG-Based Gesture Recognition by Dual-View Deep Learning
    Zhang, Yan
    Yang, Fan
    Fan, Qi
    Yang, Anjie
    Li, Xuan
    IEEE ACCESS, 2022, 10 : 32928 - 32937
  • [42] sEMG-Based Gesture Recognition Using Deep Learning From Noisy Labels
    Fatayer, Akram
    Gao, Wenpeng
    Fu, Yili
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (09) : 4462 - 4473
  • [43] sEMG-Based Gesture Classifier for a Rehabilitation Glove
    Copaci, Dorin
    Arias, Janeth
    Gomez-Tome, Marcos
    Moreno, Luis
    Blanco, Dolores
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [44] Implementation of sEMG-Based Robotic Hand
    Darmakusuma, Reza
    Prihatmanto, Ary S.
    Indrayanto, Adi
    Mengko, Tati L.
    2014 IEEE 4TH INTERNATIONAL CONFERENCE ON SYSTEM ENGINEERING AND TECHNOLOGY (ICSET), 2014,
  • [45] Underwater sEMG-based recognition of hand gestures using tensor decomposition
    Xue, Jianing
    Sun, Zhe
    Duan, Feng
    Caiafa, Cesar F.
    Sole-Casals, Jordi
    PATTERN RECOGNITION LETTERS, 2023, 165 : 39 - 46
  • [46] Artificial Intelligence for sEMG-Based Muscular Movement Recognition for Hand Prosthesis
    Hye, Nafe Muhtasim
    Hany, Umma
    Chakravarty, Sumit
    Akter, Lutfa
    Ahmed, Imtiaz
    IEEE ACCESS, 2023, 11 : 38850 - 38863
  • [47] sEMG-Based Inter-Session Hand Gesture Recognition via Domain Adaptation with Locality Preserving and Maximum Margin
    Guo, Yao
    Liu, Jiayan
    Wu, Yonglin
    Jiang, Xinyu
    Wang, Yalin
    Meng, Long
    Liu, Xiangyu
    Shu, Feng
    Dai, Chenyun
    Chen, Wei
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2024, 34 (03)
  • [48] Optimization of inter-subject sEMG-based hand gesture recognition tasks using unsupervised domain adaptation techniques
    Wang, Zihao
    Wan, Huiying
    Meng, Long
    Zeng, Zheng
    Akay, Metin
    Chen, Chen
    Chen, Wei
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 92
  • [49] Improving sEMG-Based Hand Gesture Recognition Using Maximal Overlap Discrete Wavelet Transform and an Autoencoder Neural Network
    Cruz de Andrade, Fernando Henrique
    Pereira, Flavio Garcia
    Resende, Cassius Zanetti
    Cavalieri, Daniel Cruz
    XXVI BRAZILIAN CONGRESS ON BIOMEDICAL ENGINEERING, CBEB 2018, VOL. 2, 2019, 70 (02): : 271 - 279
  • [50] sEMG based hand gesture recognition with deformable convolutional network
    Hao Wang
    Yue Zhang
    Chao Liu
    Honghai Liu
    International Journal of Machine Learning and Cybernetics, 2022, 13 : 1729 - 1738