SGRN: SEMG-based gesture recognition network with multi-dimensional feature extraction and multi-branch information fusion

被引:0
|
作者
Gan, Zhenhua [1 ]
Bai, Yuankun [1 ]
Wu, Peishu [2 ]
Xiong, Baoping [1 ]
Zeng, Nianyin [2 ]
Zou, Fumin [1 ]
Li, Jinyang [1 ]
Guo, Feng [3 ]
He, Dongyu [1 ]
机构
[1] Fujian Univ Technol, Fujian Key Lab Automot Elect & Elect Drive, Fuzhou 350118, Peoples R China
[2] Xiamen Univ, Dept Instrumental & Elect Engn, Xiamen 361005, Peoples R China
[3] Fujian Univ Technol, Renewable Energy Technol Res Inst, Ningde 352101, Peoples R China
关键词
Feature extraction; Gesture recognition; Information fusion; Muscle-computer interaction (MCI); Surface electromyography (sEMG); CLASSIFICATION;
D O I
10.1016/j.eswa.2024.125302
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spatial-temporal feature extraction methods have been widely used for gesture classification using surface electromyography (sEMG) signals. Nevertheless, prevalent methodologies in this realm are constrained by limitations stemming from their simplistic single-branch architectures, which impose sequential constraints and facilitate unidirectional information flow during the feature extraction phase. To enhance the accuracy of gesture recognition by comprehensively capturing intricate spatial-temporal features in sEMG signals, this paper introduces SGRN, a novel multi-branch spatial-temporal feature extraction network. SGRN integrates a meticulously crafted Spatial Feature Extraction Network (SNet), Temporal Feature Extraction Network (TNet), and Spatial-Temporal Feature Fusion Network (STNet), enabling comprehensive multi-dimensional feature extraction and seamless multi-branch information fusion. Distinct from prior spatial-temporal fusion methods, SGRN concurrently performs spatial feature extraction and temporal modeling, followed by multi-branch fusion, thereby harnessing the full potential of the multi-branch architecture to boost model performance. Extensive experiments on four datasets conclusively demonstrate SGRN's efficacy and superiority over state-of-the-art models, presenting a promising avenue for prosthetic control and muscle-computer interaction.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] A Convolutional Neural Network With Multi-scale Kernel and Feature Fusion for sEMG-based Gesture Recognition
    Han, Lijun
    Zou, Yongxiang
    Cheng, Long
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE-ROBIO 2021), 2021, : 774 - 779
  • [2] Toward Generalization of sEMG-Based Pattern Recognition: A Novel Feature Extraction for Gesture Recognition
    Shen, Cheng
    Pei, Zhongcai
    Chen, Weihai
    Wang, Jianhua
    Zhang, Jianbin
    Chen, Zuobing
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [3] Speech emotion recognition based on multi-dimensional feature extraction and multi-scale feature fusion
    Yu, Lingli
    Xu, Fengjun
    Qu, Yundong
    Zhou, Kaijun
    [J]. APPLIED ACOUSTICS, 2024, 216
  • [4] MBFFNet: Multi-Branch Feature Fusion Network for Colonoscopy
    Su, Houcheng
    Lin, Bin
    Huang, Xiaoshuang
    Li, Jiao
    Jiang, Kailin
    Duan, Xuliang
    [J]. Frontiers in Bioengineering and Biotechnology, 2021, 9
  • [5] MBFFNet: Multi-Branch Feature Fusion Network for Colonoscopy
    Su, Houcheng
    Lin, Bin
    Huang, Xiaoshuang
    Li, Jiao
    Jiang, Kailin
    Duan, Xuliang
    [J]. FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2021, 9
  • [6] sEMG-based consecutive estimation of human lower limb movement by using multi-branch neural network
    Wang, Xingjian
    Dong, Dengpeng
    Chi, Xiaokai
    Wang, Shaoping
    Miao, Yinan
    An, Mailing
    Gavrilov, Alexander, I
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 68
  • [7] Multi-stream fusion network for continuous gesture recognition based on sEMG
    Li, Jun
    Zou, Chunlong
    Tang, Dalai
    Sun, Ying
    Fan, Hanwen
    Li, Boao
    Tang, Xinjie
    [J]. International Journal of Wireless and Mobile Computing, 2024, 26 (04) : 374 - 383
  • [8] A novel concatenate feature fusion RCNN architecture for sEMG-based hand gesture recognition
    Xu, Pufan
    Li, Fei
    Wang, Haipeng
    [J]. PLOS ONE, 2022, 17 (01):
  • [9] A Convolutional Neural Network with Narrow Kernel and Dual-View Feature Fusion for sEMG-Based Gesture Recognition
    Wu, Hao
    Jiang, Bin
    Xia, Qingling
    Xiao, Hanguang
    Ren, Fudai
    Zhao, Yun
    [J]. 12TH ASIAN-PACIFIC CONFERENCE ON MEDICAL AND BIOLOGICAL ENGINEERING, VOL 1, APCMBE 2023, 2024, 103 : 352 - 361
  • [10] DNA Steganalysis Based on Multi-dimensional Feature Extraction and Fusion
    Wang, Zhuang
    Xia, Jinyi
    Huang, Kaibo
    Guo, Shengnan
    Huang, Chenwei
    Yang, Zhongliang
    Zhou, Linna
    [J]. DIGITAL FORENSICS AND WATERMARKING, IWDW 2023, 2024, 14511 : 277 - 291