SGRN: SEMG-based gesture recognition network with multi-dimensional feature extraction and multi-branch information fusion

被引:0
|
作者
Gan, Zhenhua [1 ]
Bai, Yuankun [1 ]
Wu, Peishu [2 ]
Xiong, Baoping [1 ]
Zeng, Nianyin [2 ]
Zou, Fumin [1 ]
Li, Jinyang [1 ]
Guo, Feng [3 ]
He, Dongyu [1 ]
机构
[1] Fujian Univ Technol, Fujian Key Lab Automot Elect & Elect Drive, Fuzhou 350118, Peoples R China
[2] Xiamen Univ, Dept Instrumental & Elect Engn, Xiamen 361005, Peoples R China
[3] Fujian Univ Technol, Renewable Energy Technol Res Inst, Ningde 352101, Peoples R China
关键词
Feature extraction; Gesture recognition; Information fusion; Muscle-computer interaction (MCI); Surface electromyography (sEMG); CLASSIFICATION;
D O I
10.1016/j.eswa.2024.125302
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spatial-temporal feature extraction methods have been widely used for gesture classification using surface electromyography (sEMG) signals. Nevertheless, prevalent methodologies in this realm are constrained by limitations stemming from their simplistic single-branch architectures, which impose sequential constraints and facilitate unidirectional information flow during the feature extraction phase. To enhance the accuracy of gesture recognition by comprehensively capturing intricate spatial-temporal features in sEMG signals, this paper introduces SGRN, a novel multi-branch spatial-temporal feature extraction network. SGRN integrates a meticulously crafted Spatial Feature Extraction Network (SNet), Temporal Feature Extraction Network (TNet), and Spatial-Temporal Feature Fusion Network (STNet), enabling comprehensive multi-dimensional feature extraction and seamless multi-branch information fusion. Distinct from prior spatial-temporal fusion methods, SGRN concurrently performs spatial feature extraction and temporal modeling, followed by multi-branch fusion, thereby harnessing the full potential of the multi-branch architecture to boost model performance. Extensive experiments on four datasets conclusively demonstrate SGRN's efficacy and superiority over state-of-the-art models, presenting a promising avenue for prosthetic control and muscle-computer interaction.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] CDBA: a novel multi-branch feature fusion model for EEG-based emotion recognition
    Huang, Zhentao
    Ma, Yahong
    Su, Jianyun
    Shi, Hangyu
    Jia, Shanshan
    Yuan, Baoxi
    Li, Weisu
    Geng, Jingzhi
    Yang, Tingting
    [J]. FRONTIERS IN PHYSIOLOGY, 2023, 14
  • [22] sEMG-Based Hand Gesture Recognition Using Binarized Neural Network
    Kang, Soongyu
    Kim, Haechan
    Park, Chaewoon
    Sim, Yunseong
    Lee, Seongjoo
    Jung, Yunho
    [J]. SENSORS, 2023, 23 (03)
  • [23] COMPOUND MULTI-BRANCH FEATURE FUSION FOR IMAGE DERAINDROP
    Fan, Chi-Mao
    Liu, Tsung-Jung
    Liu, Kuan-Hsien
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3399 - 3403
  • [24] Improved Multi-Stream Convolutional Block Attention Module for sEMG-Based Gesture Recognition
    Wang, Shudi
    Huang, Li
    Jiang, Du
    Sun, Ying
    Jiang, Guozhang
    Li, Jun
    Zou, Cejing
    Fan, Hanwen
    Xie, Yuanmin
    Xiong, Hegen
    Chen, Baojia
    [J]. FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2022, 10
  • [25] A vehicle re-identification framework based on the improved multi-branch feature fusion network
    Leilei Rong
    Yan Xu
    Xiaolei Zhou
    Lisu Han
    Linghui Li
    Xuguang Pan
    [J]. Scientific Reports, 11
  • [26] A Multi-Branch Feature Fusion Network for Building Detection in Remote Sensing Images
    Li, Chao
    Huang, Xinyu
    Tang, Jiechen
    Wang, Kai
    [J]. IEEE ACCESS, 2021, 9 : 168511 - 168519
  • [27] Remote Sensing Image Scene Classification Based on Deep Multi-branch Feature Fusion Network
    Zhang Tong
    Zheng En-rang
    Shen Jun-ge
    Gao An-tong
    [J]. ACTA PHOTONICA SINICA, 2020, 49 (05)
  • [28] A vehicle re-identification framework based on the improved multi-branch feature fusion network
    Rong, Leilei
    Xu, Yan
    Zhou, Xiaolei
    Han, Lisu
    Li, Linghui
    Pan, Xuguang
    [J]. SCIENTIFIC REPORTS, 2021, 11 (01)
  • [29] Recognition of coal and gangue based on multi-dimensional gray gradient feature fusion
    Luo, Qisheng
    Wang, Shuang
    Li, Xin
    He, Lei
    [J]. ENERGY SOURCES PART A-RECOVERY UTILIZATION AND ENVIRONMENTAL EFFECTS, 2022, 44 (03) : 8060 - 8076
  • [30] Research on Dynamic Gesture Recognition Based on Multi Feature Fusion
    Yu, Meijuan
    Liu, Yankai
    [J]. COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, 2018, 423 : 733 - 738