A Convolutional Neural Network with Narrow Kernel and Dual-View Feature Fusion for sEMG-Based Gesture Recognition

被引:0
|
作者
Wu, Hao [1 ]
Jiang, Bin [1 ]
Xia, Qingling [1 ]
Xiao, Hanguang [1 ]
Ren, Fudai [1 ]
Zhao, Yun [2 ]
机构
[1] Chongqing Univ Technol, Sch Artificial Intelligence, 459 Pufu Ave, Chongqing, Peoples R China
[2] Chongqing Coll Elect Engn, Sch Smart Hlth, 76Univ City East Rd, Chongqing, Peoples R China
基金
中国国家自然科学基金;
关键词
Surface electromyography (sEMG); Gesture recognition; Narrow kernel; Dual-view; Feature fusion;
D O I
10.1007/978-3-031-51455-5_39
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For gesture recognition based on surface Electromyography (sEMG), Convolutional Neural Network (CNN)-based techniques have made prominent progress to gesture features extract for motor rehabilitation or bionic hand control. However, the performance of traditional CNN algorithms shows limited capability to characterize the time-varying properties and channel independence of sEMG. In this paper, a Narrow Kernel and Dual-view Feature Fusion Convolutional Neural Network (NKDFF-CNN) is proposed. The Narrow Kernel was firstly used to fully extract the temporal features of each channel to protect the channel independence of sEMG. Feature fusion between two views to effectively reduce the number of the model parameters and avoid the overfitting phenomenon. Then, shallow and deep features were fused in the decision phase to improve the multi-dimensional characterization of sEMG. Finally, a more powerful Arcface loss function replaced Softmax for gesture classification. The algorithm was validated experimentally on the Ninapro DB2 dataset using a 200 ms window length. The results showed that NKDFF-CNN achieved an average recognition accuracy of 87.96% for 40 subjects, which is 0.94% higher than the best result using other methods. This algorithm presented in this paper effectively improved the performance of gesture recognition based sEMG and provided a new idea for this research direction.
引用
收藏
页码:352 / 361
页数:10
相关论文
共 50 条
  • [41] Improving sEMG-Based Hand Gesture Recognition Using Maximal Overlap Discrete Wavelet Transform and an Autoencoder Neural Network
    Cruz de Andrade, Fernando Henrique
    Pereira, Flavio Garcia
    Resende, Cassius Zanetti
    Cavalieri, Daniel Cruz
    [J]. XXVI BRAZILIAN CONGRESS ON BIOMEDICAL ENGINEERING, CBEB 2018, VOL. 2, 2019, 70 (02): : 271 - 279
  • [42] Neural operator Res-FNO based on dual-view feature fusion and Fourier transform
    Xu, Jinghong
    Zhou, Yuqian
    Liu, Qian
    [J]. DIGITAL SIGNAL PROCESSING, 2024, 148
  • [43] DeepTPA-Net: A Deep Triple Attention Network for sEMG-Based Hand Gesture Recognition
    Li, Qingqing
    Luo, Zhirui
    Qi, Ruobin
    Zheng, Jun
    [J]. IEEE ACCESS, 2023, 11 : 96797 - 96807
  • [44] A novel sEMG-based dynamic hand gesture recognition approach via residual attention network
    Liu, Yanhong
    Li, Xingyu
    Yu, Hongnian
    Yang, Lei
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (03) : 9329 - 9349
  • [45] A novel sEMG-based dynamic hand gesture recognition approach via residual attention network
    Yanhong Liu
    Xingyu Li
    Hongnian Yu
    Lei Yang
    [J]. Multimedia Tools and Applications, 2024, 83 : 9329 - 9349
  • [46] Improve Inter-day Hand Gesture Recognition Via Convolutional Neural Network-based Feature Fusion
    Fang, Yinfeng
    Zhang, Xuguang
    Zhou, Dalin
    Liu, Honghai
    [J]. INTERNATIONAL JOURNAL OF HUMANOID ROBOTICS, 2021, 18 (02)
  • [47] Gesture Recognition based on Deep Convolutional Neural Network
    Jayanthi, P.
    Bhama, Ponsy R. K. Sathia
    [J]. 2018 10TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (ICOAC), 2018, : 367 - 372
  • [48] SpGesture: Source-Free Domain-adaptive sEMG-based Gesture Recognition with Jaccard Attentive Spiking Neural Network
    Guo, Weiyu
    Sun, Ying
    Xu, Yijie
    Qiao, Ziyue
    Yang, Yongkui
    Xiong, Hui
    [J]. arXiv,
  • [49] Facial Expression Recognition Based on Local Feature Fusion of Convolutional Neural Network
    Yao Lisha
    Xu Guoming
    Zhao Feng
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (04)
  • [50] Gesture Recognition and Master–Slave Control of a Manipulator Based on sEMG and Convolutional Neural Network–Gated Recurrent Unit
    Ge, Zhaojie
    Wu, Zhile
    Han, Xu
    Zhao, Ping
    [J]. Journal of Engineering and Science in Medical Diagnostics and Therapy, 2023, 6 (02)