A Convolutional Neural Network With Multi-scale Kernel and Feature Fusion for sEMG-based Gesture Recognition

被引:3
|
作者
Han, Lijun [1 ,2 ]
Zou, Yongxiang [1 ,2 ]
Cheng, Long [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Surface electromyography; hand gesture recognition; convolutional neural network; multi-scale kernel; feature fusion; PATTERN-RECOGNITION;
D O I
10.1109/ROBIO54168.2021.9739426
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The sEMG-based gesture recognition has great potential in human-computer interaction. However, the current approaches are far from optimal. In this paper, a novel convolutional neural network which combines the multi-scale kernal and feature fusion (MKFF-CNN) is proposed. This model could extract multi-scale features and make full use of these feature maps. One dataset called "gForce dataset" is recorded in this work, comprising 13 able-bodied participants. To verify the effectiveness of the proposed model, evaluations on both the gForce dataset and the Ninapro DB6 are conducted. The experimental results demonstrate that, MKFF-CNN achieves an accuracy of 97.65% on the gForce dataset, which is 1.39% higher than that of the subnetwork without early fusion, and at least 6.54% higher than that of the subnetwork with single-scale convolution kernel. On the Ninapro DB6, MKFF-CNN achieves 98.52% accuracy, which is 1.3% higher than the state-of-the-art works, showing the superiority of the proposed model.
引用
收藏
页码:774 / 779
页数:6
相关论文
共 50 条
  • [1] A Convolutional Neural Network with Narrow Kernel and Dual-View Feature Fusion for sEMG-Based Gesture Recognition
    Wu, Hao
    Jiang, Bin
    Xia, Qingling
    Xiao, Hanguang
    Ren, Fudai
    Zhao, Yun
    [J]. 12TH ASIAN-PACIFIC CONFERENCE ON MEDICAL AND BIOLOGICAL ENGINEERING, VOL 1, APCMBE 2023, 2024, 103 : 352 - 361
  • [2] A multi-scale feature fusion convolutional neural network for facial expression recognition
    Zhang, Xiufeng
    Fu, Xingkui
    Qi, Guobin
    Zhang, Ning
    [J]. EXPERT SYSTEMS, 2024, 41 (04)
  • [3] A multi-scale feature fusion convolutional neural network for facial expression recognition
    Zhang, Xiufeng
    Fu, Xingkui
    Qi, Guobin
    Zhang, Ning
    [J]. Expert Systems, 1600, 4
  • [4] A multi-stream convolutional neural network for sEMG-based gesture recognition in muscle-computer interface
    Wei, Wentao
    Wong, Yongkang
    Du, Yu
    Hu, Yu
    Kankanhalli, Mohan
    Geng, Weidong
    [J]. PATTERN RECOGNITION LETTERS, 2019, 119 : 131 - 138
  • [5] Multi-feature fusion gesture recognition based on deep convolutional neural network
    Yun Wei-guo
    Shi Qi-qi
    Wang Min
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2019, 34 (04) : 417 - 422
  • [6] SGRN: SEMG-based gesture recognition network with multi-dimensional feature extraction and multi-branch information fusion
    Gan, Zhenhua
    Bai, Yuankun
    Wu, Peishu
    Xiong, Baoping
    Zeng, Nianyin
    Zou, Fumin
    Li, Jinyang
    Guo, Feng
    He, Dongyu
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2025, 259
  • [7] sEMG-based recognition of composite motion with convolutional neural network
    Qi, Shuhao
    Wu, Xingming
    Chen, Wei-Hai
    Liu, Jingmeng
    Zhang, Jianbin
    Wang, Jianhua
    [J]. SENSORS AND ACTUATORS A-PHYSICAL, 2020, 311
  • [8] SEMG-BASED HAND GESTURE RECOGNITION VIA DILATED CONVOLUTIONAL NEURAL NETWORKS
    Rahimian, Elahe
    Zabihi, Soheil
    Atashzar, S. Farokh
    Asif, Amir
    Mohammadi, Arash
    [J]. 2019 7TH IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (IEEE GLOBALSIP), 2019,
  • [9] sEMG-Based Hand Gesture Recognition Using Binarized Neural Network
    Kang, Soongyu
    Kim, Haechan
    Park, Chaewoon
    Sim, Yunseong
    Lee, Seongjoo
    Jung, Yunho
    [J]. SENSORS, 2023, 23 (03)
  • [10] Facial Expression Recognition Based on Multi-scale Feature Fusion Convolutional Neural Network and Attention Mechanism
    Wu, Yana
    Jia, Kebin
    Sun, Zhonghua
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2021, PT II, 2021, 13020 : 324 - 335