An end-to-end hand action recognition framework based on cross-time mechanomyography signals

被引:0
|
作者
Zhang, Yue [1 ]
Li, Tengfei [1 ]
Zhang, Xingguo [1 ]
Xia, Chunming [2 ]
Zhou, Jie [1 ]
Sun, Maoxun [3 ]
机构
[1] Nantong Univ, Sch Mech Engn, Nantong 226019, Peoples R China
[2] East China Univ Sci & Technol, Sch Mech & Power Engn, Shanghai 200237, Peoples R China
[3] Univ Shanghai Sci & Technol, Sch Mech Engn, Shanghai 200093, Peoples R China
基金
中国国家自然科学基金;
关键词
Densely connected convolutional networks (DenseNet); Hand action recognition; Mechanomyography (MMG); CLASSIFICATION;
D O I
10.1007/s40747-024-01541-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The susceptibility of mechanomyography (MMG) signals acquisition to sensor donning and doffing, and the apparent time-varying characteristics of biomedical signals collected over different periods, inevitably lead to a reduction in model recognition accuracy. To investigate the adverse effects on the recognition results of hand actions, a 12-day cross-time MMG data collection experiment with eight subjects was conducted by an armband, then a novel MMG-based hand action recognition framework with densely connected convolutional networks (DenseNet) was proposed. In this study, data from 10 days were selected as a training subset, and the remaining data from another 2 days were used as a test set to evaluate the model's performance. As the number of days in the training set increases, the recognition accuracy increases and becomes more stable, peaking when the training set includes 10 days and achieving an average recognition rate of 99.57% (+/- 0.37%). In addition, part of the training subset is extracted and recombined into a new dataset and the better classification performances of models can be achieved from the test set. The method proposed effectively mitigates the adverse effects of sensor donning and doffing on recognition results.
引用
收藏
页码:6953 / 6964
页数:12
相关论文
共 50 条
  • [31] A Text Detection and Recognition System based on an End-to-End Trainable Framework from UAV Imagery
    Wu, Qingtian
    Zhou, Yimin
    Liang, Guoyuan
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2018, : 736 - 741
  • [32] A hybrid CTC plus Attention model based on end-to-end framework for multilingual speech recognition
    Liang, Sendong
    Yan, Wei Qi
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (28) : 41295 - 41308
  • [33] End-to-End Slot Alignment and Recognition for Cross-Lingual NLU
    Xu, Weijia
    Haider, Batool
    Mansour, Saab
    [J]. PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 5052 - 5063
  • [34] A Cross-Domain Framework for Coordinated End-to-End QoS Adaptation
    Zhou, LiFeng
    Pung, Hung Keng
    Ngoh, Lek Heng
    [J]. 2008 IEEE 33RD CONFERENCE ON LOCAL COMPUTER NETWORKS, VOLS 1 AND 2, 2008, : 521 - +
  • [35] Phoneme-Based Contextualization for Cross-Lingual Speech Recognition in End-to-End Models
    Hu, Ke
    Bruguier, Antoine
    Sainath, Tara N.
    Prabhavalkar, Rohit
    Pundak, Golan
    [J]. INTERSPEECH 2019, 2019, : 2155 - 2159
  • [36] Deep TextSpotter: An End-to-End Trainable Scene Text Localization and Recognition Framework
    Busta, Michal
    Neumann, Lukas
    Matas, Jiri
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2223 - 2231
  • [37] An End-to-end Speech Recognition Algorithm based on Attention Mechanism
    Chen, Jia-nan
    Gao, Shuang
    Sun, Han-zhe
    Liu, Xiao-hui
    Wang, Zi-ning
    Zheng, Yan
    [J]. PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 2935 - 2940
  • [38] Lattice Based Transcription Loss for End-to-End Speech Recognition
    Kang, Jian
    Zhang, Wei-Qiang
    Liu, Wei-Wei
    Liu, Jia
    Johnson, Michael T.
    [J]. JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2018, 90 (07): : 1013 - 1023
  • [39] Lattice Based Transcription Loss for End-to-End Speech Recognition
    Kang, Jian
    Zhang, Wei-Qiang
    Liu, Jia
    [J]. 2016 10TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2016,
  • [40] End-to-End Speech Emotion Recognition Based on Neural Network
    Zhu, Bing
    Zhou, Wenkai
    Wang, Yutian
    Wang, Hui
    Cai, Juan Juan
    [J]. 2017 17TH IEEE INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT 2017), 2017, : 1634 - 1638