RNN With Stacked Architecture for sEMG based Sequence-to-Sequence Hand Gesture Recognition

被引:0
|
作者
Koch, Philipp [1 ]
Dreier, Mark [1 ]
Maass, Marco [1 ]
Phan, Huy [2 ]
Mertins, Alfred [1 ]
机构
[1] Univ Lubeck, Inst Signal Proc, Lubeck, Germany
[2] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London, England
关键词
hand movement classification; surface electromyography; recurrent neural network; hand prosthesis;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Having proven their suitability for real world applications, surface electromyography signals are the means of choice for hand gesture recognition especially in medical applications like upper limb prosthesis. So far, mostly hand-crafted features combined with a standard classifier or neural networks are adopted for signal analysis. However, the performance of the standard approaches is insufficient and the networks are inappropriate for embedded applications due to their sheer size. To address these problems, a small recurrent neural network is proposed to fully utilize the sequential nature of the biosignals. Our network architecture features a special recurrent neural network cell for feature learning and extraction instead of convolutional layers and another type of cell for further processing. To evaluate the suitability of this inhomogenously stacked recurrent neural network, experiments on three different databases were conducted. The results reveal that this small network significantly outperforms state-of-the-art systems and sets new records. In addition, we demonstrate that it is possible to achieve relatively equal performance across all subjects.
引用
收藏
页码:1600 / 1604
页数:5
相关论文
共 50 条
  • [21] On the Choice of Modeling Unit for Sequence-to-Sequence Speech Recognition
    Irie, Kazuki
    Prabhavalkar, Rohit
    Kannan, Anjuli
    Bruguier, Antoine
    Rybach, David
    Nguyen, Patrick
    INTERSPEECH 2019, 2019, : 3800 - 3804
  • [22] On the Use of Deeper CNNs in Hand Gesture Recognition Based on sEMG Signals
    Tsagkas, Nikolaos
    Tsinganos, Panagiotis
    Skodras, Athanassios
    2019 10TH INTERNATIONAL CONFERENCE ON INFORMATION, INTELLIGENCE, SYSTEMS AND APPLICATIONS (IISA), 2019, : 585 - 588
  • [23] Hand Gesture Recognition Based on sEMG Signal and Convolutional Neural Network
    Su, Ziyi
    Liu, Handong
    Qian, Jinwu
    Zhang, Zhen
    Zhang, Lunwei
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2021, 35 (11)
  • [24] An Efficient Solution for Hand Gesture Recognition from Video Sequence
    Prodan, Remus-Catalin
    Pentiuc, Stefan-Gheorghe
    Vatavu, Radu-Daniel
    ADVANCES IN ELECTRICAL AND COMPUTER ENGINEERING, 2012, 12 (03) : 85 - 88
  • [25] Analysis of Multilingual Sequence-to-Sequence Speech Recognition Systems
    Karafiat, Martin
    Baskar, Murali Karthick
    Watanabe, Shinji
    Hori, Takaaki
    Wiesner, Matthew
    Cernocky, Jan Honza
    INTERSPEECH 2019, 2019, : 2220 - 2224
  • [26] SUPERVISED ATTENTION IN SEQUENCE-TO-SEQUENCE MODELS FOR SPEECH RECOGNITION
    Yang, Gene-Ping
    Tang, Hao
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7222 - 7226
  • [27] ACOUSTIC-TO-WORD RECOGNITION WITH SEQUENCE-TO-SEQUENCE MODELS
    Palaskar, Shruti
    Metze, Florian
    2018 IEEE WORKSHOP ON SPOKEN LANGUAGE TECHNOLOGY (SLT 2018), 2018, : 397 - 404
  • [28] CONFIDENCE ESTIMATION FOR ATTENTION-BASED SEQUENCE-TO-SEQUENCE MODELS FOR SPEECH RECOGNITION
    Li, Qiujia
    Qiu, David
    Zhang, Yu
    Li, Bo
    He, Yanzhang
    Woodland, Philip C.
    Cao, Liangliang
    Strohman, Trevor
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6388 - 6392
  • [29] Syllable-Based Sequence-to-Sequence Speech Recognition with the Transformer in Mandarin Chinese
    Zhou, Shiyu
    Dong, Linhao
    Xu, Shuang
    Xu, Bo
    19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 791 - 795
  • [30] High Performance Sequence-to-Sequence Model for Streaming Speech Recognition
    Thai-Son Nguyen
    Ngoc-Quan Pham
    Stueker, Sebastian
    Waibel, Alex
    INTERSPEECH 2020, 2020, : 2147 - 2151