A simple and effective static gesture recognition method based on attention mechanism

被引:7
|
作者
Zhang, Lizao [1 ]
Tian, Qiuhong [1 ]
Ruan, Qionglu [1 ]
Shi, Zhixiang [1 ]
机构
[1] Zhejiang Sci Tech Univ, Sch Informat Sci & Technol, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
Sign language recognition; Deep learning; Attention mechanism;
D O I
10.1016/j.jvcir.2023.103783
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To solve the problem of low sign language recognition rate under the condition of small samples, a simple and effective static gesture recognition method based on an attention mechanism is proposed. The method proposed in this paper can enhance the features of both the details and the subject of the gesture image. The input of the proposed method depends on the intermediate feature map generated by the original network. Also, the proposed convolutional model is a lightweight general module, which can be seamlessly integrated into any CNN(Convolutional Neural Network) architecture and achieve significant performance gains with minimal overhead. Experiments on two different datasets show that the proposed method is effective and can improve the accuracy of sign language recognition of the benchmark model, making its performance better than the existing methods.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Gesture recognition based on sEMG using multi-attention mechanism for remote control
    Lv, Xiaodong
    Dai, Chuankai
    Liu, Haijie
    Tian, Ye
    Chen, Luyao
    Lang, Yiran
    Tang, Rongyu
    He, Jiping
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (19): : 13839 - 13849
  • [22] Gesture recognition based on sEMG using multi-attention mechanism for remote control
    Xiaodong Lv
    Chuankai Dai
    Haijie Liu
    Ye Tian
    Luyao Chen
    Yiran Lang
    Rongyu Tang
    Jiping He
    Neural Computing and Applications, 2023, 35 : 13839 - 13849
  • [23] Parallel temporal feature selection based on improved attention mechanism for dynamic gesture recognition
    Gongzheng Chen
    Zhenghong Dong
    Jue Wang
    Lurui Xia
    Complex & Intelligent Systems, 2023, 9 : 1377 - 1390
  • [24] Parallel temporal feature selection based on improved attention mechanism for dynamic gesture recognition
    Chen, Gongzheng
    Dong, Zhenghong
    Wang, Jue
    Xia, Lurui
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (02) : 1377 - 1390
  • [25] HAND GESTURE RECOGNITION USING TEMPORAL CONVOLUTIONS AND ATTENTION MECHANISM
    Rahimian, Elahe
    Zabihi, Soheil
    Asif, Amir
    Farina, Dario
    Atashzar, S. Farokh
    Mohammadi, Arash
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1196 - 1200
  • [26] Gesture Feature Extraction for Static Gesture Recognition
    Haitham Sabah Hasan
    Sameem Binti Abdul Kareem
    Arabian Journal for Science and Engineering, 2013, 38 : 3349 - 3366
  • [27] Gesture Feature Extraction for Static Gesture Recognition
    Hasan, Haitham Sabah
    Kareem, Sameem Binti Abdul
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2013, 38 (12) : 3349 - 3366
  • [28] Static Hand Gesture Recognition Based on Fusion of Moments
    Chatterjee, Subhamoy
    Ghosh, Dipak Kumar
    Ari, Samit
    INTELLIGENT COMPUTING, COMMUNICATION AND DEVICES, 2015, 309 : 429 - 434
  • [29] Vision Based Static Hand Gesture Recognition Techniques
    Sharrma, Ananyaa
    Khandelwal, Ayush
    Kaur, Kavleen
    Joshi, Shivani
    Upadhyay, Richa
    Prabhu, Sameer
    2017 INTERNATIONAL CONFERENCE ON COMMUNICATION AND SIGNAL PROCESSING (ICCSP), 2017, : 705 - 709
  • [30] A VISUAL-BASED RESEARCH ON STATIC GESTURE RECOGNITION
    Xue, Jun-Tao
    Zong, Yun-Rui
    Li, Hong-Wei
    PROCEEDINGS OF 2013 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOLS 1-4, 2013, : 476 - 480