A simple and effective static gesture recognition method based on attention mechanism

被引:7
|
作者
Zhang, Lizao [1 ]
Tian, Qiuhong [1 ]
Ruan, Qionglu [1 ]
Shi, Zhixiang [1 ]
机构
[1] Zhejiang Sci Tech Univ, Sch Informat Sci & Technol, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
Sign language recognition; Deep learning; Attention mechanism;
D O I
10.1016/j.jvcir.2023.103783
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To solve the problem of low sign language recognition rate under the condition of small samples, a simple and effective static gesture recognition method based on an attention mechanism is proposed. The method proposed in this paper can enhance the features of both the details and the subject of the gesture image. The input of the proposed method depends on the intermediate feature map generated by the original network. Also, the proposed convolutional model is a lightweight general module, which can be seamlessly integrated into any CNN(Convolutional Neural Network) architecture and achieve significant performance gains with minimal overhead. Experiments on two different datasets show that the proposed method is effective and can improve the accuracy of sign language recognition of the benchmark model, making its performance better than the existing methods.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] A Simple and Effective Method for Hand Gesture Recognition
    Quan, Chunying
    Liang, Jianning
    2016 INTERNATIONAL CONFERENCE ON NETWORK AND INFORMATION SYSTEMS FOR COMPUTERS (ICNISC), 2016, : 302 - 305
  • [2] HandFormer: A Dynamic Hand Gesture Recognition Method Based on Attention Mechanism
    Zhang, Yun
    Wang, Fengping
    APPLIED SCIENCES-BASEL, 2023, 13 (07):
  • [3] A static gesture recognition method based on data glove
    Lu, Lei
    Zhang, Jinling
    Zhu, Yingjie
    Liu, Hong
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2015, 27 (12): : 2410 - 2418
  • [4] sEMG Gesture Recognition with a Simple Model of Attention
    Josephs, David
    Drake, Carson
    Heroy, Andy
    Santerre, John
    MACHINE LEARNING FOR HEALTH, VOL 136, 2020, 136 : 126 - 138
  • [5] A fast static gesture recognition method
    Zhang, Dongquan
    Zhao, Jian
    International Journal of Computer Applications in Technology, 2014, 50 (03) : 253 - 257
  • [6] A fast static gesture recognition method
    Zhang, Dongquan
    Zhao, Jian
    INTERNATIONAL JOURNAL OF COMPUTER APPLICATIONS IN TECHNOLOGY, 2014, 50 (3-4) : 253 - 257
  • [7] Static hand gesture recognition method based on the Vision Transformer
    Yu Zhang
    Junlin Wang
    Xin Wang
    Haonan Jing
    Zhanshuo Sun
    Yu Cai
    Multimedia Tools and Applications, 2023, 82 : 31309 - 31328
  • [8] Static hand gesture recognition method based on the Vision Transformer
    Zhang, Yu
    Wang, Junlin
    Wang, Xin
    Jing, Haonan
    Sun, Zhanshuo
    Cai, Yu
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (20) : 31309 - 31328
  • [9] A static hand gesture recognition method based on the depth information
    Ma, Li
    Huang, Wenjing
    2016 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC), VOL. 2, 2016, : 136 - 139
  • [10] A Gesture Recognition Method Based on MIC-Attention- LSTM
    Hu, Ming-Jia
    Gong, Yu-Lin
    Chen, Xiao-Juan
    Han, Bo
    HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES, 2023, 13