A simple and effective static gesture recognition method based on attention mechanism

被引:7
|
作者
Zhang, Lizao [1 ]
Tian, Qiuhong [1 ]
Ruan, Qionglu [1 ]
Shi, Zhixiang [1 ]
机构
[1] Zhejiang Sci Tech Univ, Sch Informat Sci & Technol, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
Sign language recognition; Deep learning; Attention mechanism;
D O I
10.1016/j.jvcir.2023.103783
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To solve the problem of low sign language recognition rate under the condition of small samples, a simple and effective static gesture recognition method based on an attention mechanism is proposed. The method proposed in this paper can enhance the features of both the details and the subject of the gesture image. The input of the proposed method depends on the intermediate feature map generated by the original network. Also, the proposed convolutional model is a lightweight general module, which can be seamlessly integrated into any CNN(Convolutional Neural Network) architecture and achieve significant performance gains with minimal overhead. Experiments on two different datasets show that the proposed method is effective and can improve the accuracy of sign language recognition of the benchmark model, making its performance better than the existing methods.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Static gesture recognition based on thermal imaging sensors
    Zhang, Zhi-Yuan
    Ren, Hao
    Li, Hao
    Yuan, Kang-Hui
    Zhu, Chu-Feng
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (04):
  • [32] Recognition of Static Hand Gesture
    Sadeddine, Khadidja
    Djeradi, Rachida
    Chelali, Fatma Zohra
    Djeradi, Amar
    PROCEEDINGS OF 2018 6TH INTERNATIONAL CONFERENCE ON MULTIMEDIA COMPUTING AND SYSTEMS (ICMCS), 2018, : 368 - 373
  • [33] A hybrid approach for static hand gesture recognition with integrated BiGRU-BiLSTM and sequential self-attention mechanism
    Arti Bahuguna
    Mahesh Chandra Govil
    Gopa Bhaumik
    Signal, Image and Video Processing, 2025, 19 (6)
  • [34] Gesture recognition method based on FSMM
    Zou, Wei
    Yuan, Kui
    Du, Qingxiu
    Chen, Jinlong
    Jisuanji Gongcheng/Computer Engineering, 2003, 29 (15):
  • [35] Gesture recognition by attention control method for intelligent humanoid robot
    Oh, JY
    Lee, CW
    You, BJ
    KNOWLEDGE-BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT 1, PROCEEDINGS, 2005, 3681 : 1139 - 1145
  • [36] Gesture recognition based on millimeter-wave radar with pure self-attention mechanism
    Zhang C.
    Wang G.
    Chen Q.
    Deng Z.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2024, 46 (03): : 859 - 867
  • [37] A method of gesture recognition based on morphology
    Yin, Chunping
    Liao, Caiying
    Wang, Dexin
    Dong, Yiwei
    2018 IEEE CSAA GUIDANCE, NAVIGATION AND CONTROL CONFERENCE (CGNCC), 2018,
  • [38] A classroom facial expression recognition method based on attention mechanism
    Jin, Huilong
    Du, Ruiyan
    Wen, Tian
    Zhao, Jia
    Shi, Lei
    Zhang, Shuang
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (06) : 11873 - 11882
  • [39] Road Sign Recognition Method Based on Segmentation and Attention Mechanism
    Chen, Tianao
    Chen, Aotian
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [40] Dynamic Hand Gesture Recognition Using Effective Feature Extraction and Attention Based Deep Neural Network
    Miah, Abu Saleh Musa
    Shin, Jungpil
    Hasan, Md. Al Mehedi
    Okuyama, Yuichi
    Nobuyoshi, Asai
    2023 IEEE 16TH INTERNATIONAL SYMPOSIUM ON EMBEDDED MULTICORE/MANY-CORE SYSTEMS-ON-CHIP, MCSOC, 2023, : 241 - 247