A simple and effective static gesture recognition method based on attention mechanism

被引:7
|
作者
Zhang, Lizao [1 ]
Tian, Qiuhong [1 ]
Ruan, Qionglu [1 ]
Shi, Zhixiang [1 ]
机构
[1] Zhejiang Sci Tech Univ, Sch Informat Sci & Technol, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
Sign language recognition; Deep learning; Attention mechanism;
D O I
10.1016/j.jvcir.2023.103783
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To solve the problem of low sign language recognition rate under the condition of small samples, a simple and effective static gesture recognition method based on an attention mechanism is proposed. The method proposed in this paper can enhance the features of both the details and the subject of the gesture image. The input of the proposed method depends on the intermediate feature map generated by the original network. Also, the proposed convolutional model is a lightweight general module, which can be seamlessly integrated into any CNN(Convolutional Neural Network) architecture and achieve significant performance gains with minimal overhead. Experiments on two different datasets show that the proposed method is effective and can improve the accuracy of sign language recognition of the benchmark model, making its performance better than the existing methods.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] A Simple RF-Based Solution for Gesture Recognition
    Louzir, Ali
    Haskou, Abdullah
    Pesin, Anthony
    2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2021,
  • [42] Synthetic Aperture Radar Automatic Target Recognition Based on a Simple Attention Mechanism
    Ukwuoma, Chiagoziem C.
    Zhiguang, Qin
    Tienin, Bole W.
    Yussif, Sophyani B.
    Ejiyi, Chukwuebuka J.
    Urama, Gilbert C.
    Ukwuoma, Chibueze D.
    Chikwendu, Ijeoma A.
    INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE, 2023, 8 (04): : 67 - 77
  • [43] A Simple Manner of Dynamic Gesture Recognition Based on Kinect
    Li, Fenggang
    Jiang, Xiangfei
    Xia, Xiaobo
    PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE: TECHNOLOGIES AND APPLICATIONS, 2016, 127
  • [44] A Static Gesture Recognition Algorithm Based on DAG-SVMs
    Li, Mengxin
    Jiang, Tongwei
    Xu, Rui
    Lin, Baifeng
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON MODELLING, IDENTIFICATION AND CONTROL (ICMIC2019), 2020, 582 : 185 - 193
  • [45] A Static Hand Gesture Recognition Algorithm Based on Krawtchouk Moments
    Liu, Shuping
    Liu, Yu
    Yu, Jun
    Wang, Zengfu
    PATTERN RECOGNITION (CCPR 2014), PT II, 2014, 484 : 321 - 330
  • [46] Static Hand Gesture Recognition Based on Convolutional Neural Networks
    Pinto, Raimundo F., Jr.
    Borges, Carlos D. B.
    Almeida, Antonio M. A.
    Paula, Alis C., Jr.
    JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING, 2019, 2019
  • [47] Static Hand Gesture Recognition Based on Neighborhood Rough Set
    Cui, Zhen-Xing
    Yang, Ming-Qiang
    Zeng, Wei
    Zhuang, Hui-Wei
    FUZZY SYSTEM AND DATA MINING, 2016, 281 : 122 - 128
  • [48] Data glove-based gesture recognition using CNN-BiLSTM model with attention mechanism
    Wu, Jiawei
    Ren, Peng
    Song, Boming
    Zhang, Ran
    Zhao, Chen
    Zhang, Xiao
    PLOS ONE, 2023, 18 (11):
  • [49] Deep Learning with Attention on Hand Gesture Recognition Based on sEMG
    Zhao, Huanjun
    Zheng, Bin
    Wang, Le
    2022 PROGNOSTICS AND HEALTH MANAGEMENT CONFERENCE, PHM-LONDON 2022, 2022, : 316 - 320
  • [50] Attention-Based Gated Recurrent Unit for Gesture Recognition
    Khodabandelou, Ghazaleh
    Jung, Pyeong-Gook
    Amirat, Yacine
    Mohammed, Samer
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2021, 18 (02) : 495 - 507