Skeleton-Based Dynamic Hand Gesture Recognition Using a Part-Based GRU-RNN for Gesture-Based Interface

被引:27
|
作者
Shin, Seunghyeok [1 ]
Kim, Whoi-Yul [1 ]
机构
[1] Hanyang Univ, Dept Elect & Comp Engn, Seoul 04763, South Korea
关键词
Feature extraction; Gesture recognition; Joints; Neural networks; Hidden Markov models; Sensors; Artificial neural networks; gesture recognition; multi-layer neural network; recurrent neural networks; SEGMENTATION;
D O I
10.1109/ACCESS.2020.2980128
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent improvements in imaging sensors and computing units have led to the development of a range of image-based human-machine interfaces (HMIs). An important approach in this direction is the use of dynamic hand gestures for a gesture-based interface, and some methods have been developed to provide real-time hand skeleton generation from depth images for dynamic hand gesture recognition. Towards this end, we propose a skeleton-based dynamic hand gesture recognition method that divides geometric features into multiple parts and uses a gated recurrent unit-recurrent neural network (GRU-RNN) for each feature part. Because each divided feature part has fewer dimensions than an entire feature, the number of hidden units required for optimization is reduced. As a result, we achieved similar recognition performance as the latest methods with fewer parameters.
引用
收藏
页码:50236 / 50243
页数:8
相关论文
共 50 条
  • [1] Skeleton-based Dynamic hand gesture recognition
    De Smedt, Quentin
    Wannous, Hazem
    Vandeborre, Jean-Philippe
    PROCEEDINGS OF 29TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, (CVPRW 2016), 2016, : 1206 - 1214
  • [2] Motion feature estimation using bi-directional GRU for skeleton-based dynamic hand gesture recognition
    Tripathi, Reena
    Verma, Bindu
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (SUPPL 1) : 299 - 308
  • [3] Decoupled and boosted learning for skeleton-based dynamic hand gesture recognition
    Li, Yangke
    Wei, Guangshun
    Desrosiers, Christian
    Zhou, Yuanfeng
    PATTERN RECOGNITION, 2024, 153
  • [4] Compact joints encoding for skeleton-based dynamic hand gesture recognition
    Li, Yangke
    Ma, Dongyang
    Yu, Yuhang
    Wei, Guangshun
    Zhou, Yuanfeng
    COMPUTERS & GRAPHICS-UK, 2021, 97 : 191 - 199
  • [5] CNN plus RNN Depth and Skeleton based Dynamic Hand Gesture Recognition
    Lai, Kenneth
    Yanushkevich, Svetlana N.
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 3451 - 3456
  • [6] Quantized depth image and skeleton-based multimodal dynamic hand gesture recognition
    Mahmud, Hasan
    Morshed, Mashrur M.
    Hasan, Md. Kamrul
    VISUAL COMPUTER, 2024, 40 (01): : 11 - 25
  • [7] Quantized depth image and skeleton-based multimodal dynamic hand gesture recognition
    Hasan Mahmud
    Mashrur M. Morshed
    Md. Kamrul Hasan
    The Visual Computer, 2024, 40 : 11 - 25
  • [8] A Skeleton-based Dynamic Hand Gesture Recognition for Home Appliance Control System
    Tsai, Tsung-Han
    Luo, Yi-Jhen
    Wan, Wei-Chung
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 3265 - 3268
  • [9] An Efficient Graph Convolution Network for Skeleton-Based Dynamic Hand Gesture Recognition
    Peng, Sheng-Hui
    Tsai, Pei-Hsuan
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2023, 15 (04) : 2179 - 2189
  • [10] SHREC 2021: Skeleton-based hand gesture recognition in the wild
    Caputo, Ariel
    Giachetti, Andrea
    Soso, Simone
    Pintani, Deborah
    D'Eusanio, Andrea
    Pini, Stefano
    Borghi, Guido
    Simoni, Alessandro
    Vezzani, Roberto
    Cucchiara, Rita
    Ranieri, Andrea
    Giannini, Franca
    Lupinetti, Katia
    Monti, Marina
    Maghoumi, Mehran
    LaViola Jr, J. Joseph
    Le, Minh-Quan
    Nguyen, Hai-Dang
    Tran, Minh-Triet
    COMPUTERS & GRAPHICS-UK, 2021, 99 : 201 - 211