Skeleton-Based Dynamic Hand Gesture Recognition Using a Part-Based GRU-RNN for Gesture-Based Interface

被引:27
|
作者
Shin, Seunghyeok [1 ]
Kim, Whoi-Yul [1 ]
机构
[1] Hanyang Univ, Dept Elect & Comp Engn, Seoul 04763, South Korea
关键词
Feature extraction; Gesture recognition; Joints; Neural networks; Hidden Markov models; Sensors; Artificial neural networks; gesture recognition; multi-layer neural network; recurrent neural networks; SEGMENTATION;
D O I
10.1109/ACCESS.2020.2980128
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent improvements in imaging sensors and computing units have led to the development of a range of image-based human-machine interfaces (HMIs). An important approach in this direction is the use of dynamic hand gestures for a gesture-based interface, and some methods have been developed to provide real-time hand skeleton generation from depth images for dynamic hand gesture recognition. Towards this end, we propose a skeleton-based dynamic hand gesture recognition method that divides geometric features into multiple parts and uses a gated recurrent unit-recurrent neural network (GRU-RNN) for each feature part. Because each divided feature part has fewer dimensions than an entire feature, the number of hidden units required for optimization is reduced. As a result, we achieved similar recognition performance as the latest methods with fewer parameters.
引用
收藏
页码:50236 / 50243
页数:8
相关论文
共 50 条
  • [31] Spatial-Temporal Attention Res-TCN for Skeleton-Based Dynamic Hand Gesture Recognition
    Hou, Jingxuan
    Wang, Guijin
    Chen, Xinghao
    Xue, Jing-Hao
    Zhu, Rui
    Yang, Huazhong
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT VI, 2019, 11134 : 273 - 286
  • [32] Gesture recognition matching based on dynamic skeleton
    Wang Jingyao
    Yu Naigong
    Firdaous, Essaf
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 1680 - 1685
  • [33] Dynamic Hand Gesture Recognition Using the Skeleton of the Hand
    Bogdan Ionescu
    Didier Coquin
    Patrick Lambert
    Vasile Buzuloiu
    EURASIP Journal on Advances in Signal Processing, 2005
  • [34] Dynamic hand gesture recognition using the skeleton of the hand
    Ionescu, B
    Coquin, D
    Lambert, P
    Buzuloiu, V
    EURASIP JOURNAL ON APPLIED SIGNAL PROCESSING, 2005, 2005 (13) : 2101 - 2109
  • [35] Normalize d e dge convolutional networks for skeleton-based hand gesture recognition
    Guo, Fangtai
    He, Zaixing
    Zhang, Shuyou
    Zhao, Xinyue
    Fang, Jinhui
    Tan, Jianrong
    PATTERN RECOGNITION, 2021, 118
  • [36] Learning Recurrent High-order Statistics for Skeleton-based Hand Gesture Recognition
    Nguyen, Xuan Son
    Brun, Luc
    Lezoray, Olivier
    Bougleux, Sebastien
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 975 - 982
  • [37] Hand Gesture Recognition based on Skeleton of Point Clouds
    Wu, Shen
    Jiang, Feng
    Zhao, Debin
    2012 IEEE FIFTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2012, : 566 - 569
  • [38] Hand gesture-based interface with multichannel sEMG band enabling unknown gesture discrimination
    Tomczynski, Jakub
    Kaczmarek, Piotr
    Mankowski, Tomasz
    2015 10TH INTERNATIONAL WORKSHOP ON ROBOT MOTION AND CONTROL (ROMOCO), 2015, : 52 - 57
  • [39] Skeleton-Based Gesture Recognition With Learnable Paths and Signature Features
    Cheng, Jiale
    Shi, Dongzi
    Li, Chenyang
    Li, Yu
    Ni, Hao
    Jin, Lianwen
    Zhang, Xin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 3951 - 3961
  • [40] A Hand Gesture Recognition Framework and Wearable Gesture-Based Interaction Prototype for Mobile Devices
    Lu, Zhiyuan
    Chen, Xiang
    Li, Qiang
    Zhang, Xu
    Zhou, Ping
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2014, 44 (02) : 293 - 299