Skeleton-Based Dynamic Hand Gesture Recognition Using a Part-Based GRU-RNN for Gesture-Based Interface

被引:27
|
作者
Shin, Seunghyeok [1 ]
Kim, Whoi-Yul [1 ]
机构
[1] Hanyang Univ, Dept Elect & Comp Engn, Seoul 04763, South Korea
关键词
Feature extraction; Gesture recognition; Joints; Neural networks; Hidden Markov models; Sensors; Artificial neural networks; gesture recognition; multi-layer neural network; recurrent neural networks; SEGMENTATION;
D O I
10.1109/ACCESS.2020.2980128
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent improvements in imaging sensors and computing units have led to the development of a range of image-based human-machine interfaces (HMIs). An important approach in this direction is the use of dynamic hand gestures for a gesture-based interface, and some methods have been developed to provide real-time hand skeleton generation from depth images for dynamic hand gesture recognition. Towards this end, we propose a skeleton-based dynamic hand gesture recognition method that divides geometric features into multiple parts and uses a gated recurrent unit-recurrent neural network (GRU-RNN) for each feature part. Because each divided feature part has fewer dimensions than an entire feature, the number of hidden units required for optimization is reduced. As a result, we achieved similar recognition performance as the latest methods with fewer parameters.
引用
收藏
页码:50236 / 50243
页数:8
相关论文
共 50 条
  • [21] DIFFERENTIAL PSEUDO-IMAGE FOR SKELETON-BASED DYNAMIC GESTURE RECOGNITION
    Kapuscinski, Tomasz
    Mis, Mateusz
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 4203 - 4207
  • [22] Skeleton-Based Hand Gesture Recognition by Learning SPD Matrices with Neural Networks
    Xuan Son Nguyen
    Brun, Luc
    Lezoray, Olivier
    Bougleux, Sebastien
    2019 14TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2019), 2019, : 326 - 330
  • [23] Bidirectional Independently Recurrent Neural Network for Skeleton-based Hand Gesture Recognition
    Li, Shuai
    Zheng, Longfei
    Zhu, Ce
    Gao, Yanbo
    2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2020,
  • [24] Spatial--Temporal Synchronous Transformer for Skeleton-Based Hand Gesture Recognition
    Zhao, Dongdong
    Li, Hongli
    Yan, Shi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (03) : 1403 - 1412
  • [25] Decoupled Representation Learning for Skeleton-Based Gesture Recognition
    Liu, Jianbo
    Liu, Yongcheng
    Wang, Ying
    Prinet, Veronique
    Xiang, Shiming
    Pan, Chunhong
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5750 - 5759
  • [26] A lightweight GRU-based gesture recognition model for skeleton dynamic graphs
    Ni, Jianjun
    Wang, Yongchun
    Tang, Guangyi
    Cao, Weidong
    Yang, Simon X.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (27) : 70545 - 70570
  • [27] Skeleton-based Visual Recognition of Diver's Gesture
    Ghader, Bilal
    Dune, Claire
    Watelain, Eric
    Hugel, Vincent
    OCEANS 2023 - LIMERICK, 2023,
  • [28] Hand Gesture Recognition Using Skeleton of Hand and Distance Based Metric
    Reddy, K. Sivarajesh
    Latha, P. Swarna
    Babu, M. Rajasekhara
    ADVANCES IN COMPUTING AND INFORMATION TECHNOLOGY, 2011, 198 : 346 - 354
  • [29] Skeleton-Based Hand Gesture Recognition by Using Multi-input Fusion Lightweight Network
    Hu, Qihao
    Gao, Qing
    Gao, Hongwei
    Ju, Zhaojie
    INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2022), PT I, 2022, 13455 : 24 - 34
  • [30] Developing a gesture-based interface
    Gupta, N
    Mittal, P
    Roy, SD
    Chaudhury, S
    Banerjee, S
    IETE JOURNAL OF RESEARCH, 2002, 48 (3-4) : 237 - 244