3D Hand Gesture Representation and Recognition through Deep Joint Distance Measurements

被引:0
|
作者
Vasavi, P. [1 ]
Maloji, Suman [1 ]
Kumar, E. Kiran [1 ]
Kumar, D. Anil [2 ]
Sasikala, N. [1 ]
机构
[1] Koneru Lakshmaiah Educ Fdn, Dept ECM, Vaddeswaram, Andhra Pradesh, India
[2] PACE Inst Technol & Sci, Dept ECE, Ongole, Andhra Pradesh, India
关键词
Gesture recognition; 3D motion capture; deep learning; joint relational distance maps; MAPS;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Hand gestures with finger relationships are among the toughest features to extract for machine recognition. In this paper, this particular research challenge is addressed with 3D hand joint features extracted from distance measurements which are then colour mapped as spatio temporal features. Further patterns are learned using an 8-layer convolutional neural network (CNN) to estimate the hand gesture. The results showed a higher degree of recognition accuracy when compared to similar 3D hand gesture methods. The recognition accuracy for our dataset KL 3DHG with 220 classes was around 94.32%. Robustness of the proposed method was validated with only available benchmark 3D skeletal hand gesture dataset DGH 14/28.
引用
收藏
页码:741 / 748
页数:8
相关论文
共 50 条
  • [1] Survey on 3D Hand Gesture Recognition
    Cheng, Hong
    Yang, Lu
    Liu, Zicheng
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2016, 26 (09) : 1659 - 1673
  • [2] Hand gesture recognition via deep data optimization and 3D reconstruction
    Mustafa, Zaid
    Nsour, Heba
    Tahir, Sheikh Badar ud din
    [J]. PEERJ COMPUTER SCIENCE, 2023, 9
  • [3] A ToF 3D Database for Hand Gesture Recognition
    Simion, Georgiana
    Caleanu, Catalin-Daniel
    [J]. 2012 10TH INTERNATIONAL SYMPOSIUM ON ELECTRONICS AND TELECOMMUNICATIONS, 2012, : 363 - 366
  • [4] Hand Gesture Recognition Using 3D Sensors
    Goga, Jozef
    Kajan, Slavomir
    [J]. PROCEEDINGS OF 2017 INTERNATIONAL SYMPOSIUM ELMAR, 2017, : 181 - 184
  • [5] Hand Gesture Recognition for Blind Users by Tracking 3D Gesture Trajectory
    Khanna, Prerna
    Ramakrishnan, Iv
    Jain, Shubham
    Bi, Xiaojun
    Balasubramanian, Aruna
    [J]. PROCEEDINGS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYTEMS (CHI 2024), 2024,
  • [6] A ROBUST TRACKING ALGORITHM FOR 3D HAND GESTURE WITH RAPID HAND MOTION THROUGH DEEP LEARNING
    Sanchez-Riera, Jordi
    Hsiao, Yuan-Sheng
    Lim, Tekoing
    Hua, Kai-Lung
    Cheng, Wen-Huang
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2014,
  • [7] Hand Gesture Recognition with 3D Convolutional Neural Networks
    Molchanov, Pavlo
    Gupta, Shalini
    Kim, Kihwan
    Kautz, Jan
    [J]. 2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2015,
  • [8] 3D Hand Gesture Recognition for Drone Control in Unity
    Tsai, Chia-Chun
    Kuo, Chih-Chia
    Chen, Yen-Lun
    [J]. 2020 IEEE 16TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2020, : 985 - 988
  • [9] 3D Hand Gesture Recognition from One Example
    Sohn, Myoung-Kyu
    Lee, Sang-Heon
    Kim, Dong-Ju
    Kim, Byungmin
    Kim, Hyunduk
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2013, : 171 - 172
  • [10] 3D Hand Gesture Recognition using the Hough Transform
    Oprisescu, Serban
    Barth, Erhardt
    [J]. ADVANCES IN ELECTRICAL AND COMPUTER ENGINEERING, 2013, 13 (03) : 71 - 76