A New Approach For Hand Gestures Recognition Based on Depth Map Captured by RGB-D Camera

被引:0
|
作者
Ben Jmaa, Ahmed [1 ]
Mahdi, Walid [1 ]
Ben Jemaa, Yousra [2 ]
Ben Hamadou, Abdelmajid [1 ]
机构
[1] Multimedia Informat Syst & Adv Comp Lab, Sfax, Tunisia
[2] Signal & Syst Res Unit, Tunis, Tunisia
来源
COMPUTACION Y SISTEMAS | 2016年 / 20卷 / 04期
关键词
Sign Language (SL); Kinect camera; Depth sensor; Hand gesture recognition;
D O I
10.13053/CyS-20-4-2390
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper introduces a new approach for hand gesture recognition based on depth Map captured by an RGB-D Kinect camera. Although this camera provides two types of information "Depth Map" and "RGB Image", only the depth data information is used to analyze and recognize the hand gestures. Given the complexity of this task, a new method based on edge detection is proposed to eliminate the noise and segment the hand. Moreover, new descriptors are introduce to model the hand gesture. These features are invariant to scale, rotation and translation. Our approach is applied on French sign language alphabet to show its effectiveness and evaluate the robustness of the proposed descriptors. The experimental results clearly show that the proposed system is very satisfactory as it to recognizes the French alphabet sign with an accuracy of more than 93%. Our approach is also applied to a public dataset in order to be compared in the existing studies. The results prove that our system can outperform previous methods using the same dataset.
引用
收藏
页码:709 / 721
页数:13
相关论文
共 50 条
  • [1] Sparse Representation Based Approach for RGB-D Hand Gesture Recognition
    Su, Te-Feng
    Fan, Chin-Yun
    Lin, Meng-Hsuan
    Lai, Shang-Hong
    [J]. ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2015, PT II, 2015, 9315 : 564 - 570
  • [2] DEPTH MAP ENHANCEMENT ON RGB-D VIDEO CAPTURED BY KINECT V2
    Lin, Ke-Yu
    Hang, Hsueh-Ming
    [J]. 2018 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2018, : 1530 - 1535
  • [3] A RGB-D Face Recognition Approach without Confronting the Camera
    Zhou, Wei
    Chen, Jian-xin
    Wang, Lei
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC), 2015, : 109 - 114
  • [4] Hand Position Tracking Using a Depth Image from a RGB-d Camera
    Marino Lizarazo, Daniel Leonardo
    Tumialan Borja, Jose Antonio
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), 2015, : 1680 - 1687
  • [5] A New Fall Detection Algorithm based on Depth Information using RGB-D Camera
    Sun, Chi-Chia
    Sheu, Ming-Hwa
    Syu, Yu-Cheng
    [J]. 2017 INTERNATIONAL SYMPOSIUM ON INTELLIGENT SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ISPACS 2017), 2017, : 413 - 416
  • [6] 3D Hand Posture Tracking with Depth Gradient Estimation on a RGB-D Camera
    Lin, Jan-Cheng
    Huang, Cheng-Ming
    [J]. 2013 IEEE 17TH INTERNATIONAL SYMPOSIUM ON CONSUMER ELECTRONICS (ISCE), 2013, : 109 - 110
  • [7] Depth Map Super-Resolution for Cost-Effective RGB-D Camera
    Takaoka, Ryotaro
    Hashimoto, Naoki
    [J]. 2015 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW), 2015, : 133 - 136
  • [8] Static Gesture Recognition Based on RGB-D Depth Information
    Wang, Yi
    Dong, Xiucheng
    Li, Changlong
    Yu, Ximu
    [J]. ADVANCES IN COMPUTERS, ELECTRONICS AND MECHATRONICS, 2014, 667 : 248 - +
  • [9] Depth camera based dataset of hand gestures
    Jeeru, Sindhusha
    Sivapuram, Arun Kumar
    Leon, David Gonzalez
    Groli, Jade
    Yeduri, Sreenivasa Reddy
    Cenkeramaddi, Linga Reddy
    [J]. DATA IN BRIEF, 2022, 45
  • [10] Shape Preserving RGB-D Depth Map Restoration
    Liu, Wei
    Xue, Haoyang
    Gu, Yun
    Yang, Jie
    Wu, Qiang
    Jia, Zhenhong
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2014, PT III, 2014, 8836 : 150 - 158