Depth-based hand gesture recognition

被引:14
|
作者
Wu, Chih-Hung [1 ]
Chen, Wei-Lun [1 ]
Lin, Chang Hong [1 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Elect & Comp Engn, Taipei, Taiwan
关键词
Depth cameras; Static hand posture recognition; Dynamic hand gesture recognition; Support vector machine;
D O I
10.1007/s11042-015-2632-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, a dynamic gesture recognition system with the depth information is proposed. The proposed system consists of three main components: preprocessing, static posture recognition and dynamic gesture recognition. In the first component, the background subtraction is used to exclude invalid gestures that is not generated by the main user, and then to detect and track the hand. Second, the region of hand is extracted using an adaptive square. Once the region of hand is obtained, the features of hand are extracted and the static hand posture are classified using the support vector machine (SVM). Finally, nine commonly used dynamic hand gestures can be detected using different methods. In the experiments, the static hand posture classification was evaluated in different postures and the performance of dynamic gesture recognition is verified by two different persons at 4 different position with 2 different depths. The experiment results show that the proposed system can accurately detect the dynamic hand gestures with an average recognition rate of 87.6 %, which is good for controlling the embedded systems, such as home appliances.
引用
收藏
页码:7065 / 7086
页数:22
相关论文
共 50 条
  • [1] Depth-based hand gesture recognition
    Chih-Hung Wu
    Wei-Lun Chen
    Chang Hong Lin
    [J]. Multimedia Tools and Applications, 2016, 75 : 7065 - 7086
  • [2] Depth-based Hand Gesture Recognition Using Hand Movements And Defects
    Chen, Wei-Lun
    Wu, Chih-Hung
    Lin, Chang Hong
    [J]. 2015 INTERNATIONAL SYMPOSIUM ON NEXT-GENERATION ELECTRONICS (ISNE), 2015,
  • [3] Combining multiple depth-based descriptors for hand gesture recognition
    Dominio, Fabio
    Donadeo, Mauro
    Zanuttigh, Pietro
    [J]. PATTERN RECOGNITION LETTERS, 2014, 50 : 101 - 111
  • [4] Depth-based hand gesture recognition for home appliance control
    Wu, Chih-Hung
    Lin, Chang Hong
    [J]. 2013 IEEE 17TH INTERNATIONAL SYMPOSIUM ON CONSUMER ELECTRONICS (ISCE), 2013, : 279 - 280
  • [5] Depth-based Hand Gesture Recognition using Convolutional Neural Networks
    Pyo, Jeongwon
    Ji, Sanghoon
    You, Sujeong
    Kuc, Taeyoung
    [J]. 2016 13TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS AND AMBIENT INTELLIGENCE (URAI), 2016, : 225 - 227
  • [6] A Combined Method of Skin-and Depth-based Hand Gesture Recognition
    Sokhib, Tukhtaev
    Whangbo, Taeg Keun
    [J]. INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY, 2020, 17 (01) : 137 - 145
  • [7] Gesture Recognition using Depth-based Hand Tracking for Contactless Controller Application
    Yang, Cheoljong
    Jang, Yujeong
    Beh, Jounghoon
    Han, David
    Ko, Hanseok
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2012, : 297 - +
  • [8] Fusing shape and spatio-temporal features for depth-based dynamic hand gesture recognition
    Zheng, Jinqing
    Feng, Zhiyong
    Xu, Chao
    Hu, Jing
    Ge, Weimin
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (20) : 20525 - 20544
  • [9] Fused features mining for depth-based hand gesture recognition to classify blind human communication
    Saba Jadooki
    Dzulkifli Mohamad
    Tanzila Saba
    Abdulaziz S. Almazyad
    Amjad Rehman
    [J]. Neural Computing and Applications, 2017, 28 : 3285 - 3294
  • [10] Fused features mining for depth-based hand gesture recognition to classify blind human communication
    Jadooki, Saba
    Mohamad, Dzulkifli
    Saba, Tanzila
    Almazyad, Abdulaziz S.
    Rehman, Amjad
    [J]. NEURAL COMPUTING & APPLICATIONS, 2017, 28 (11): : 3285 - 3294