A novel finger and hand pose estimation technique for real-time hand gesture recognition

被引:94
|
作者
Zhou, Yimin [1 ]
Jiang, Guolai [1 ,2 ]
Lin, Yaorong [2 ]
机构
[1] Chinese Acad Sci, Shenzhen Inst Adv Technol, Beijing 100864, Peoples R China
[2] S China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510641, Guangdong, Peoples R China
关键词
Computer vision; Finger modelling; Salient hand edge; Convolution operator; Real-time hand gesture recognition; POSTURE RECOGNITION; TRACKING;
D O I
10.1016/j.patcog.2015.07.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a high-level hand feature extraction method for real-time gesture recognition. Firstly, the fingers are modelled as cylindrical objects due to their parallel edge feature. Then a novel algorithm is proposed to directly extract fingers from salient hand edges. Considering the hand geometrical characteristics, the hand posture is segmented and described based on the finger positions, palm center location and wrist position. A weighted radial projection algorithm with the origin at the wrist position is applied to localize each finger. The developed system can not only extract extensional fingers but also flexional fingers with high accuracy. Furthermore, hand rotation and finger angle variation have no effect on the algorithm performance. The orientation of the gesture can be calculated without the aid of arm direction and it would not be disturbed by the bare arm area. Experiments have been performed to demonstrate that the proposed method can directly extract high-level hand feature and estimate hand poses in real-time. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:102 / 114
页数:13
相关论文
共 50 条
  • [1] Real-Time Hand Gesture Recognition Using Finger Segmentation
    Chen, Zhi-hua
    Kim, Jung-Tae
    Liang, Jianning
    Zhang, Jing
    Yuan, Yu-Bo
    [J]. SCIENTIFIC WORLD JOURNAL, 2014,
  • [2] NUI framework based on real-time head pose estimation and hand gesture recognition
    Kim, Hyunduk
    Lee, Sang-Heon
    Sohn, Myoung-Kyu
    [J]. 2016 8TH INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING (ICCAE 2016), 2016, 56
  • [3] A Real-Time Hand Pose Recognition Method with Hidden Finger Prediction
    Na, Min-Young
    Kim, Tae-Young
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2013, E96D (09): : 2170 - 2173
  • [4] Real-Time Hand Gesture Recognition for Robot Hand Interface
    Lv, Xiaomeng
    Xu, Yulin
    Wang, Ming
    [J]. LIFE SYSTEM MODELING AND SIMULATION, 2014, 461 : 209 - 214
  • [5] A Real-time Hand Gesture Recognition Method
    Zhao, Yafei
    Wang, Weidong
    Wang, Yuehai
    [J]. 2011 INTERNATIONAL CONFERENCE ON ELECTRONICS, COMMUNICATIONS AND CONTROL (ICECC), 2011, : 2475 - 2478
  • [6] Real-Time Dynamic Hand Gesture Recognition
    Lai, Hsiang-Yueh.
    Lai, Han-Jheng.
    [J]. 2014 INTERNATIONAL SYMPOSIUM ON COMPUTER, CONSUMER AND CONTROL (IS3C 2014), 2014, : 658 - 661
  • [7] A real-time hand gesture recognition method
    Fang, Yikai
    Wang, Kongqiao
    Cheng, Jian
    Lu, Hanqing
    [J]. 2007 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-5, 2007, : 995 - +
  • [8] Real-time hand gesture recognition in FPGA
    Raheja, Jagdish Lal
    Subramaniyam, Shriram
    Chaudhary, Ankit
    [J]. OPTIK, 2016, 127 (20): : 9719 - 9726
  • [9] Real-time Hand Gesture Recognition System and Application
    Lai, Hsiang-Yueh
    Ke, Hao-Yuan
    Hsu, Yu-Chun
    [J]. SENSORS AND MATERIALS, 2018, 30 (04) : 869 - 884
  • [10] Real-Time Hand Gesture Recognition Based on Vision
    Ren, Yu
    Gu, Chengcheng
    [J]. ENTERTAINMENT FOR EDUCATION: DIGITAL TECHNIQUES AND SYSTEMS, 2010, 6249 : 468 - 475