Real-Time Human Pose Estimation and Gesture Recognition from Depth Images Using Superpixels and SVM Classifier

被引:27
|
作者
Kim, Hanguen [1 ]
Lee, Sangwon [1 ]
Lee, Dongsung [2 ]
Choi, Soonmin [2 ]
Ju, Jinsun [2 ]
Myung, Hyun [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Dept Civil & Environm Engn, Urban Robot Lab, Taejon 305338, South Korea
[2] Samsung S1 Cooperat, Image & Video Res Grp, Seoul 100773, South Korea
关键词
human pose estimation; gesture recognition; depth information; low-cost platform; TRACKING;
D O I
10.3390/s150612410
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In this paper, we present human pose estimation and gesture recognition algorithms that use only depth information. The proposed methods are designed to be operated with only a CPU (central processing unit), so that the algorithm can be operated on a low-cost platform, such as an embedded board. The human pose estimation method is based on an SVM (support vector machine) and superpixels without prior knowledge of a human body model. In the gesture recognition method, gestures are recognized from the pose information of a human body. To recognize gestures regardless of motion speed, the proposed method utilizes the keyframe extraction method. Gesture recognition is performed by comparing input keyframes with keyframes in registered gestures. The gesture yielding the smallest comparison error is chosen as a recognized gesture. To prevent recognition of gestures when a person performs a gesture that is not registered, we derive the maximum allowable comparison errors by comparing each registered gesture with the other gestures. We evaluated our method using a dataset that we generated. The experiment results show that our method performs fairly well and is applicable in real environments.
引用
收藏
页码:12410 / 12427
页数:18
相关论文
共 50 条
  • [1] Real-Time Human Pose Recognition in Parts from Single Depth Images
    Shotton, Jamie
    Fitzgibbon, Andrew
    Cook, Mat
    Sharp, Toby
    Finocchio, Mark
    Moore, Richard
    Kipman, Alex
    Blake, Andrew
    [J]. 2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, : 1297 - 1304
  • [2] Real-Time Human Pose Recognition in Parts from Single Depth Images
    Shotton, Jamie
    Sharp, Toby
    Kipman, Alex
    Fitzgibbon, Andrew
    Finocchio, Mark
    Blake, Andrew
    Cook, Mat
    Moore, Richard
    [J]. COMMUNICATIONS OF THE ACM, 2013, 56 (01) : 116 - 124
  • [3] REAL-TIME UPPER BODY POSE ESTIMATION FROM DEPTH IMAGES
    Tsai, Ming-Han
    Chen, Kuan-Hua
    Lin, I-Chen
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 2234 - 2238
  • [4] Real-Time Human Body Pose Estimation for In-Car Depth Images
    Torres, Helena R.
    Oliveira, Bruno
    Fonseca, Jaime
    Queiros, Sandro
    Borges, Joao
    Rodrigues, Nelson
    Coelho, Victor
    Pallauf, Johannes
    Brito, Jose
    Mendes, Jose
    [J]. TECHNOLOGICAL INNOVATION FOR INDUSTRY AND SERVICE SYSTEMS, DOCEIS 2019, 2019, 553 : 169 - 182
  • [5] Real-time Hand Gesture Recognition from Depth Images Using Convex Shape Decomposition Method
    Qin, Shuxin
    Zhu, Xiaoyang
    Yang, Yiping
    Jiang, Yongshi
    [J]. JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2014, 74 (01): : 47 - 58
  • [6] Real-time Hand Gesture Recognition from Depth Images Using Convex Shape Decomposition Method
    Shuxin Qin
    Xiaoyang Zhu
    Yiping Yang
    Yongshi Jiang
    [J]. Journal of Signal Processing Systems, 2014, 74 : 47 - 58
  • [7] Real-time body gesture recognition using depth camera
    Gonzalez-Sanchez, T.
    Puig, D.
    [J]. ELECTRONICS LETTERS, 2011, 47 (12) : 697 - 698
  • [8] Real-time 3D Pose Estimation from Single Depth Images
    Schnuerer, Thomas
    Fuchs, Stefan
    Eisenbach, Markus
    Gross, Horst-Michael
    [J]. PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2019, : 716 - 724
  • [9] Real-time upper-body human pose estimation using a depth camera
    Jain, Himanshu Prakash
    Subramanian, Anbumani
    [J]. HP Laboratories Technical Report, 2010, (190):
  • [10] A novel finger and hand pose estimation technique for real-time hand gesture recognition
    Zhou, Yimin
    Jiang, Guolai
    Lin, Yaorong
    [J]. PATTERN RECOGNITION, 2016, 49 : 102 - 114