A template matching approach of one-shot-learning gesture recognition

被引:27
|
作者
Mahbub, Upal [1 ]
Imtiaz, Hafiz [1 ]
Roy, Tonmoy [1 ]
Rahman, Md. Shafiur [1 ]
Ahad, Md. Atiqur Rahman [2 ]
机构
[1] Bangladesh Univ Engn & Technol, Dept Elect & Elect Engn, Dhaka 1000, Bangladesh
[2] Univ Dhaka, Dept Appl Phys Elect & Commun Engn, Dhaka, Bangladesh
关键词
Gesture recognition; Depth image; Motion history image; 2D Fourier transform; MOTION; SEGMENTATION;
D O I
10.1016/j.patrec.2012.09.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a novel approach for gesture recognition from motion depth images based on template matching. Gestures can be represented with image templates, which in turn can be used to compare and match gestures. The proposed method uses a single example of an action as a query to find similar matches and thus termed one-shot-learning gesture recognition. It does not require prior knowledge about actions, foreground/background segmentation, or any motion estimation or tracking. The proposed method makes a novel approach to separate different gestures from a single video. Moreover, this method is based on the computation of space-time descriptors from the query video which measures the likeness of a gesture in a lexicon. These descriptor extraction methods include the standard deviation of the depth images of a gesture as well as the motion history image. Furthermore, two dimensional discrete Fourier transform is employed to reduce the effect of camera shift. The comparison is done based on correlation coefficient of the image templates and an intelligent classifier is proposed to ensure better recognition accuracy. Extensive experimentation is done on a very complicated and diversified dataset to establish the effectiveness of employing the proposed methods. (C) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:1780 / 1788
页数:9
相关论文
共 50 条
  • [1] One-Shot-Learning Gesture Recognition using HOG-HOF Features
    Konecny, Jakub
    Hagara, Michal
    JOURNAL OF MACHINE LEARNING RESEARCH, 2014, 15 : 2513 - 2532
  • [2] Improved GLOH Approach for One-Shot Learning Human Gesture Recognition
    Karn, Nabin Kumar
    Jiang, Feng
    BIOMETRIC RECOGNITION, 2016, 9967 : 441 - 452
  • [3] Conditional distance based matching for one-shot gesture recognition
    Krishnan, Ravikiran
    Sarkar, Sudeep
    PATTERN RECOGNITION, 2015, 48 (04) : 1302 - 1314
  • [4] IMPROVING THE ROBUSTNESS OF HAND GESTURE RECOGNITION WITH ONE-SHOT-LEARNING FEATURES OF STATIC HOG AND SVM BY USING KINECT V2 METHOD
    Chandrasekhar, S.
    Mhala, N. N.
    PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON INTELLIGENT SUSTAINABLE SYSTEMS (ICISS 2019), 2019, : 15 - 19
  • [5] One-Shot Gesture Recognition: One Step Towards Adaptive Learning
    Cabrera, Maria E.
    Sanchez-Tamayo, Natalia
    Voyles, Richard
    Wachs, Juan P.
    2017 12TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2017), 2017, : 784 - 789
  • [6] WLCSSLearn: Learning Algorithm for Template Matching-based Gesture Recognition Systems
    Ciliberto, Mathias
    Cuspinera, Luis Ponce
    Roggen, Daniel
    2019 JOINT 8TH INTERNATIONAL CONFERENCE ON INFORMATICS, ELECTRONICS & VISION (ICIEV) AND 2019 3RD INTERNATIONAL CONFERENCE ON IMAGING, VISION & PATTERN RECOGNITION (ICIVPR) WITH INTERNATIONAL CONFERENCE ON ACTIVITY AND BEHAVIOR COMPUTING (ABC), 2019, : 91 - 96
  • [7] Tracking Skeletal Fusion Feature for One Shot Learning Gesture Recognition
    Liu Xuejiao
    Su Yongqing
    2017 2ND INTERNATIONAL CONFERENCE ON IMAGE, VISION AND COMPUTING (ICIVC 2017), 2017, : 194 - 200
  • [8] One-Shot-Learning for Visual Lip-Based Biometric Authentication
    Wright, Carrie
    Stewart, Darryl
    ADVANCES IN VISUAL COMPUTING, ISVC 2019, PT I, 2020, 11844 : 405 - 417
  • [9] Database of Gesture Attributes: Zero Shot Learning for Gesture Recognition
    Madapana, Naveen
    Wachs, Juan
    2019 14TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2019), 2019, : 525 - 532
  • [10] Hard Zero Shot Learning For Gesture Recognition
    Madapana, Naveen
    Wachs, Juan P.
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 3574 - 3579