A template matching approach of one-shot-learning gesture recognition

被引:27
|
作者
Mahbub, Upal [1 ]
Imtiaz, Hafiz [1 ]
Roy, Tonmoy [1 ]
Rahman, Md. Shafiur [1 ]
Ahad, Md. Atiqur Rahman [2 ]
机构
[1] Bangladesh Univ Engn & Technol, Dept Elect & Elect Engn, Dhaka 1000, Bangladesh
[2] Univ Dhaka, Dept Appl Phys Elect & Commun Engn, Dhaka, Bangladesh
关键词
Gesture recognition; Depth image; Motion history image; 2D Fourier transform; MOTION; SEGMENTATION;
D O I
10.1016/j.patrec.2012.09.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a novel approach for gesture recognition from motion depth images based on template matching. Gestures can be represented with image templates, which in turn can be used to compare and match gestures. The proposed method uses a single example of an action as a query to find similar matches and thus termed one-shot-learning gesture recognition. It does not require prior knowledge about actions, foreground/background segmentation, or any motion estimation or tracking. The proposed method makes a novel approach to separate different gestures from a single video. Moreover, this method is based on the computation of space-time descriptors from the query video which measures the likeness of a gesture in a lexicon. These descriptor extraction methods include the standard deviation of the depth images of a gesture as well as the motion history image. Furthermore, two dimensional discrete Fourier transform is employed to reduce the effect of camera shift. The comparison is done based on correlation coefficient of the image templates and an intelligent classifier is proposed to ensure better recognition accuracy. Extensive experimentation is done on a very complicated and diversified dataset to establish the effectiveness of employing the proposed methods. (C) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:1780 / 1788
页数:9
相关论文
共 50 条
  • [21] Principal motion components for one-shot gesture recognition
    Hugo Jair Escalante
    Isabelle Guyon
    Vassilis Athitsos
    Pat Jangyodsuk
    Jun Wan
    Pattern Analysis and Applications, 2017, 20 : 167 - 182
  • [22] A Semantical & Analytical Approach for Zero Shot Gesture Learning
    Madapana, Naveen
    Wachs, Juan P.
    2017 12TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2017), 2017, : 796 - 801
  • [23] A Pattern Recognition Approach of Japanese Text Recognition for Template Matching
    Das, Soumendu
    Banerjee, Sreeparna
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, 2013, 174 : 1083 - 1089
  • [24] A Reinforcement One-Shot Active Learning Approach for Aircraft Type Recognition
    Huang, Honglan
    Feng, Yanghe
    Huang, Jincai
    Zhang, Jiarui
    Chen, Li
    IEEE ACCESS, 2019, 7 : 147204 - 147214
  • [25] Radar-Based Face Recognition: One-Shot Learning Approach
    Ha-Anh Pho
    Lee, Seongwook
    Vo-Nguyen Tuyet-Doan
    Kim, Yong-Hwa
    IEEE SENSORS JOURNAL, 2021, 21 (05) : 6335 - 6341
  • [26] Template Matching Approach for Printed Kannada Numeral Recognition
    Hegadi, Ravindra S.
    COMPUTATIONAL INTELLIGENCE AND INFORMATION TECHNOLOGY, 2011, 250 : 648 - 651
  • [27] Memory Matching Networks for One-Shot Image Recognition
    Cai, Qi
    Pan, Yingwei
    Yao, Ting
    Yan, Chenggang
    Mei, Tao
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 4080 - 4088
  • [28] Continuous Gesture Sequences Recognition Based on Few-Shot Learning
    Liu, Zhe
    Pan, Cao
    Wang, Hongyuan
    INTERNATIONAL JOURNAL OF AEROSPACE ENGINEERING, 2022, 2022
  • [29] One-shot Learning Gesture Recognition from RGB-D Data Using Bag of Features
    Wan, Jun
    Ruan, Qiuqi
    Li, Wei
    Deng, Shuang
    JOURNAL OF MACHINE LEARNING RESEARCH, 2013, 14 : 2549 - 2582
  • [30] Dynamic spectrum matching with one-shot learning
    Liu, Jinchao
    Gibson, Stuart J.
    Mills, James
    Osadchy, Margarita
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2019, 184 (175-181) : 175 - 181