A template matching approach of one-shot-learning gesture recognition

被引:27
|
作者
Mahbub, Upal [1 ]
Imtiaz, Hafiz [1 ]
Roy, Tonmoy [1 ]
Rahman, Md. Shafiur [1 ]
Ahad, Md. Atiqur Rahman [2 ]
机构
[1] Bangladesh Univ Engn & Technol, Dept Elect & Elect Engn, Dhaka 1000, Bangladesh
[2] Univ Dhaka, Dept Appl Phys Elect & Commun Engn, Dhaka, Bangladesh
关键词
Gesture recognition; Depth image; Motion history image; 2D Fourier transform; MOTION; SEGMENTATION;
D O I
10.1016/j.patrec.2012.09.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a novel approach for gesture recognition from motion depth images based on template matching. Gestures can be represented with image templates, which in turn can be used to compare and match gestures. The proposed method uses a single example of an action as a query to find similar matches and thus termed one-shot-learning gesture recognition. It does not require prior knowledge about actions, foreground/background segmentation, or any motion estimation or tracking. The proposed method makes a novel approach to separate different gestures from a single video. Moreover, this method is based on the computation of space-time descriptors from the query video which measures the likeness of a gesture in a lexicon. These descriptor extraction methods include the standard deviation of the depth images of a gesture as well as the motion history image. Furthermore, two dimensional discrete Fourier transform is employed to reduce the effect of camera shift. The comparison is done based on correlation coefficient of the image templates and an intelligent classifier is proposed to ensure better recognition accuracy. Extensive experimentation is done on a very complicated and diversified dataset to establish the effectiveness of employing the proposed methods. (C) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:1780 / 1788
页数:9
相关论文
共 50 条
  • [41] One-shot learning gesture recognition based on joint training of 3D ResNet and memory module
    Li, Lianwei
    Qin, Shiyin
    Lu, Zhi
    Xu, Kuanhong
    Hu, Zhongying
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (9-10) : 6727 - 6757
  • [42] Explore Efficient Local Features from RGB-D Data for One-Shot Learning Gesture Recognition
    Wan, Jun
    Guo, Guodong
    Li, Stan Z.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (08) : 1626 - 1639
  • [43] One-shot learning hand gesture recognition based on modified 3d convolutional neural networks
    Zhi Lu
    Shiyin Qin
    Xiaojie Li
    Lianwei Li
    Dinghao Zhang
    Machine Vision and Applications, 2019, 30 : 1157 - 1180
  • [44] FEW-SHOT LEARNING FOR DECODING SURFACE ELECTROMYOGRAPHY FOR HAND GESTURE RECOGNITION
    Rahimian, Elahe
    Zabihi, Soheil
    Asif, Amir
    Atashzar, S. Farokh
    Mohammadi, Arash
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1300 - 1304
  • [45] One-shot learning based on improved matching network
    Jiang L.
    Zhou X.
    Jiang F.
    Che L.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2019, 41 (06): : 1210 - 1217
  • [46] One Shot Similarity Metric Learning for Action Recognition
    Kliper-Gross, Orit
    Hassner, Tal
    Wolf, Lior
    SIMILARITY-BASED PATTERN RECOGNITION: FIRST INTERNATIONAL WORKSHOP, SIMBAD 2011, 2011, 7005 : 31 - 45
  • [47] One Shot Similarity Metric Learning for Action Recognition
    Kliper-Gross, Orit
    Hassner, Tal
    Wolf, Lior
    SIMILARITY-BASED PATTERN RECOGNITION, 2011, 7005 : 31 - +
  • [48] FEATURE LEARNING FOR ONE-SHOT FACE RECOGNITION
    Wang, Lingxiao
    Li, Yali
    Wang, Shengjin
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 2386 - 2390
  • [49] Self-Supervised Approach for Few-shot Hand Gesture Recognition
    Kimura, Naoki
    ADJUNCT PROCEEDINGS OF THE 35TH ACM SYMPOSIUM ON USER INTERFACE SOFTWARE & TECHNOLOGY, UIST 2022, 2022,
  • [50] Gesture recognition approach based on learning sparse representation
    Xiao, L., 1600, Editorial Board of Journal on Communications (34):