A template matching approach of one-shot-learning gesture recognition

被引:27
|
作者
Mahbub, Upal [1 ]
Imtiaz, Hafiz [1 ]
Roy, Tonmoy [1 ]
Rahman, Md. Shafiur [1 ]
Ahad, Md. Atiqur Rahman [2 ]
机构
[1] Bangladesh Univ Engn & Technol, Dept Elect & Elect Engn, Dhaka 1000, Bangladesh
[2] Univ Dhaka, Dept Appl Phys Elect & Commun Engn, Dhaka, Bangladesh
关键词
Gesture recognition; Depth image; Motion history image; 2D Fourier transform; MOTION; SEGMENTATION;
D O I
10.1016/j.patrec.2012.09.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a novel approach for gesture recognition from motion depth images based on template matching. Gestures can be represented with image templates, which in turn can be used to compare and match gestures. The proposed method uses a single example of an action as a query to find similar matches and thus termed one-shot-learning gesture recognition. It does not require prior knowledge about actions, foreground/background segmentation, or any motion estimation or tracking. The proposed method makes a novel approach to separate different gestures from a single video. Moreover, this method is based on the computation of space-time descriptors from the query video which measures the likeness of a gesture in a lexicon. These descriptor extraction methods include the standard deviation of the depth images of a gesture as well as the motion history image. Furthermore, two dimensional discrete Fourier transform is employed to reduce the effect of camera shift. The comparison is done based on correlation coefficient of the image templates and an intelligent classifier is proposed to ensure better recognition accuracy. Extensive experimentation is done on a very complicated and diversified dataset to establish the effectiveness of employing the proposed methods. (C) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:1780 / 1788
页数:9
相关论文
共 50 条
  • [31] One-shot learning gesture recognition from RGB-D data using bag of features
    Wan, Jun
    Ruan, Qiuqi
    Li, Wei
    Deng, Shuang
    Journal of Machine Learning Research, 2013, 14 : 2549 - 2582
  • [32] Improvement of One-Shot-Learning by Integrating a Convolutional Neural Network and an Image Descriptor into a Siamese Neural Network
    Duque Domingo, Jaime
    Medina Aparicio, Roberto
    Gonzalez Rodrigo, Luis Miguel
    APPLIED SCIENCES-BASEL, 2021, 11 (17):
  • [33] A Hand Gesture Recognition Method Based on Multi-Feature Fusion and Template Matching
    Liu Yun
    Zhang Lifeng
    Zhang Shujun
    2012 INTERNATIONAL WORKSHOP ON INFORMATION AND ELECTRONICS ENGINEERING, 2012, 29 : 1678 - 1684
  • [34] Skeleton-Based Dynamic Hand Gesture Recognition Using an Enhanced Network with One-Shot Learning
    Ma, Chunyong
    Zhang, Shengsheng
    Wang, Anni
    Qi, Yongyang
    Chen, Ge
    APPLIED SCIENCES-BASEL, 2020, 10 (11):
  • [35] Coherence in One-Shot Gesture Recognition for Human-Robot Interaction
    Cabrera, Maria E.
    Voyles, Richard M.
    Wachs, Juan P.
    COMPANION OF THE 2018 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION (HRI'18), 2018, : 75 - 76
  • [36] Gesture sequence recognition with one shot learned CRF/HMM hybrid model
    Belgacem, Selma
    Chatelain, Clement
    Paquet, Thierry
    IMAGE AND VISION COMPUTING, 2017, 61 : 12 - 21
  • [37] Adaptive Local Spatiotemporal Features from RGB-D Data for One-Shot Learning Gesture Recognition
    Lin, Jia
    Ruan, Xiaogang
    Yu, Naigong
    Yang, Yee-Hong
    SENSORS, 2016, 16 (12)
  • [38] Post-stroke hand gesture recognition via one-shot transfer learning using prototypical networks
    Sarwat, Hussein
    Alkhashab, Amr
    Song, Xinyu
    Jiang, Shuo
    Jia, Jie
    Shull, Peter B.
    JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2024, 21 (01)
  • [39] One-shot learning gesture recognition based on joint training of 3D ResNet and memory module
    Lianwei Li
    Shiyin Qin
    Zhi Lu
    Kuanhong Xu
    Zhongying Hu
    Multimedia Tools and Applications, 2020, 79 : 6727 - 6757
  • [40] One-shot learning hand gesture recognition based on modified 3d convolutional neural networks
    Lu, Zhi
    Qin, Shiyin
    Li, Xiaojie
    Li, Lianwei
    Zhang, Dinghao
    MACHINE VISION AND APPLICATIONS, 2019, 30 (7-8) : 1157 - 1180