A hand gesture recognition technique for human-computer interaction

被引:62
|
作者
Kiliboz, Nurettin Cagri [1 ]
Gudukbay, Ugur [1 ]
机构
[1] Bilkent Univ, Dept Comp Engn, TR-06800 Ankara, Turkey
关键词
Dynamic gesture recognition; Hand gesture; Finite state machine-based recognition; Gestural interfaces; Gesture-based interaction; Human-computer interaction; Intuitive interfaces; Hand trajectory recognition; Adaptive gestures;
D O I
10.1016/j.jvcir.2015.01.015
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose an approach to recognize trajectory-based dynamic hand gestures in real time for human-computer interaction (HCI). We also introduce a fast learning mechanism that does not require extensive training data to teach gestures to the system. We use a six-degrees-of-freedom position tracker to collect trajectory data and represent gestures as an ordered sequence of directional movements in 2D. In the learning phase, sample gesture data is filtered and processed to create gesture recognizers, which are basically finite-state machine sequence recognizers. We achieve online gesture recognition by these recognizers without needing to specify gesture start and end positions. The results of the conducted user study show that the proposed method is very promising in terms of gesture detection and recognition performance (73% accuracy) in a stream of motion. Additionally, the assessment of the user attitude survey denotes that the gestural interface is very useful and satisfactory. One of the novel parts of the proposed approach is that it gives users the freedom to create gesture commands according to their preferences for selected tasks. Thus, the presented gesture recognition approach makes the HCI process more intuitive and user specific. (C) 2015 Elsevier Inc. All rights reserved.
引用
收藏
页码:97 / 104
页数:8
相关论文
共 50 条
  • [21] Dynamic hand gesture recognition using vision-based approach for human-computer interaction
    Singha, Joyeeta
    Roy, Amarjit
    Laskar, Rabul Hussain
    [J]. NEURAL COMPUTING & APPLICATIONS, 2018, 29 (04): : 1129 - 1141
  • [22] Hand Gesture Recognition based on Motion History Images for a Simple Human-Computer Interaction System
    Timotius, Ivanna K.
    Setyawan, Iwan
    [J]. INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2012), 2013, 8768
  • [23] Gesture recognition for human-computer interaction using neural networks
    Zhang, YX
    Yuan, JG
    [J]. 8TH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING, VOLS 1-3, PROCEEDING, 2001, : 735 - 740
  • [24] A Low-Cost Hand Gesture Human-Computer Interaction System
    Liu, Leyuan
    Sang, Nong
    Yang, Saiyong
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2012, : 299 - 300
  • [25] Robust Hand Gesture Recognition Based on RGB-D Data for Natural Human-Computer Interaction
    Xu, Jun
    Wang, Hanchen
    Zhang, Jianrong
    Cai, Linqin
    [J]. IEEE ACCESS, 2022, 10 : 54549 - 54562
  • [26] Dynamic hand gesture recognition using RGB-D data for natural human-computer interaction
    Cai Linqin
    Cui Shuangjie
    Xiang Min
    Yu Jimin
    Zhang Jianrong
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2017, 32 (05) : 3495 - 3507
  • [27] Non-trajectory-based gesture recognition in human-computer interaction based on hand skeleton data
    Lesong Jia
    Xiaozhou Zhou
    Chengqi Xue
    [J]. Multimedia Tools and Applications, 2022, 81 : 20509 - 20539
  • [28] Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware
    Yeo, Hui-Shyong
    Lee, Byung-Gook
    Lim, Hyotaek
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (08) : 2687 - 2715
  • [29] Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware
    Hui-Shyong Yeo
    Byung-Gook Lee
    Hyotaek Lim
    [J]. Multimedia Tools and Applications, 2015, 74 : 2687 - 2715
  • [30] Vision-based Hand Gesture Recognition for Human-Computer Interaction using MobileNetV2
    Baumgartl, Hermann
    Sauter, Daniel
    Schenk, Christian
    Atik, Cem
    Buettner, Ricardo
    [J]. 2021 IEEE 45TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE (COMPSAC 2021), 2021, : 1667 - 1674