A hand gesture recognition technique for human-computer interaction

被引:62
|
作者
Kiliboz, Nurettin Cagri [1 ]
Gudukbay, Ugur [1 ]
机构
[1] Bilkent Univ, Dept Comp Engn, TR-06800 Ankara, Turkey
关键词
Dynamic gesture recognition; Hand gesture; Finite state machine-based recognition; Gestural interfaces; Gesture-based interaction; Human-computer interaction; Intuitive interfaces; Hand trajectory recognition; Adaptive gestures;
D O I
10.1016/j.jvcir.2015.01.015
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose an approach to recognize trajectory-based dynamic hand gestures in real time for human-computer interaction (HCI). We also introduce a fast learning mechanism that does not require extensive training data to teach gestures to the system. We use a six-degrees-of-freedom position tracker to collect trajectory data and represent gestures as an ordered sequence of directional movements in 2D. In the learning phase, sample gesture data is filtered and processed to create gesture recognizers, which are basically finite-state machine sequence recognizers. We achieve online gesture recognition by these recognizers without needing to specify gesture start and end positions. The results of the conducted user study show that the proposed method is very promising in terms of gesture detection and recognition performance (73% accuracy) in a stream of motion. Additionally, the assessment of the user attitude survey denotes that the gestural interface is very useful and satisfactory. One of the novel parts of the proposed approach is that it gives users the freedom to create gesture commands according to their preferences for selected tasks. Thus, the presented gesture recognition approach makes the HCI process more intuitive and user specific. (C) 2015 Elsevier Inc. All rights reserved.
引用
收藏
页码:97 / 104
页数:8
相关论文
共 50 条
  • [1] Recognition of hand gesture to human-computer interaction
    Lee, LK
    Kim, S
    Choi, YK
    Lee, MH
    [J]. IECON 2000: 26TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, VOLS 1-4: 21ST CENTURY TECHNOLOGIES AND INDUSTRIAL OPPORTUNITIES, 2000, : 2117 - 2122
  • [2] Face and hand gesture recognition for human-computer interaction
    Hongo, H
    Ohya, M
    Yasumoto, M
    Yamamoto, K
    [J]. 15TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 2, PROCEEDINGS: PATTERN RECOGNITION AND NEURAL NETWORKS, 2000, : 921 - 924
  • [3] Design of hand gesture recognition system for human-computer interaction
    Tsai, Tsung-Han
    Huang, Chih-Chi
    Zhang, Kung-Long
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (9-10) : 5989 - 6007
  • [4] A visual system for hand gesture recognition in human-computer interaction
    Okkonen, Matti-Antero
    Kellokumpu, Vili
    Pietikainen, Matti
    Heikkilae, Janne
    [J]. IMAGE ANALYSIS, PROCEEDINGS, 2007, 4522 : 709 - +
  • [5] THE METHOD FOR HUMAN-COMPUTER INTERACTION BASED ON HAND GESTURE RECOGNITION
    Raudonis, Vidas
    Jonaitis, Domas
    [J]. PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON ELECTRICAL AND CONTROL TECHNOLOGIES, 2013, : 45 - 49
  • [6] Design of hand gesture recognition system for human-computer interaction
    Tsung-Han Tsai
    Chih-Chi Huang
    Kung-Long Zhang
    [J]. Multimedia Tools and Applications, 2020, 79 : 5989 - 6007
  • [7] Continuous Body and Hand Gesture Recognition for Natural Human-Computer Interaction
    Song, Yale
    Demirdjian, David
    Davis, Randall
    [J]. ACM TRANSACTIONS ON INTERACTIVE INTELLIGENT SYSTEMS, 2012, 2 (01) : 1 - 28
  • [8] Continuous Body and Hand Gesture Recognition for Natural Human-Computer Interaction
    Song, Yale
    Davis, Randall
    [J]. PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), 2015, : 4212 - 4216
  • [9] Human-Computer Interaction with Hand Gesture Recognition Using ResNet and MobileNet
    Alnuaim, Abeer
    Zakariah, Mohammed
    Hatamleh, Wesam Atef
    Tarazi, Hussam
    Tripathi, Vikas
    Amoatey, Enoch Tetteh
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [10] Dynamic gesture recognition and human-computer interaction
    Zhang, Jiali
    Liu, Guixi
    [J]. PROCEEDINGS OF THE 2015 INTERNATIONAL INDUSTRIAL INFORMATICS AND COMPUTER ENGINEERING CONFERENCE, 2015, : 1836 - 1839