Gesture recognition based on BoF and its application in human-machine interaction of service robot

被引:0
|
作者
Wang, Fei [1 ]
Zhou, Lei [1 ]
Cui, Ziqiang [1 ]
Li, Haolai [1 ]
Li, Mingchao [1 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110918, Peoples R China
关键词
SURF; BoF; Visual; Dictionary; Human-computer Interaction; Gesture Contril;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The algorithm is applied to the field of hand gesture recognition by Referencing the Bag of Feature (BoF) algorithm in the field of target recognition and image retrieval. First of all, this paper uses the HSV skin color adaptive method to segment the gesture's information from body and uses SURF algorithm to extract the feature of the image. After feature extraction, it uses BoF algorithm to generate the SURF feature visual histogram and mapping to the visual dictionary to generate a unified BOF vector. Then use SVM to train and classify the vector to identify 26 English gestures. This paper selects six gestures as a service robot control commands, which achieve the goal of gesture information control robot. Experimental results show that the BoF algorithm not only has a high time efficiency and accuracy, and meets the real-time performance. The algorithm can achieve real-time control of the robot to stop, start, forward, backward, turn left, turn right, and the accuracy rate is above 90%.
引用
下载
收藏
页码:115 / 120
页数:6
相关论文
共 50 条
  • [1] Gesture labeling based on gaze direction recognition for human-machine interaction
    Wang, Y
    Yuan, JH
    Chang, SJ
    Zhang, YX
    OPTICAL ENGINEERING, 2002, 41 (08) : 1840 - 1844
  • [2] Automatic Gesture Recognition for Human-Machine Interaction: An Overview
    Nataliia, Konkina
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2022, 22 (01): : 129 - 138
  • [3] Visual gesture recognition for human-machine interface of robot teleoperation
    Hu, C
    Meng, MQ
    Liu, PXP
    Wang, X
    IROS 2003: PROCEEDINGS OF THE 2003 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-4, 2003, : 1560 - 1565
  • [4] Wavelet-Based Gesture Recognition Method for Human-Machine Interaction in Aviation
    Zeybek, Tugba
    Sakarya, Ufuk
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2023, 109 (02)
  • [5] Wavelet-Based Gesture Recognition Method for Human-Machine Interaction in Aviation
    Tuğba Zeybek
    Ufuk Sakarya
    Journal of Intelligent & Robotic Systems, 2023, 109
  • [6] Human-Machine Interaction Sensing Technology Based on Hand Gesture Recognition: A Review
    Guo, Lin
    Lu, Zongxing
    Yao, Ligang
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2021, 51 (04) : 300 - 309
  • [7] A Prototype System for Secure Human-Machine Interaction Based on Face and Gesture Recognition
    Khan, I. R.
    Miyamoto, H.
    Morie, T.
    Shimazu, M.
    Kuriya, Y.
    IECON 2008: 34TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, VOLS 1-5, PROCEEDINGS, 2008, : 1513 - 1518
  • [8] Vision based dynamic gesture recognition and its application in human-humanoid robot interaction
    Liu, Jiang-Hua
    Cheng, Jun-Shi
    Chen, Jia-Pin
    Jiqiren/Robot, 2002, 24 (03):
  • [9] How to Achieve Human-Machine Interaction by Foot Gesture Recognition: A Review
    Yue, Lian
    Lu Zongxing
    Hui, Dong
    Chao, Jia
    Liu Ziqiang
    Liu Zhoujie
    IEEE SENSORS JOURNAL, 2023, 23 (15) : 16515 - 16528
  • [10] Robust Implementation of Hand Gesture Recognition for Remote Human-Machine Interaction
    Dulayatrakul, Jakkrit
    Prasertsakul, Pawin
    Kondo, Toshiaki
    Nilkhamhang, Itthisek
    2015 7TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND ELECTRICAL ENGINEERING (ICITEE), 2015, : 247 - 252