A Dynamic Head Gesture Recognition Method for Real-Time Human-Computer Interaction

被引:0
|
作者
Xie, Jialong [1 ]
Zhang, Botao [1 ]
Chepinskiy, Sergey A. [2 ]
Zhilenkov, Anton A. [3 ]
机构
[1] Hangzhou Dianzi Univ, Sch Automat, Hangzhou, Zhejiang, Peoples R China
[2] ITMO Univ, Fac Control Syst & Robot, St Petersburg, Russia
[3] St Petersburg State Marine Tech Univ, Inst Hydrodynam & Control Proc, St Petersburg, Russia
关键词
Human-computer interaction; Computer vision; Deep learning; Dynamic head gesture recognition;
D O I
10.1007/978-3-030-89134-3_22
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In human-computer interaction, head gestures play a significant role in improving smoothness and naturality. However, existing head gesture recognition algorithms have disadvantages in accuracy and generalization ability. To deal with these problems, this paper addresses a two-stream dynamic head gesture recognition method with the SlowFast pathway called 3DSFI (3D SlowFast Inception). The SlowFast pathway is designed to reduce parameters and computational costs. Meanwhile, its two-stream structure can efficiently capture motion features in videos and dense optical flows. Besides, Inception blocks of InceptionV3 are expanded by the 3D convolutional kernel into space-time and serve as a feature extractor. Finally, 3DSFI is applied to a robot Pepper in order to evaluate realistic performance. Experimental results show that the proposed method has higher accuracy and better generalization performance than the classical C3D (Convolutional 3D) and I3D (Inflated 3D ConvNet) methods.
引用
收藏
页码:235 / 245
页数:11
相关论文
共 50 条
  • [1] Real-Time Continuous Gesture Recognition for Natural Human-Computer Interaction
    Yin, Ying
    Davis, Randall
    [J]. 2014 IEEE SYMPOSIUM ON VISUAL LANGUAGES AND HUMAN-CENTRIC COMPUTING (VL/HCC 2014), 2014, : 113 - 120
  • [2] Dynamic gesture recognition and human-computer interaction
    Zhang, Jiali
    Liu, Guixi
    [J]. PROCEEDINGS OF THE 2015 INTERNATIONAL INDUSTRIAL INFORMATICS AND COMPUTER ENGINEERING CONFERENCE, 2015, : 1836 - 1839
  • [3] Real-Time Hand Gesture Detection and Recognition for Human Computer Interaction
    Yadav, Kapil
    Bhattacharya, Jhilik
    [J]. INTELLIGENT SYSTEMS TECHNOLOGIES AND APPLICATIONS, VOL 1, 2016, 384 : 559 - 567
  • [4] THE METHOD FOR HUMAN-COMPUTER INTERACTION BASED ON HAND GESTURE RECOGNITION
    Raudonis, Vidas
    Jonaitis, Domas
    [J]. PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON ELECTRICAL AND CONTROL TECHNOLOGIES, 2013, : 45 - 49
  • [5] Real-time visual recognition of facial gestures for human-computer interaction
    Zelinsky, A
    Heinzmann, J
    [J]. PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, 1996, : 351 - 356
  • [6] Recognition of hand gesture to human-computer interaction
    Lee, LK
    Kim, S
    Choi, YK
    Lee, MH
    [J]. IECON 2000: 26TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, VOLS 1-4: 21ST CENTURY TECHNOLOGIES AND INDUSTRIAL OPPORTUNITIES, 2000, : 2117 - 2122
  • [7] An Approach to Dynamic Gesture Recognition for Real-Time Interaction
    Zhao, Jinli
    Chen, Tianding
    [J]. SIXTH INTERNATIONAL SYMPOSIUM ON NEURAL NETWORKS (ISNN 2009), 2009, 56 : 369 - 377
  • [8] A Dynamic Head Gesture Recognition Method for Real-time Intention Inference and Its Application to Visual Human-robot Interaction
    Jialong Xie
    Botao Zhang
    Qiang Lu
    Oleg Borisov
    [J]. International Journal of Control, Automation and Systems, 2024, 22 : 252 - 264
  • [9] A Dynamic Head Gesture Recognition Method for Real-time Intention Inference and Its Application to Visual Human-robot Interaction
    Xie, Jialong
    Zhang, Botao
    Lu, Qiang
    Borisov, Oleg
    [J]. INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2024, 22 (01) : 252 - 264
  • [10] Real Time Hand Gesture Recognition for Human Computer Interaction
    Agrawal, Rishabh
    Gupta, Nikita
    [J]. 2016 IEEE 6TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (IACC), 2016, : 470 - 475