Visual Gesture Recognition for Human Robot Interaction Using Dynamic Movement Primitives

被引:0
|
作者
Liu, Zhan [1 ]
Hu, Fan [1 ]
Luo, Dingsheng [1 ]
Wu, Xihong [1 ]
机构
[1] Peking Univ, Sch Elect Engn & Comp Sci, Speech & Hearing Res Ctr, Key Lab Machine Percept,Minist Educ, Beijing 100871, Peoples R China
关键词
Gesture recognition; human robot interaction; dynamic movement primitives;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper a method to address the efficiency and robustness of dynamic hand gesture recognition for human robot interaction is proposed. By using on-board monocular camera and specialized gesture detection algorithms, the humanoid robot is able to detect gestures fast. To model the dynamics of gestures, the dynamic movement primitives (DMP) model is employed, which well characterizes both spatial and temporal evolutions of gestures. The invariance properties of the DMP model against different spatiotemporal scales also offer expected robustness to handle the variances in gestures. To cope with the diversity and noise of gestures, an efficient adaptive DMP learning method is further proposed. Since the learnt weights of the DMP compactly represent the original gestures, they serve as ideal feature vectors for building a classifier to recognize new gestures. To evaluate the proposed method, a nine-class human gestures recognition task on a real humanoid robot is performed and 98.06% accuracy is obtained. Experimental results demonstrate the effectiveness of our method.
引用
收藏
页码:2094 / 2100
页数:7
相关论文
共 50 条
  • [31] Diver Gesture Recognition using Deep Learning for Underwater Human-Robot Interaction
    Yang, Jing
    Wilson, James P.
    Gupta, Shalabh
    [J]. OCEANS 2019 MTS/IEEE SEATTLE, 2019,
  • [32] A Dynamic Head Gesture Recognition Method for Real-time Intention Inference and Its Application to Visual Human-robot Interaction
    Jialong Xie
    Botao Zhang
    Qiang Lu
    Oleg Borisov
    [J]. International Journal of Control, Automation and Systems, 2024, 22 : 252 - 264
  • [33] A Dynamic Head Gesture Recognition Method for Real-time Intention Inference and Its Application to Visual Human-robot Interaction
    Xie, Jialong
    Zhang, Botao
    Lu, Qiang
    Borisov, Oleg
    [J]. INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2024, 22 (01) : 252 - 264
  • [34] Human Motion Prediction in Human-Robot Handovers based on Dynamic Movement Primitives
    Widmann, Dominik
    Karayiannidis, Yiannis
    [J]. 2018 EUROPEAN CONTROL CONFERENCE (ECC), 2018, : 2781 - 2787
  • [35] Human-robot collaborative object transfer using human motion prediction based on Dynamic Movement Primitives
    Sidiropoulos, Antonis
    Karayiannidis, Yiannis
    Doulgeri, Zoe
    [J]. 2019 18TH EUROPEAN CONTROL CONFERENCE (ECC), 2019, : 2583 - 2588
  • [36] Visual gesture recognition for human-machine interface of robot teleoperation
    Hu, C
    Meng, MQ
    Liu, PXP
    Wang, X
    [J]. IROS 2003: PROCEEDINGS OF THE 2003 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-4, 2003, : 1560 - 1565
  • [37] A Locomotion Mode Recognition Algorithm Using Adaptive Dynamic Movement Primitives
    Eken, Huseyin
    Lanotte, Francesco
    Papapicco, Vito
    Penna, Michele Francesco
    Gruppioni, Emanuele
    Trigili, Emilio
    Crea, Simona
    Vitiello, Nicola
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 4318 - 4328
  • [38] Human Gesture Recognition with a Flow-based Model for Human Robot Interaction
    Liu, Lanmiao
    Yu, Chuang
    Song, Siyang
    Su, Zhidong
    Tapus, Adriana
    [J]. COMPANION OF THE ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, HRI 2023, 2023, : 548 - 551
  • [39] Dynamic Movement Primitives Based Robot Skills Learning
    Ling-Huan Kong
    Wei He
    Wen-Shi Chen
    Hui Zhang
    Yao-Nan Wang
    [J]. Machine Intelligence Research, 2023, 20 : 396 - 407
  • [40] Adaptation of Robot Locomotion Patterns with Dynamic Movement Primitives
    Rosado, Jose
    Silva, Filipe
    Santos, Vitor
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC), 2015, : 23 - 28