IMITATION LEARNING OF DUAL-ARM MANIPULATION TASKS IN HUMANOID ROBOTS

被引:76
|
作者
Asfour, T. [1 ]
Azad, P. [1 ]
Gyarfas, F. [1 ]
Dillmann, R. [1 ]
机构
[1] Univ Karlsruhe, Inst Comp Sci & Engn, IAIM, D-76128 Karlsruhe, Germany
关键词
Imitation learning; cognitive behavior; dual-arm manipulation; hidden Markov models; human motion capture;
D O I
10.1142/S0219843608001431
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In this paper, we present an approach to imitation learning of arm movements in humanoid robots. Continuous hidden Markov models (HMMs) are used to generalize movements demonstrated to a robot multiple times. Characteristic features of the perceived movement, so-called key points, are detected in a preprocessing stage and used to train the HMMs. For the reproduction of a perceived movement, key points that are common to all (or almost all) demonstrations, so-called common key points, are used. These common key points are determined by comparing the HMM state sequences and selecting only those states that appear in every sequence. We also show how the HMM can be used to detect temporal dependencies between the two arms in dual-arm tasks. Experiments reported in this paper have been performed using a kinematics model of the human upper body to simulate the reproduction of arm movements and the generation of natural-looking joint configurations from perceived hand paths. Results are presented and discussed.
引用
收藏
页码:183 / 202
页数:20
相关论文
共 50 条
  • [1] Imitation learning of dual-arm manipulation tasks in humanoid robots
    Asfour, Tamim
    Gyarfas, Florian
    Azad, Pedram
    Dillmann, Rudiger
    2006 6TH IEEE-RAS INTERNATIONAL CONFERENCE ON HUMANOID ROBOTS, VOLS 1 AND 2, 2006, : 40 - +
  • [2] Human to humanoid motion conversion for dual-arm manipulation tasks
    Tomic, Marija
    Chevallereau, Christine
    Jovanovic, Kosta
    Potkonjak, Veljko
    Rodic, Aleksandar
    ROBOTICA, 2018, 36 (08) : 1167 - 1187
  • [3] Imitation Learning and Attentional Supervision of Dual-Arm Structured Tasks
    Caccavale, R.
    Saveriano, M.
    Fontanelli, G. A.
    Ficuciello, F.
    Lee, D.
    Finzi, A.
    2017 THE SEVENTH JOINT IEEE INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING AND EPIGENETIC ROBOTICS (ICDL-EPIROB), 2017, : 66 - 71
  • [4] Visual Servoing for Single and Dual Arm Manipulation Tasks in Humanoid Robots
    Boege, Christian
    Vahrenkamp, Nikolaus
    Asfour, Tamim
    Dillmann, Ruediger
    AT-AUTOMATISIERUNGSTECHNIK, 2012, 60 (05) : 309 - 317
  • [5] Humanoid Motion Planning for Dual-Arm Manipulation and Re-Grasping Tasks
    Vahrenkamp, Nikolaus
    Berenson, Dmitry
    Asfour, Tamim
    Kuffner, James
    Dillmann, Ruediger
    2009 IEEE-RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2009, : 2464 - 2470
  • [6] Hybrid Sensor Fusion Mixed with Reinforcement Learning in Autonomous Dual-Arm Lifting Tasks Performed by Humanoid Robots
    Hernandez-Vicen, Juan
    Lukawski, Bartek
    Martinez, Santiago
    Tsagarakis, Nikos
    Balaguer, Carlos
    ROBOTICS, 2024, 13 (08)
  • [7] Research on kinematics of humanoid dual-arm for mobile robots
    Ge, Lianzheng
    Chen, Jian
    Li, Ruifeng
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2011, 39 (SUPPL. 2): : 1 - 4
  • [8] Using Synergies in Dual-Arm Manipulation Tasks
    Suarez, Raul
    Rosell, Jan
    Garcia, Nestor
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2015, : 5655 - 5661
  • [9] Transformer-based deep imitation learning for dual-arm robot manipulation
    Kim, Heecheol
    Ohmura, Yoshiyuki
    Kuniyoshi, Yasuo
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 8965 - 8972
  • [10] Cable Installation by a Humanoid Integrating Dual-arm Manipulation and Walking
    Qin, Yili
    Escande, Adrien
    Yoshida, Eiichi
    2019 IEEE/SICE INTERNATIONAL SYMPOSIUM ON SYSTEM INTEGRATION (SII), 2019, : 98 - 103