Imitation learning of dual-arm manipulation tasks in humanoid robots

被引:48
|
作者
Asfour, Tamim [1 ]
Gyarfas, Florian [1 ]
Azad, Pedram [1 ]
Dillmann, Rudiger [1 ]
机构
[1] Univ Karlsruhe, Inst Comp Sci & Engn, CSE IAIM, POB 6980, D-76128 Karlsruhe, Germany
关键词
D O I
10.1109/ICHR.2006.321361
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we deal with imitation learning of arm movements in humanoid robots. Hidden Markov Models (HMM) are used to generalize movements demonstrated to a robot multiple times. They are trained with the characteristic features (key points) of each demonstration. Using the same HMM, key points that are common to all demonstrations are identified; only those are considered when reproducing a movement. We also show how HMM can be used to detect temporal dependencies between both arms in dual-arm tasks. We created a model of the human upper body to simulate the reproduction of dual-arm movements and generate natural-looking joint configurations from tracked hand paths. Results are presented and discussed.
引用
收藏
页码:40 / +
页数:2
相关论文
共 50 条
  • [1] IMITATION LEARNING OF DUAL-ARM MANIPULATION TASKS IN HUMANOID ROBOTS
    Asfour, T.
    Azad, P.
    Gyarfas, F.
    Dillmann, R.
    [J]. INTERNATIONAL JOURNAL OF HUMANOID ROBOTICS, 2008, 5 (02) : 183 - 202
  • [2] Human to humanoid motion conversion for dual-arm manipulation tasks
    Tomic, Marija
    Chevallereau, Christine
    Jovanovic, Kosta
    Potkonjak, Veljko
    Rodic, Aleksandar
    [J]. ROBOTICA, 2018, 36 (08) : 1167 - 1187
  • [3] Imitation Learning and Attentional Supervision of Dual-Arm Structured Tasks
    Caccavale, R.
    Saveriano, M.
    Fontanelli, G. A.
    Ficuciello, F.
    Lee, D.
    Finzi, A.
    [J]. 2017 THE SEVENTH JOINT IEEE INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING AND EPIGENETIC ROBOTICS (ICDL-EPIROB), 2017, : 66 - 71
  • [4] Visual Servoing for Single and Dual Arm Manipulation Tasks in Humanoid Robots
    Boege, Christian
    Vahrenkamp, Nikolaus
    Asfour, Tamim
    Dillmann, Ruediger
    [J]. AT-AUTOMATISIERUNGSTECHNIK, 2012, 60 (05) : 309 - 317
  • [5] Humanoid Motion Planning for Dual-Arm Manipulation and Re-Grasping Tasks
    Vahrenkamp, Nikolaus
    Berenson, Dmitry
    Asfour, Tamim
    Kuffner, James
    Dillmann, Ruediger
    [J]. 2009 IEEE-RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2009, : 2464 - 2470
  • [6] Hybrid Sensor Fusion Mixed with Reinforcement Learning in Autonomous Dual-Arm Lifting Tasks Performed by Humanoid Robots
    Hernandez-Vicen, Juan
    Lukawski, Bartek
    Martinez, Santiago
    Tsagarakis, Nikos
    Balaguer, Carlos
    [J]. ROBOTICS, 2024, 13 (08)
  • [7] Using Synergies in Dual-Arm Manipulation Tasks
    Suarez, Raul
    Rosell, Jan
    Garcia, Nestor
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2015, : 5655 - 5661
  • [8] Transformer-based deep imitation learning for dual-arm robot manipulation
    Kim, Heecheol
    Ohmura, Yoshiyuki
    Kuniyoshi, Yasuo
    [J]. 2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 8965 - 8972
  • [9] Cable Installation by a Humanoid Integrating Dual-arm Manipulation and Walking
    Qin, Yili
    Escande, Adrien
    Yoshida, Eiichi
    [J]. 2019 IEEE/SICE INTERNATIONAL SYMPOSIUM ON SYSTEM INTEGRATION (SII), 2019, : 98 - 103
  • [10] A Novel Robust Imitation Learning Framework for Dual-Arm Object-Moving Tasks
    Wang, Weiyong
    Zeng, Chao
    Lu, Zhenyu
    Yang, Chenguang
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2024,