IMITATION LEARNING OF DUAL-ARM MANIPULATION TASKS IN HUMANOID ROBOTS

被引:76
|
作者
Asfour, T. [1 ]
Azad, P. [1 ]
Gyarfas, F. [1 ]
Dillmann, R. [1 ]
机构
[1] Univ Karlsruhe, Inst Comp Sci & Engn, IAIM, D-76128 Karlsruhe, Germany
关键词
Imitation learning; cognitive behavior; dual-arm manipulation; hidden Markov models; human motion capture;
D O I
10.1142/S0219843608001431
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In this paper, we present an approach to imitation learning of arm movements in humanoid robots. Continuous hidden Markov models (HMMs) are used to generalize movements demonstrated to a robot multiple times. Characteristic features of the perceived movement, so-called key points, are detected in a preprocessing stage and used to train the HMMs. For the reproduction of a perceived movement, key points that are common to all (or almost all) demonstrations, so-called common key points, are used. These common key points are determined by comparing the HMM state sequences and selecting only those states that appear in every sequence. We also show how the HMM can be used to detect temporal dependencies between the two arms in dual-arm tasks. Experiments reported in this paper have been performed using a kinematics model of the human upper body to simulate the reproduction of arm movements and the generation of natural-looking joint configurations from perceived hand paths. Results are presented and discussed.
引用
收藏
页码:183 / 202
页数:20
相关论文
共 50 条
  • [41] Kinematic modeling and Simulation of humanoid dual-arm robot
    Wang, Jiwu
    Xu, Junxiang
    PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS (ICAROB 2021), 2021, : 381 - 384
  • [42] Dynamic Analysis of a Dual-arm Humanoid Cooking Robot
    Zhai, Jiaxin
    Pan, Gen
    Yan, Weixin
    Fu, Zhuang
    Zhao, Yanzheng
    PROCEEDINGS OF THE 2015 10TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS, 2015, : 851 - 854
  • [43] Dual-Arm Control for Enhanced Magnetic Manipulation
    Pittiglio, Giovanni
    Chandler, James H.
    Richter, Michiel
    Venkiteswaran, Venkatasubramanian K.
    Misra, Sarthak
    Valdastri, Pietro
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 7211 - 7218
  • [44] Underactuated Robot Hand for Dual-Arm Manipulation
    Yamaguchi, Kengo
    Hirata, Yasuhisa
    Kosuge, Kazuhiro
    2015 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2015, : 2937 - 2942
  • [45] Admittance control for collaborative dual-arm manipulation
    Tarbouriech, Sonny
    Navarro, Benjamin
    Fraisse, Philippe
    Crosnier, Andre
    Cherubini, Andrea
    Salle, Damien
    2019 19TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS (ICAR), 2019, : 198 - 204
  • [46] Autonomous Dual-Arm Manipulation of Familiar Objects
    Pavlichenko, Dmytro
    Rodriguez, Diego
    Schwarz, Max
    Lenz, Christian
    Periyasamy, Arul Selvam
    Behnke, Sven
    2018 IEEE-RAS 18TH INTERNATIONAL CONFERENCE ON HUMANOID ROBOTS (HUMANOIDS), 2018, : 1136 - 1142
  • [47] Dual-arm robotic manipulation of flexible cables
    Zhu, Jihong
    Navarro, Benjamin
    Fraisse, Philippe
    Crosnier, Andre
    Cherubini, Andrea
    2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 479 - 484
  • [48] Toward optimal mapping of human dual-arm motion to humanoid motion for tasks involving contact with the environment
    Tomic, Marija
    Jovanovic, Kosta
    Chevallereau, Christine
    Potkonjak, Veljko
    Rodic, Aleksandar
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2018, 15 (01):
  • [49] LfDT: Learning Dual-Arm Manipulation from Demonstration Translated from a Human and Robotic Arm
    Kobayashi, Masato
    Yamada, Jun
    Hamaya, Masashi
    Tanaka, Kazutoshi
    2023 IEEE-RAS 22ND INTERNATIONAL CONFERENCE ON HUMANOID ROBOTS, HUMANOIDS, 2023,
  • [50] Barrier Lyapunov Based Control of Dual-Arm Exoskeleton Robots Performing Asymmetric Bimanual Tasks
    Li, Zhijun
    Su, Hang
    Zhang, Hongbin
    Su, Chun-Yi
    Chai, Tianyou
    2014 INTERNATIONAL CONFERENCE ON ADVANCED MECHATRONIC SYSTEMS (ICAMECHS), 2014, : 301 - 306