Dynamic motion learning for multi-DOF flexible-joint robots using active-passive motor babbling through deep learning

被引:13
|
作者
Takahashi, Kuniyuki [1 ,2 ]
Ogata, Tetsuya [3 ]
Nakanishi, Jun [4 ]
Cheng, Gordon [5 ]
Sugano, Shigeki [1 ]
机构
[1] Waseda Univ, Grad Sch Creat Sci & Engn, Tokyo, Japan
[2] Japan Soc Promot Sci, Tokyo, Japan
[3] Waseda Univ, Grad Sch Fundamental Sci & Engn, Tokyo, Japan
[4] Nagoya Univ, Dept Micronano Mech Sci & Engn, Nagoya, Aichi, Japan
[5] Tech Univ Munich, Inst Cognit Syst, Munich, Germany
关键词
Motor babbling; flexible-joint robot; dynamic motion learning; recurrent neural network; deep learning; SELF;
D O I
10.1080/01691864.2017.1383939
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This paper proposes a learning strategy for robots with flexible joints having multi-degrees of freedom in order to achieve dynamic motion tasks. In spite of there being several potential benefits of flexible-joint robots such as exploitation of intrinsic dynamics and passive adaptation to environmental changes with mechanical compliance, controlling such robots is challenging because of increased complexity of their dynamics. To achieve dynamic movements, we introduce a two-phase learning framework of the body dynamics of the robot using a recurrent neural network motivated by a deep learning strategy. The proposed methodology comprises a pre-training phase with motor babbling and a fine-tuning phase with additional learning of the target tasks. In the pre-training phase, we consider active and passive exploratory motions for efficient acquisition of body dynamics. In the fine-tuning phase, the learned body dynamics are adjusted for specific tasks. We demonstrate the effectiveness of the proposed methodology in achieving dynamic tasks involving constrained movement requiring interactions with the environment on a simulated robot model and an actual PR2 robot both of which have a compliantly actuated seven degree-of-freedom arm. The results illustrate a reduction in the required number of training iterations for task learning and generalization capabilities for untrained situations.
引用
收藏
页码:1002 / 1015
页数:14
相关论文
共 10 条
  • [1] Effective Motion Learning for a Flexible-Joint Robot Using Motor Babbling
    Takahashi, Kuniyuki
    Ogata, Tetsuya
    Yamada, Hiroki
    Tjandra, Hadi
    Sugano, Shigeki
    2015 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2015, : 2723 - 2728
  • [2] Dynamic Motion Generation by Flexible-Joint Robot based on Deep Learning using Images
    Wu, Yuheng
    Takahashi, Kuniyuki
    Yamada, Hiroki
    Kim, Kitae
    Murata, Shingo
    Sugano, Shigeki
    Ogata, Tetsuya
    2018 JOINT IEEE 8TH INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING AND EPIGENETIC ROBOTICS (ICDL-EPIROB), 2018, : 169 - 174
  • [3] A novel parameter identification method for flexible-joint robots using input torque and motor-side motion data
    Zhao, Pu
    ROBOTICA, 2022, 40 (09) : 3077 - 3087
  • [4] Continuous joint velocity estimation using CNN-based deep learning for multi-DoF prosthetic wrist for activities of daily living
    Meng, Zixia
    Kang, Jiyeon
    FRONTIERS IN NEUROROBOTICS, 2023, 17
  • [5] Dynamic Input Deep Learning Control of Artificial Avatars in a Multi-Agent Joint Motor Task
    Lombardi, Maria
    Liuzza, Davide
    di Bernardo, Mario
    FRONTIERS IN ROBOTICS AND AI, 2021, 8
  • [6] Dynamic Task Planning for Multi-Arm Harvesting Robots Under Multiple Constraints Using Deep Reinforcement Learning
    Xie, Feng
    Guo, Zhengwei
    Li, Tao
    Feng, Qingchun
    Zhao, Chunjiang
    HORTICULTURAE, 2025, 11 (01)
  • [7] Active control of flexible rotors using deep reinforcement learning with application of multi-actor-critic deep deterministic policy gradient
    Ahmed, Maheed H.
    AboHussien, Abdullah
    El-Shafei, Aly
    Darwish, Ahmed M.
    Abdel-Gawad, Ahmed H.
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 124
  • [8] Efficient Multi-Objective Optimization on Dynamic Flexible Job Shop Scheduling Using Deep Reinforcement Learning Approach
    Wu, Zufa
    Fan, Hongbo
    Sun, Yimeng
    Peng, Manyu
    PROCESSES, 2023, 11 (07)
  • [9] Dynamic Voltage Regulation in Active Distribution Networks Using Day-Ahead Multi-Agent Deep Reinforcement Learning
    Ali, Arman
    Li, Chaojie
    Hredzak, Branislav
    IEEE TRANSACTIONS ON POWER DELIVERY, 2024, 39 (02) : 1186 - 1197
  • [10] Improving interpretability of deep active learning for flood inundation mapping through class ambiguity indices using multi-spectral satellite imagery
    Lee, Hyunho
    Li, Wenwen
    REMOTE SENSING OF ENVIRONMENT, 2024, 309