Real-world Robot Reaching Skill Learning Based on Deep Reinforcement Learning

被引:0
|
作者
Liu, Naijun [1 ,2 ]
Lu, Tao [1 ]
Cai, Yinghao [1 ]
Wang, Rui [1 ,3 ]
Wang, Shuo [1 ,2 ,4 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100190, Peoples R China
[3] Chinese Acad Sci, Shenzhen Inst Adv Technol, Guangdong Prov Key Lab Robot & Intelligent Syst, Shenzhen 518055, Peoples R China
[4] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Shanghai 200031, Peoples R China
基金
中国国家自然科学基金;
关键词
Robot; reaching skill learning; deep reinforcement learning; NEURAL-NETWORKS; GAME; GO;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional programming method can achieve certain manipulation tasks with the assumption that robot environment is known and structured. However, with robots gradually applied in more domains, robots often encounter working scenes which are complicated, unpredictable, and unstructured. To overcome the limitation of traditional programming method, in this paper, we apply deep reinforcement learning (DRL) method to train robot agent to obtain skill policy. As policy trained with DRL on real-world robot is time-consuming and costly, we propose a novel and simple learning paradigm with the aim of training physical robot efficiently. Firstly, our method train a virtual agent in an simulated environment to reach random target position from random initial position. Secondly, virtual agent trajectory sequence obtained with the trained policy, is transformed to real-world robot command with coordinate transformation to control robot performing reaching tasks. Experiments show that the proposed method can obtain self-adaptive reaching policy with low training cost, which is of great benefits for developing intelligent and robust robot manipulation skill system.
引用
收藏
页码:4780 / 4784
页数:5
相关论文
共 50 条
  • [41] Robot Motor Skill Coordination with EM-based Reinforcement Learning
    Kormushev, Petar
    Calinon, Sylvain
    Caldwell, Darwin G.
    [J]. IEEE/RSJ 2010 INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2010), 2010, : 3232 - 3237
  • [42] Fuzzy-based reinforcement learning of a robot force control skill
    Araujo, R
    Nunes, U
    deAlmeida, AT
    [J]. ISIE'96 - PROCEEDINGS OF THE IEEE INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS, VOLS 1 AND 2, 1996, : 453 - 458
  • [43] Learning for a robot: Deep reinforcement learning, imitation learning, transfer learning
    Hua, Jiang
    Zeng, Liangcai
    Li, Gongfa
    Ju, Zhaojie
    [J]. Sensors (Switzerland), 2021, 21 (04): : 1 - 21
  • [44] Learning for a Robot: Deep Reinforcement Learning, Imitation Learning, Transfer Learning
    Hua, Jiang
    Zeng, Liangcai
    Li, Gongfa
    Ju, Zhaojie
    [J]. SENSORS, 2021, 21 (04) : 1 - 21
  • [45] Deep learning, reinforcement learning, and world models
    Matsuo, Yutaka
    LeCun, Yann
    Sahani, Maneesh
    Precup, Doina
    Silver, David
    Sugiyama, Masashi
    Uchibe, Eiji
    Morimoto, Jun
    [J]. NEURAL NETWORKS, 2022, 152 : 267 - 275
  • [46] Skill Reward for Safe Deep Reinforcement Learning
    Cheng, Jiangchang
    Yu, Fumin
    Zhang, Hongliang
    Dai, Yinglong
    [J]. UBIQUITOUS SECURITY, 2022, 1557 : 203 - 213
  • [47] Independent Skill Transfer for Deep Reinforcement Learning
    Tian, Qiangxing
    Wang, Guanchu
    Liu, Jinxin
    Wang, Donglin
    Kang, Yachen
    [J]. PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 2901 - 2907
  • [48] Deep learning and alternative learning strategies for retrospective real-world clinical data
    Chen, David
    Liu, Sijia
    Kingsbury, Paul
    Sohn, Sunghwan
    Storlie, Curtis B.
    Habermann, Elizabeth B.
    Naessens, James M.
    Larson, David W.
    Liu, Hongfang
    [J]. NPJ DIGITAL MEDICINE, 2019, 2 (1)
  • [49] Deep learning and alternative learning strategies for retrospective real-world clinical data
    David Chen
    Sijia Liu
    Paul Kingsbury
    Sunghwan Sohn
    Curtis B. Storlie
    Elizabeth B. Habermann
    James M. Naessens
    David W. Larson
    Hongfang Liu
    [J]. npj Digital Medicine, 2
  • [50] Differentiable Physics Models for Real-world Offline Model-based Reinforcement Learning
    Lutter, Michael
    Silberbauer, Johannes
    Watson, Joe
    Peters, Jan
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 4163 - 4170