Real-world Robot Reaching Skill Learning Based on Deep Reinforcement Learning

被引:0
|
作者
Liu, Naijun [1 ,2 ]
Lu, Tao [1 ]
Cai, Yinghao [1 ]
Wang, Rui [1 ,3 ]
Wang, Shuo [1 ,2 ,4 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100190, Peoples R China
[3] Chinese Acad Sci, Shenzhen Inst Adv Technol, Guangdong Prov Key Lab Robot & Intelligent Syst, Shenzhen 518055, Peoples R China
[4] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Shanghai 200031, Peoples R China
基金
中国国家自然科学基金;
关键词
Robot; reaching skill learning; deep reinforcement learning; NEURAL-NETWORKS; GAME; GO;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional programming method can achieve certain manipulation tasks with the assumption that robot environment is known and structured. However, with robots gradually applied in more domains, robots often encounter working scenes which are complicated, unpredictable, and unstructured. To overcome the limitation of traditional programming method, in this paper, we apply deep reinforcement learning (DRL) method to train robot agent to obtain skill policy. As policy trained with DRL on real-world robot is time-consuming and costly, we propose a novel and simple learning paradigm with the aim of training physical robot efficiently. Firstly, our method train a virtual agent in an simulated environment to reach random target position from random initial position. Secondly, virtual agent trajectory sequence obtained with the trained policy, is transformed to real-world robot command with coordinate transformation to control robot performing reaching tasks. Experiments show that the proposed method can obtain self-adaptive reaching policy with low training cost, which is of great benefits for developing intelligent and robust robot manipulation skill system.
引用
收藏
页码:4780 / 4784
页数:5
相关论文
共 50 条
  • [1] Real-Sim-Real Transfer for Real-World Robot Control Policy Learning with Deep Reinforcement Learning
    Liu, Naijun
    Cai, Yinghao
    Lu, Tao
    Wang, Rui
    Wang, Shuo
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (05):
  • [2] Real-world dexterous object manipulation based deep reinforcement learning
    Yao, Qingfeng
    Wang, Jilong
    Yang, Shuyu
    [J]. arXiv, 2021,
  • [3] Robot autonomous grasping and assembly skill learning based on deep reinforcement learning
    Chen, Chengjun
    Zhang, Hao
    Pan, Yong
    Li, Dongnian
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2024, 130 (11-12): : 5233 - 5249
  • [4] Robot autonomous grasping and assembly skill learning based on deep reinforcement learning
    Chengjun Chen
    Hao Zhang
    Yong Pan
    Dongnian Li
    [J]. The International Journal of Advanced Manufacturing Technology, 2024, 130 : 5233 - 5249
  • [5] Setting up a Reinforcement Learning Task with a Real-World Robot
    Mahmood, A. Rupam
    Korenkevych, Dmytro
    Komer, Brent J.
    Bergstra, James
    [J]. 2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 4635 - 4640
  • [6] Real-world reinforcement learning for autonomous humanoid robot docking
    Navarro-Guerrero, Nicolas
    Weber, Cornelius
    Schroeter, Pascal
    Wermter, Stefan
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2012, 60 (11) : 1400 - 1407
  • [7] Real-World Human-Robot Collaborative Reinforcement Learning
    Shafti, Ali
    Tjomsland, Jonas
    Dudley, William
    Faisal, A. Aldo
    [J]. 2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 11161 - 11166
  • [8] Tackling Real-World Autonomous Driving using Deep Reinforcement Learning
    Maramotti, Paolo
    Capasso, Alessandro Paolo
    Bacchiani, Giulio
    Broggi, Alberto
    [J]. 2022 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2022, : 1274 - 1281
  • [9] Deep Offline Reinforcement Learning for Real-world Treatment Optimization Applications
    Nambiar, Mila
    Ghosh, Supriyo
    Ong, Priscilla
    Chan, Yu En
    Bee, Yong Mong
    Krishnaswamy, Pavitra
    [J]. PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 4673 - 4684
  • [10] Real-World Object Recognition for Robot Based on Lightweight Deep Multimodal Distance Learning
    Zhang, Xu
    Xue, Bin
    Jing, Feng
    [J]. 2020 5TH ASIA-PACIFIC CONFERENCE ON INTELLIGENT ROBOT SYSTEMS (ACIRS 2020), 2020, : 33 - 36