Real-world Robot Reaching Skill Learning Based on Deep Reinforcement Learning

被引:0
|
作者
Liu, Naijun [1 ,2 ]
Lu, Tao [1 ]
Cai, Yinghao [1 ]
Wang, Rui [1 ,3 ]
Wang, Shuo [1 ,2 ,4 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100190, Peoples R China
[3] Chinese Acad Sci, Shenzhen Inst Adv Technol, Guangdong Prov Key Lab Robot & Intelligent Syst, Shenzhen 518055, Peoples R China
[4] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Shanghai 200031, Peoples R China
基金
中国国家自然科学基金;
关键词
Robot; reaching skill learning; deep reinforcement learning; NEURAL-NETWORKS; GAME; GO;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional programming method can achieve certain manipulation tasks with the assumption that robot environment is known and structured. However, with robots gradually applied in more domains, robots often encounter working scenes which are complicated, unpredictable, and unstructured. To overcome the limitation of traditional programming method, in this paper, we apply deep reinforcement learning (DRL) method to train robot agent to obtain skill policy. As policy trained with DRL on real-world robot is time-consuming and costly, we propose a novel and simple learning paradigm with the aim of training physical robot efficiently. Firstly, our method train a virtual agent in an simulated environment to reach random target position from random initial position. Secondly, virtual agent trajectory sequence obtained with the trained policy, is transformed to real-world robot command with coordinate transformation to control robot performing reaching tasks. Experiments show that the proposed method can obtain self-adaptive reaching policy with low training cost, which is of great benefits for developing intelligent and robust robot manipulation skill system.
引用
收藏
页码:4780 / 4784
页数:5
相关论文
共 50 条
  • [21] Real-World Reinforcement Learning via Multifidelity Simulators
    Cutler, Mark
    Walsh, Thomas J.
    How, Jonathan P.
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2015, 31 (03) : 655 - 671
  • [22] Deep reinforcement learning towards real-world dynamic thermal management of data centers
    Zhang, Qingang
    Zeng, Wei
    Lin, Qinjie
    Chng, Chin-Boon
    Chui, Chee-Kong
    Lee, Poh-Seng
    [J]. APPLIED ENERGY, 2023, 333
  • [23] Real-world ride-hailing vehicle repositioning using deep reinforcement learning
    Jiao, Yan
    Tang, Xiaocheng
    Qin, Zhiwei
    Li, Shuaiji
    Zhang, Fan
    Zhu, Hongtu
    Ye, Jieping
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2021, 130
  • [24] Real-world ride-hailing vehicle repositioning using deep reinforcement learning
    Jiao, Yan
    Tang, Xiaocheng
    Qin, Zhiwei
    Li, Shuaiji
    Zhang, Fan
    Zhu, Hongtu
    Ye, Jieping
    [J]. Transportation Research Part C: Emerging Technologies, 2021, 130
  • [26] Real-World Implementation of Reinforcement Learning Based Energy Coordination for a Cluster of Households
    Gokhale, Gargya
    Tiben, Niels
    Verwee, Marie-Sophie
    Lahariya, Manu
    Claessens, Bert
    Develder, Chris
    [J]. PROCEEDINGS OF THE 10TH ACM INTERNATIONAL CONFERENCE ON SYSTEMS FOR ENERGY-EFFICIENT BUILDINGS, CITIES, AND TRANSPORTATION, BUILDSYS 2023, 2023, : 347 - 351
  • [27] Face Recognition in Real-world Internet Videos Based on Deep Learning
    Li, Zhaoyang
    Tie, Yun
    Qi, Lin
    [J]. 2019 8TH INTERNATIONAL SYMPOSIUM ON NEXT GENERATION ELECTRONICS (ISNE), 2019,
  • [28] NeoRL: A Near Real-World Benchmark for Offline Reinforcement Learning
    Qin, Rong-Jun
    Zhang, Xingyuan
    Gao, Songyi
    Chen, Xiong-Hui
    Li, Zewen
    Zhang, Weinan
    Yu, Yang
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [29] ContainerGym: A Real-World Reinforcement Learning Benchmark for Resource Allocation
    Pendyala, Abhijeet
    Dettmer, Justin
    Glasmachers, Tobias
    Atamna, Asma
    [J]. MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE, LOD 2023, PT I, 2024, 14505 : 78 - 92
  • [30] Toward the confident deployment of real-world reinforcement learning agents
    Hanna, Josiah P.
    [J]. AI MAGAZINE, 2024, 45 (03) : 396 - 403