Motion Profile Optimization in Industrial Robots using Reinforcement Learning

被引:0
|
作者
Wen, Yunshi [1 ]
He, Honglu [1 ]
Julius, Agung [1 ]
Wen, John T. [1 ]
机构
[1] Rensselaer Polytech Inst, Elect Comp & Syst Engn Dept, Troy, NY 12180 USA
关键词
Reinforcement Learning; Industrial Robot; Motion Primitive; Trajectory Optimization; Trajectory Tracking;
D O I
10.1109/AIM46323.2023.10196247
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Path tracking problems are challenging with the absence of dynamic models and information about robot controllers. This paper presents a method of optimizing a motion profile constructed using a set of pre-defined motion primitives and a speed command to track a spatial trajectory with high accuracy, speed, and uniform motion using industrial robots. We use a bi-level optimization approach that optimizes execution accuracy using reinforcement learning and execution speed using bi-section search. We train and evaluate the reinforcement learning policy in simulation for an ABB robot. Experiment results demonstrate that the learned policy reduces the optimization cost to achieve the desired specifications. Additionally, the trained policy can generalize to trajectories not included in the training set.
引用
收藏
页码:1309 / 1316
页数:8
相关论文
共 50 条
  • [1] Motion Planning for Industrial Robots using Reinforcement Learning
    Meyes, Richard
    Tercan, Hasan
    Roggendorf, Simon
    Thiele, Thomas
    Buescher, Christian
    Obdenbusch, Markus
    Brecher, Christian
    Jeschke, Sabina
    Meisen, Tobias
    [J]. MANUFACTURING SYSTEMS 4.0, 2017, 63 : 107 - 112
  • [2] Calculation and Optimization of Industrial Robots Motion
    Ivanov, Sergei
    Ivanova, Lubov
    Meleshkova, Zoia
    [J]. PROCEEDINGS OF THE 26TH CONFERENCE OF OPEN INNOVATIONS ASSOCIATION FRUCT, 2020, : 115 - 123
  • [3] Transferring Human Manipulation Knowledge to Industrial Robots Using Reinforcement Learning
    Arana-Arexolaleiba, N.
    Urrestilla-Anguiozar, N.
    Chrysostomou, D.
    Bogh, S.
    [J]. 29TH INTERNATIONAL CONFERENCE ON FLEXIBLE AUTOMATION AND INTELLIGENT MANUFACTURING (FAIM 2019): BEYOND INDUSTRY 4.0: INDUSTRIAL ADVANCES, ENGINEERING EDUCATION AND INTELLIGENT MANUFACTURING, 2019, 38 : 1508 - 1515
  • [4] Human Motion Control of Quadrupedal Robots using Deep Reinforcement Learning
    Kim, Sunwoo
    Sorokin, Maks
    Lee, Jehee
    Ha, Sehoon
    [J]. ROBOTICS: SCIENCE AND SYSTEM XVIII, 2022,
  • [5] Deep reinforcement learning for motion planning of mobile robots
    Sun, Hui-Hui
    Hu, Chun-He
    Zhang, Jun-Guo
    [J]. Kongzhi yu Juece/Control and Decision, 2021, 36 (06): : 1281 - 1292
  • [6] Hierarchical Free Gait Motion Planning for Hexapod Robots Using Deep Reinforcement Learning
    Wang, Xinpeng
    Fu, Huiqiao
    Deng, Guizhou
    Liu, Canghai
    Tang, Kaiqiang
    Chen, Chunlin
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (11) : 10901 - 10912
  • [7] Motion Coordination of Multiple Robots Based on Deep Reinforcement Learning
    Hao, Xiuzhao
    Wu, Zhihao
    Zhou, Haiguang
    Bai, Xiangpeng
    Lin, Youfang
    Han, Sheng
    [J]. 2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 955 - 962
  • [8] Towards Automated Installation of Reinforcement Using Industrial Robots
    Relefors, Johan
    Momeni, Mahdi
    Pettersson, Lars
    Hellstrom, Erik
    Thunell, Anders
    Papadopoulos, Alessandro V.
    Nolte, Thomas
    [J]. 2019 24TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2019, : 1595 - 1598
  • [9] Motion Planning using Reinforcement Learning for Electric Vehicle Battery Optimization(EVBO)
    Soni, Himanshu
    Gupta, Vishu
    Kumar, Rajesh
    [J]. 2019 INTERNATIONAL CONFERENCE ON POWER ELECTRONICS, CONTROL AND AUTOMATION (ICPECA-2019), 2019, : 11 - 16
  • [10] On reinforcement learning for robots
    Kaelbling, LP
    [J]. IROS 96 - PROCEEDINGS OF THE 1996 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS - ROBOTIC INTELLIGENCE INTERACTING WITH DYNAMIC WORLDS, VOLS 1-3, 1996, : 1319 - 1320