Motion Profile Optimization in Industrial Robots using Reinforcement Learning

被引:0
|
作者
Wen, Yunshi [1 ]
He, Honglu [1 ]
Julius, Agung [1 ]
Wen, John T. [1 ]
机构
[1] Rensselaer Polytech Inst, Elect Comp & Syst Engn Dept, Troy, NY 12180 USA
关键词
Reinforcement Learning; Industrial Robot; Motion Primitive; Trajectory Optimization; Trajectory Tracking;
D O I
10.1109/AIM46323.2023.10196247
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Path tracking problems are challenging with the absence of dynamic models and information about robot controllers. This paper presents a method of optimizing a motion profile constructed using a set of pre-defined motion primitives and a speed command to track a spatial trajectory with high accuracy, speed, and uniform motion using industrial robots. We use a bi-level optimization approach that optimizes execution accuracy using reinforcement learning and execution speed using bi-section search. We train and evaluate the reinforcement learning policy in simulation for an ABB robot. Experiment results demonstrate that the learned policy reduces the optimization cost to achieve the desired specifications. Additionally, the trained policy can generalize to trajectories not included in the training set.
引用
收藏
页码:1309 / 1316
页数:8
相关论文
共 50 条
  • [41] Local motion simulation using deep reinforcement learning
    Xu, Dong
    Huang, Xiao
    Li, Zhenlong
    Li, Xiang
    [J]. TRANSACTIONS IN GIS, 2020, 24 (03) : 756 - 779
  • [42] An Optimal Satellite Antenna Profile Using Reinforcement Learning
    Ahn, Hyo-Sung
    Jung, Okchul
    Choi, Sujin
    Son, Ji-Hwan
    Chung, Daewon
    Kim, Gyusun
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2011, 41 (03): : 393 - 406
  • [43] Optimization of cooperative motion for humanoid robots using a genetic algorithm
    Choi, KJ
    Hwang, YK
    Hong, DS
    Chung, WJ
    Park, IH
    [J]. ICMIT 2005: CONTROL SYSTEMS AND ROBOTICS, PTS 1 AND 2, 2005, 6042
  • [44] A comprehensive study on reinforcement learning application for train speed profile optimization
    Sandidzadeh, Mohammad Ali
    Havaei, Pedram
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (24) : 37351 - 37386
  • [45] Composite temperature profile and tooling optimization via Deep Reinforcement Learning
    Szarski, Martin
    Chauhan, Sunita
    [J]. COMPOSITES PART A-APPLIED SCIENCE AND MANUFACTURING, 2021, 142
  • [46] A comprehensive study on reinforcement learning application for train speed profile optimization
    Mohammad Ali Sandidzadeh
    Pedram Havaei
    [J]. Multimedia Tools and Applications, 2023, 82 : 37351 - 37386
  • [47] Learning controllers for industrial robots
    Baroglio, C
    Giordana, A
    Kaiser, M
    Nuttin, M
    Piola, R
    [J]. MACHINE LEARNING, 1996, 23 (2-3) : 221 - 249
  • [48] A reinforcement learning model for robots as teachers
    Roy, Sayanti
    Kieson, Emily
    Abramson, Charles
    Crick, Christopher
    [J]. 2018 27TH IEEE INTERNATIONAL SYMPOSIUM ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (IEEE RO-MAN 2018), 2018, : 294 - 299
  • [49] Effective reinforcement learning for mobile robots
    Smart, WD
    Kaelbling, LP
    [J]. 2002 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS I-IV, PROCEEDINGS, 2002, : 3404 - 3410
  • [50] Energy Management System for an Industrial Microgrid Using Optimization Algorithms-Based Reinforcement Learning Technique
    Upadhyay, Saugat
    Ahmed, Ibrahim
    Mihet-Popa, Lucian
    [J]. ENERGIES, 2024, 17 (16)