Adaptive predictive control of a differential drive robot tuned with reinforcement learning

被引:18
|
作者
Jardine, P. Travis [1 ]
Kogan, Michael [2 ]
Givigi, Sidney N. [2 ]
Yousefi, Shahram [1 ]
机构
[1] Queens Univ, Dept Elect & Comp Engn, Kingston, ON, Canada
[2] Royal Mil Coll Canada, Dept Elect & Comp Engn, Kingston, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
feedback linearization; machine learning; model predictive control; reinforcement learning;
D O I
10.1002/acs.2882
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
One of the most important steps in designing a model predictive control strategy is selecting appropriate parameters for the relative weights of the objective function. Typically, these are selected through trial and error to meet the desired performance. In this paper, a reinforcement learning technique called learning automata is used to select appropriate parameters for the controller of a differential drive robot through a simulation process. Results of the simulation show that the parameters always converge, although to different values. A controller chosen by the learning process is then ported to a real platform. The selected controller is shown to control the robot better than a standard model predictive control.
引用
收藏
页码:410 / 423
页数:14
相关论文
共 50 条
  • [1] Model predictive control for constrained robot manipulator visual servoing tuned by reinforcement learning
    Li, Jiashuai
    Peng, Xiuyan
    Li, Bing
    Sreeram, Victor
    Wu, Jiawei
    Chen, Ziang
    Li, Mingze
    [J]. MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (06) : 10495 - 10513
  • [2] Adaptive Velocity Control for a Differential Drive Mobile Robot
    Petrov, Plamen
    Georgieva, Veska
    [J]. 2018 20TH INTERNATIONAL SYMPOSIUM ON ELECTRICAL APPARATUS AND TECHNOLOGIES (SIELA), 2018,
  • [3] Predictive Control of a Robot Manipulator with Deep Reinforcement Learning
    Bejar, Eduardo
    Moran, Antonio
    [J]. 2021 7TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2021, : 127 - 130
  • [4] Hierarchical reinforcement learning with adaptive scheduling for robot control
    Huang, Zhigang
    Liu, Quan
    Zhu, Fei
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [5] Model Predictive Control of Quadruped Robot Based on Reinforcement Learning
    Zhang, Zhitong
    Chang, Xu
    Ma, Hongxu
    An, Honglei
    Lang, Lin
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (01):
  • [6] Learning When to Drive in Intersections by Combining Reinforcement Learning and Model Predictive Control
    Tram, Tommy
    Batkovic, Ivo
    Ali, Mohammad
    Sjoberg, Jonas
    [J]. 2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 3263 - 3268
  • [7] PREDICTIVE CONTROL OF DIFFERENTIAL DRIVE MOBILE ROBOT CONSIDERING DYNAMICS AND KINEMATICS
    Sharma, Rahul K.
    Honc, Daniel
    Dusek, Frantisek
    [J]. PROCEEDINGS - 30TH EUROPEAN CONFERENCE ON MODELLING AND SIMULATION ECMS 2016, 2016, : 354 - 360
  • [8] Dynamic Goal Tracking for Differential Drive Robot Using Deep Reinforcement Learning
    Shahid, Mahrukh
    Khan, Semab Naimat
    Iqbal, Khawaja Fahad
    Ali, Sara
    Ayaz, Yasar
    [J]. NEURAL PROCESSING LETTERS, 2023, 55 (08) : 11559 - 11576
  • [9] Deep Reinforcement Learning Based Collision Avoidance Algorithm for Differential Drive Robot
    Lu, Xinglong
    Cao, Yiwen
    Zhao, Zhonghua
    Yan, Yilin
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2018), PT I, 2018, 10984 : 186 - 198
  • [10] Dynamic Goal Tracking for Differential Drive Robot Using Deep Reinforcement Learning
    Mahrukh Shahid
    Semab Naimat Khan
    Khawaja Fahad Iqbal
    Sara Ali
    Yasar Ayaz
    [J]. Neural Processing Letters, 2023, 55 : 11559 - 11576