Natural Residual Reinforcement Learning for Bicycle Robot Control

被引:4
|
作者
Zhu, Xianjin [1 ]
Zheng, Xudong [3 ]
Zhang, Qiyuan [1 ]
Chen, Zhang [2 ]
Liu, Yu [1 ]
Liang, Bin [2 ]
机构
[1] Harbin Inst Technol, Dept Mech & Elect Engn, 92 Xidazhi St, Harbin, Heilongjiang, Peoples R China
[2] Tsinghua Univ, Dept Automat, 30 Shuangqing Rd, Beijing, Peoples R China
[3] Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, 2279 Lishui Rd, Shenzhen, Peoples R China
基金
中国国家自然科学基金;
关键词
NRRL algorithm; bicycle robot; balance control; path tracking;
D O I
10.1109/ICMA52036.2021.9512587
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work focuses on motion control of the bicycle robot by using the proposed NRRL algorithm. Unlike the traditional RL algorithm, decomposing the main tasks into subtasks manually and introducing qualitative prior knowledge to the agent have been applied in the NRRL algorithm. Simulation results show that better performance and better sample efficiency of the proposed NRRL algorithm have been achieved in terms of balance control and path tracking of bicycle robot. It's believed that the NRRL algorithm is available on the real physical bicycle robot, and the deployment of the algorithm will be realized soon, as the real physical bicycle robot has been constructed currently.
引用
收藏
页码:1201 / 1206
页数:6
相关论文
共 50 条
  • [1] Residual Reinforcement Learning for Robot Control
    Johannink, Tobias
    Bahl, Shikhar
    Nair, Ashvin
    Luo, Jianlan
    Kumar, Avinash
    Loskyll, Matthias
    Ojea, Juan Aparicio
    Solowjow, Eugen
    Levine, Sergey
    [J]. 2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 6023 - 6029
  • [2] Research on Robot Massage Force Control Based on Residual Reinforcement Learning
    Xiao, Meng
    Zhang, Tie
    Zou, Yanbiao
    Chen, Shouyan
    Wu, Wen
    [J]. IEEE ACCESS, 2024, 12 : 18270 - 18279
  • [3] Reinforcement learning for robot control
    Smart, WD
    Kaelbling, LP
    [J]. MOBILE ROBOTS XVI, 2002, 4573 : 92 - 103
  • [4] Combined control algorithm based on synchronous reinforcement learning for a self-balancing bicycle robot
    Guo, Lei
    Lin, Hongyu
    Jiang, Jiale
    Song, Yuan
    Gan, Dongming
    [J]. ISA TRANSACTIONS, 2024, 145 : 479 - 492
  • [5] Residual Reinforcement Learning for Motion Control of a Bionic Exploration Robot-RoboDact
    Zhang, Tiandong
    Wang, Rui
    Wang, Shuo
    Wang, Yu
    Zheng, Gang
    Tan, Min
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [6] Natural policy gradient reinforcement learning for a CPG control of a biped robot
    Nakamura, Y
    Mori, T
    Ishii, S
    [J]. PARALLEL PROBLEM SOLVING FROM NATURE - PPSN VIII, 2004, 3242 : 972 - 981
  • [7] A Reinforcement Learning Approach for Continuum Robot Control
    Turhan Can Kargin
    Jakub Kołota
    [J]. Journal of Intelligent & Robotic Systems, 2023, 109
  • [8] Application of reinforcement learning to dexterous robot control
    Bucak, IO
    Zohdy, MA
    [J]. PROCEEDINGS OF THE 1998 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 1998, : 1405 - 1409
  • [9] Reinforcement Learning based Control of a Quadruped Robot
    Ancy, A.
    Jisha, V. R.
    [J]. 2022 IEEE 19TH INDIA COUNCIL INTERNATIONAL CONFERENCE, INDICON, 2022,
  • [10] Robot Control Optimization Using Reinforcement Learning
    Kai-Tai Song
    Wen-Yu Sun
    [J]. Journal of Intelligent and Robotic Systems, 1998, 21 : 221 - 238