MODEL-FREE ONLINE REINFORCEMENT LEARNING OF A ROBOTIC MANIPULATOR

被引:3
|
作者
Sweafford, Jerry, Jr. [1 ]
Fahimi, Farbod [1 ]
机构
[1] UAH, Dept Mech & Aerosp Engn MAE, Huntsville, AL 35899 USA
来源
MECHATRONIC SYSTEMS AND CONTROL | 2019年 / 47卷 / 03期
关键词
Reinforcement learning; neural networks; trajectory tracking; model-free; control; robotic manipulator; NONLINEAR-SYSTEMS; CONTROLLER; DESIGN;
D O I
10.2316/J.2019.201-2931
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For robotic systems that do not have joint torques as direct inputs, the computed torque approach, often based on a general dynamic model that is linear with respect to joint velocities and accelerations, is very difficult to implement. We have applied a general model-free online reinforcement learning control methodology for discrete nonaffine nonlinear multiple-input-multiple-output systems to a second-order robotic system. The controller produced effective trajectory tracking in simulations of a two-degree-of-freedom robotic arm, and in actual experiments, with a three degree-of-freedom robotic arm.
引用
收藏
页码:136 / 143
页数:8
相关论文
共 50 条
  • [1] Online Nonstochastic Model-Free Reinforcement Learning
    Ghai, Udaya
    Gupta, Arushi
    Xia, Wenhan
    Singh, Karan
    Hazan, Elad
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [2] Robotic Table Tennis with Model-Free Reinforcement Learning
    Gao, Wenbo
    Graesser, Laura
    Choromanski, Krzysztof
    Song, Xingyou
    Lazic, Nevena
    Sanketi, Pannag
    Sindhwani, Vikas
    Jaitly, Navdeep
    [J]. 2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 5556 - 5563
  • [3] Designing a Model-Free Reinforcement Learning Controller for a Flexible-Link Manipulator
    Raoufi, Mona
    Delavari, Hadi
    [J]. 2021 9TH RSI INTERNATIONAL CONFERENCE ON ROBOTICS AND MECHATRONICS (ICROM), 2021, : 1 - 6
  • [4] An online model-free adaptive learning control solution for robotic arms
    Moodi, Mostafa
    Hassanzadeh, Kiavash
    Merapala, Tharun
    Gascon, Vincent
    Abouheaf, Mohammed
    [J]. INTERNATIONAL JOURNAL OF MODELING SIMULATION AND SCIENTIFIC COMPUTING, 2024, 15 (03)
  • [5] A Model-free Deep Reinforcement Learning Approach for Robotic Manipulators Path Planning
    Liu, Wenxing
    Niu, Hanlin
    Mahyuddin, Muhammad Nasiruddin
    Herrmann, Guido
    Carrasco, Joaquin
    [J]. 2021 21ST INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2021), 2021, : 512 - 517
  • [6] Optimizing a Continuum Manipulator's Search Policy Through Model-Free Reinforcement Learning
    Frazelle, Chase
    Rogers, Jonathan
    Karamouzas, Ioannis
    Walker, Ian
    [J]. 2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 5564 - 5571
  • [7] Online model-free reinforcement learning for the automatic control of a flexible wing aircraft
    Abouheaf, Mohammed
    Gueaieb, Wail
    Lewis, Frank
    [J]. IET CONTROL THEORY AND APPLICATIONS, 2020, 14 (01): : 73 - 84
  • [8] Reinforcement Learning-Based Model-Free Controller for Feedback Stabilization of Robotic Systems
    Singh, Rupam
    Bhushan, Bharat
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (10) : 7059 - 7073
  • [9] Learning Representations in Model-Free Hierarchical Reinforcement Learning
    Rafati, Jacob
    Noelle, David C.
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 10009 - 10010
  • [10] Model-Free Quantum Control with Reinforcement Learning
    Sivak, V. V.
    Eickbusch, A.
    Liu, H.
    Royer, B.
    Tsioutsios, I
    Devoret, M. H.
    [J]. PHYSICAL REVIEW X, 2022, 12 (01):