Reinforcement learning control of a single-link flexible robotic manipulator

被引:60
|
作者
Ouyang, Yuncheng [1 ,2 ]
He, Wei [3 ]
Li, Xiajing [4 ]
机构
[1] Univ Elect Sci & Technol China, Sch Automat Engn, Chengdu 611731, Peoples R China
[2] Univ Elect Sci & Technol China, Ctr Robot, Chengdu 611731, Peoples R China
[3] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
[4] Delft Univ Technol, Delft Ctr Syst & Control, NL-2628 CD Delft, Netherlands
来源
IET CONTROL THEORY AND APPLICATIONS | 2017年 / 11卷 / 09期
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
flexible manipulators; learning (artificial intelligence); manipulator kinematics; vibration control; lightweight structures; radial basis function networks; stability; Lyapunov methods; reinforcement learning control; single-link flexible robotic manipulator; lightweight structure; Lagrange equation; radial basis function neural networks; actor NN; system stability; Lyapunov direct method; Matlab simulation; Quanser flexible link platform; ADAPTIVE TRACKING CONTROL; VIBRATION CONTROL; FEEDBACK-CONTROL; STABILITY ANALYSIS; NONLINEAR-SYSTEMS; RESONANT CONTROL; CONSTRAINT; DESIGN; PARAMETERS; NETWORKS;
D O I
10.1049/iet-cta.2016.1540
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this study, the authors focus on the reinforcement learning control of a single-link flexible manipulator and attempt to suppress the vibration due to its flexibility and lightweight structure. The assumed mode method and the Lagrange's equation are adopted in modelling to enhance the satisfaction of precision. Two radial basis function neural networks (NNs) are employed in the designed control algorithm, actor NN for generating a policy and critic NN for evaluating the cost-to-go. Rigorous stability of the system has been proven via Lyapunov's direct method. Through Matlab simulation and experiment on the Quanser flexible link platform, the superiority and feasibility of the reinforcement learning control are verified.
引用
收藏
页码:1426 / 1433
页数:8
相关论文
共 50 条
  • [1] Vibration Control Based on Reinforcement Learning for a Single-link Flexible Robotic Manipulator
    Ouyang, Yuncheng
    He, Wei
    Li, Xiajing
    Liu, Jin-Kun
    Li, Guang
    [J]. IFAC PAPERSONLINE, 2017, 50 (01): : 3476 - 3481
  • [2] GPE control for a single-link flexible manipulator
    Becedas, J.
    Feliu, V.
    Sira-Ramirez, H.
    [J]. WCECS 2007: WORLD CONGRESS ON ENGINEERING AND COMPUTER SCIENCE, 2007, : 891 - 896
  • [3] Adaptive Control of a Single-Link Flexible Manipulator
    Feliu, Vincente
    Rattan, Kuldip S.
    Brown, H. Benjamin, Jr.
    [J]. IEEE CONTROL SYSTEMS MAGAZINE, 1990, 10 (02): : 29 - 33
  • [4] Fractional control of a single-link flexible manipulator
    Feliu, Vicente
    Vinagre, Bias M.
    Monje, Concepcion A.
    [J]. PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, VOL 6, PTS A-C, 2005, : 1563 - 1572
  • [5] Resonant Control of a Single-Link Flexible Manipulator
    Abdullahi, Auwalu M.
    Mohamed, Z.
    Nafea, Marwan M.
    [J]. JURNAL TEKNOLOGI, 2014, 67 (05):
  • [6] Development of a robust controller and observer for the control of a single-link flexible robotic manipulator
    Chalhoub, N. G.
    Kfoury, G. A.
    Bazzi, B. A.
    [J]. PROCEEDINGS OF THE ASME DYNAMIC SYSTEMS AND CONTROL DIVISION 2005, PTS A AND B, 2005, : 1437 - 1446
  • [7] Modelling and H∞ control of a single-link flexible manipulator
    Sutton, RP
    Halikias, GD
    Plummer, AR
    Wilson, DA
    [J]. PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART I-JOURNAL OF SYSTEMS AND CONTROL ENGINEERING, 1999, 213 (I2) : 85 - 104
  • [8] Generalized Predictive Control for a Flexible Single-Link Manipulator
    Boucetta, Rahma
    [J]. COMPUTER INFORMATION SYSTEMS AND INDUSTRIAL MANAGEMENT, CISIM 2013, 2013, 8104 : 499 - 510
  • [9] Vibration control of a single-link flexible composite manipulator
    Yavuz, S.
    Malgaca, L.
    Karagulle, H.
    [J]. COMPOSITE STRUCTURES, 2016, 140 : 684 - 691
  • [10] Design of robust controllers and a nonlinear observer for the control of a single-link flexible robotic manipulator
    Chalhoub, NG
    Kfoury, GA
    Bazzi, BA
    [J]. JOURNAL OF SOUND AND VIBRATION, 2006, 291 (1-2) : 437 - 461