Reinforcement Learning-Based Predefined-Time Tracking Control for Nonlinear Systems Under Identifier-Critic-Actor Structure

被引:0
|
作者
Wang, Jing [1 ,2 ]
Zhao, Wei [1 ,2 ]
Cao, Jinde [3 ]
Park, Ju H. [4 ]
Shen, Hao [1 ,2 ]
机构
[1] Anhui Univ Technol, Sch Elect & Informat Engn, Maanshan 243002, Peoples R China
[2] Anhui Univ Technol, Anhui Prov Key Lab Power Elect & Mot Control, Maanshan 243002, Peoples R China
[3] Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
[4] Yeungnam Univ, Dept Elect Engn, Gyongsan 38541, South Korea
基金
新加坡国家研究基金会; 中国国家自然科学基金;
关键词
External disturbances; nonlinear systems; predefined-time control (PTC); prescribed performance; reinforcement learning (RL);
D O I
10.1109/TCYB.2024.3431670
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A novel reinforcement learning-based predefined-time tracking control scheme with prescribed performance is presented in this article for nonlinear systems in the presence of external disturbances. First, by employing the backstepping strategy, an adaptive optimized controller is developed under the identifier-critic-actor framework. Therein, the unknown nonlinear dynamics and the system control behavior can be learned effectively through neural networks. Moreover, aiming at obtaining the preset tracking performance, the prescribed performance control is integrated with the predefined-time control. In contrast to previous studies, the proposed scheme can not only constrain the tracking error rapidly to a prearranged vicinity of origin, but also ensure that the upper bound of convergence time can be adjusted in advance via a separate control parameter. In terms of the predefined-time stability theory, the boundedness of all system states can be proven within a predefined time. Finally, the availability and improved performances of the proposed control scheme are demonstrated by a numerical example and a single-link manipulator example.
引用
收藏
页码:6345 / 6357
页数:13
相关论文
共 50 条
  • [31] Predefined-time adaptive robust control of a class of nonlinear singular systems
    Liu, Xiaotong
    Yang, Renming
    [J]. PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART I-JOURNAL OF SYSTEMS AND CONTROL ENGINEERING, 2024,
  • [32] Adaptive Identifier-Critic-Based Optimal Tracking Control for Nonlinear Systems With Experimental Validation
    Na, Jing
    Lv, Yongfeng
    Zhang, Kaiqiang
    Zhao, Jun
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (01): : 459 - 472
  • [33] Adaptive Identifier-Critic-Based Optimal Tracking Control for Nonlinear Systems with Experimental Validation
    Na, Jing
    Lv, Yongfeng
    Zhang, Kaiqiang
    Zhao, Jun
    [J]. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2022, 52 (01) : 459 - 472
  • [34] Asymptotic tracking by a reinforcement learning-based adaptive critic controller
    Bhasin S.
    Sharma N.
    Patre P.
    Dixon W.
    [J]. Journal of Control Theory and Applications, 2011, 9 (3): : 400 - 409
  • [35] Asymptotic tracking by a reinforcement learning-based adaptive critic controller
    Shubhendu BHASIN
    Nitin SHARMA
    Parag PATRE
    Warren DIXON
    [J]. Control Theory and Technology, 2011, 9 (03) : 400 - 409
  • [36] Optimal synchronized control of nonlinear coupled harmonic oscillators based on actor–critic reinforcement learning
    Zhiyang Gu
    Chengli Fan
    Dengxiu Yu
    Zhen Wang
    [J]. Nonlinear Dynamics, 2023, 111 : 21051 - 21064
  • [37] A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems
    Bhasin, S.
    Kamalapurkar, R.
    Johnson, M.
    Vamvoudakis, K. G.
    Lewis, F. L.
    Dixon, W. E.
    [J]. AUTOMATICA, 2013, 49 (01) : 82 - 92
  • [38] Adaptive Predefined-Time Synchronization and Tracking Control for Multimotor Driving Servo Systems
    Hu, Shuangyi
    Chen, Qiang
    Ren, Xuemei
    Wang, Shubo
    [J]. IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2024,
  • [39] Predefined-time control of nonlinear systems: A sigmoid function based sliding manifold design approach
    Mazhar, Naveed
    Malik, Fahad Mumtaz
    Raza, Abid
    Khan, Rameez
    [J]. ALEXANDRIA ENGINEERING JOURNAL, 2022, 61 (09) : 6831 - 6841
  • [40] Predefined-time adaptive neural dynamic surface tracking control for high-order nonlinear switched systems
    Meng, Zhu
    Ma, Jiawei
    Wang, Huanqing
    [J]. ASIAN JOURNAL OF CONTROL, 2024,