Reinforcement Learning-Based Predefined-Time Tracking Control for Nonlinear Systems Under Identifier-Critic-Actor Structure

被引:0
|
作者
Wang, Jing [1 ,2 ]
Zhao, Wei [1 ,2 ]
Cao, Jinde [3 ]
Park, Ju H. [4 ]
Shen, Hao [1 ,2 ]
机构
[1] Anhui Univ Technol, Sch Elect & Informat Engn, Maanshan 243002, Peoples R China
[2] Anhui Univ Technol, Anhui Prov Key Lab Power Elect & Mot Control, Maanshan 243002, Peoples R China
[3] Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
[4] Yeungnam Univ, Dept Elect Engn, Gyongsan 38541, South Korea
基金
新加坡国家研究基金会; 中国国家自然科学基金;
关键词
External disturbances; nonlinear systems; predefined-time control (PTC); prescribed performance; reinforcement learning (RL);
D O I
10.1109/TCYB.2024.3431670
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A novel reinforcement learning-based predefined-time tracking control scheme with prescribed performance is presented in this article for nonlinear systems in the presence of external disturbances. First, by employing the backstepping strategy, an adaptive optimized controller is developed under the identifier-critic-actor framework. Therein, the unknown nonlinear dynamics and the system control behavior can be learned effectively through neural networks. Moreover, aiming at obtaining the preset tracking performance, the prescribed performance control is integrated with the predefined-time control. In contrast to previous studies, the proposed scheme can not only constrain the tracking error rapidly to a prearranged vicinity of origin, but also ensure that the upper bound of convergence time can be adjusted in advance via a separate control parameter. In terms of the predefined-time stability theory, the boundedness of all system states can be proven within a predefined time. Finally, the availability and improved performances of the proposed control scheme are demonstrated by a numerical example and a single-link manipulator example.
引用
收藏
页码:6345 / 6357
页数:13
相关论文
共 50 条
  • [21] Predefined-time tracking control of a class of nonlinear systems via a novel C∞ performance function
    Li, Jian
    Du, Jialu
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (05) : 3586 - 3601
  • [22] Adaptive fuzzy asymptotic predefined-time tracking control of uncertain nonlinear systems based on event-trigger
    Li, Yebin
    Wang, Dongshu
    Tang, Longkun
    [J]. COMMUNICATIONS IN NONLINEAR SCIENCE AND NUMERICAL SIMULATION, 2024, 137
  • [23] Reinforcement learning-based robust optimal tracking control for disturbed nonlinear systems
    Zhong-Xin Fan
    Lintao Tang
    Shihua Li
    Rongjie Liu
    [J]. Neural Computing and Applications, 2023, 35 : 23987 - 23996
  • [24] Reinforcement learning-based robust optimal tracking control for disturbed nonlinear systems
    Fan, Zhong-Xin
    Tang, Lintao
    Li, Shihua
    Liu, Rongjie
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (33): : 23987 - 23996
  • [25] Predefined-Time Adaptive Neural-Network-Based Consensus Tracking Control for Nonlinear Multiagent Systems With Zero Tracking Error
    Zhang, Yu
    Niu, Ben
    Zhang, Jia-Ming
    Wang, Xia-Mei
    [J]. IEEE ACCESS, 2021, 9 : 132205 - 132214
  • [26] Optimized Multi-Agent Formation Control Based on an Identifier-Actor--Critic Reinforcement Learning Algorithm
    Wen, Guoxing
    Chen, C. L. Philip
    Feng, Jun
    Zhou, Ning
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2018, 26 (05) : 2719 - 2731
  • [27] Actor-critic-based predefined-time control for spacecraft attitude formation system with guaranteeing prescribed performance on SO(3)
    Shi, Xiao-Ning
    Zhou, Di
    Chen, Xinwei
    Zhou, Zhi-Gang
    [J]. AEROSPACE SCIENCE AND TECHNOLOGY, 2021, 117
  • [28] An actor-critic reinforcement learning-based resource management in mobile edge computing systems
    Fu, Fang
    Zhang, Zhicai
    Yu, Fei Richard
    Yan, Qiao
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2020, 11 (08) : 1875 - 1889
  • [29] Online Reinforcement Learning-Based Control of an Active Suspension System Using the Actor Critic Approach
    Fares, Ahmad
    Bani Younes, Ahmad
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (22): : 1 - 13
  • [30] An actor-critic reinforcement learning-based resource management in mobile edge computing systems
    Fang Fu
    Zhicai Zhang
    Fei Richard Yu
    Qiao Yan
    [J]. International Journal of Machine Learning and Cybernetics, 2020, 11 : 1875 - 1889