Reinforcement Learning-Based Predefined-Time Tracking Control for Nonlinear Systems Under Identifier-Critic-Actor Structure

被引:0
|
作者
Wang, Jing [1 ,2 ]
Zhao, Wei [1 ,2 ]
Cao, Jinde [3 ]
Park, Ju H. [4 ]
Shen, Hao [1 ,2 ]
机构
[1] Anhui Univ Technol, Sch Elect & Informat Engn, Maanshan 243002, Peoples R China
[2] Anhui Univ Technol, Anhui Prov Key Lab Power Elect & Mot Control, Maanshan 243002, Peoples R China
[3] Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
[4] Yeungnam Univ, Dept Elect Engn, Gyongsan 38541, South Korea
基金
新加坡国家研究基金会; 中国国家自然科学基金;
关键词
External disturbances; nonlinear systems; predefined-time control (PTC); prescribed performance; reinforcement learning (RL);
D O I
10.1109/TCYB.2024.3431670
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A novel reinforcement learning-based predefined-time tracking control scheme with prescribed performance is presented in this article for nonlinear systems in the presence of external disturbances. First, by employing the backstepping strategy, an adaptive optimized controller is developed under the identifier-critic-actor framework. Therein, the unknown nonlinear dynamics and the system control behavior can be learned effectively through neural networks. Moreover, aiming at obtaining the preset tracking performance, the prescribed performance control is integrated with the predefined-time control. In contrast to previous studies, the proposed scheme can not only constrain the tracking error rapidly to a prearranged vicinity of origin, but also ensure that the upper bound of convergence time can be adjusted in advance via a separate control parameter. In terms of the predefined-time stability theory, the boundedness of all system states can be proven within a predefined time. Finally, the availability and improved performances of the proposed control scheme are demonstrated by a numerical example and a single-link manipulator example.
引用
收藏
页码:6345 / 6357
页数:13
相关论文
共 50 条
  • [1] Reinforcement learning-based adaptive predefined-time optimal tracking control for strict-feedback nonlinear systems
    Chen, Yilin
    Pan, Yingnan
    Lu, Qing
    [J]. INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2024, 38 (02) : 492 - 512
  • [2] Reinforcement Learning-Based Event-Triggered Predefined-Time Optimal Fuzzy Control for Nonlinear Constrained Systems
    Song, Xiaona
    Sun, Peng
    Ahn, Choon Ki
    Song, Shuai
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2024, 32 (08) : 4646 - 4659
  • [3] Actor-Critic-Based Predefined-Time Fuzzy Adaptive Optimal Control for Uncertain Nonlinear Systems With Input Saturation
    Yang, Wei
    Wang, Qing-Guo
    Liu, Jiapeng
    Yu, Jinpeng
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2024, 32 (04) : 2448 - 2457
  • [4] Optimal control of unknown nonlinear system under event-triggered mechanism and identifier-critic-actor architecture
    Liu, Ning
    Zhang, Kun
    Xie, Xiangpeng
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2023, 34 (01) : 530 - 550
  • [5] Predefined-Time Event-Triggered Tracking Control for Nonlinear Servo Systems: A Fuzzy Weight-Based Reinforcement Learning Scheme
    Shen, Hao
    Zhao, Wei
    Cao, Jinde
    Park, Ju H.
    Wang, Jing
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2024, 32 (08) : 4557 - 4569
  • [6] Predefined-time adaptive fuzzy tracking control for switched nonlinear systems
    Jin, Yitong
    Wang, Fang
    Zhao, Maoxian
    [J]. ASIAN JOURNAL OF CONTROL, 2024, 26 (04) : 1927 - 1938
  • [7] Predefined-time tracking control of spacecraft based on learning observer
    Cao, Teng
    Gong, Hua-Jun
    Xue, Yi-Xuan
    Xiao, Hui-Yunuo
    [J]. Kongzhi yu Juece/Control and Decision, 2024, 39 (02): : 519 - 526
  • [8] Predefined-Time Adaptive Neural Tracking Control of Switched Nonlinear Systems
    Wang, Huanqing
    Tong, Miao
    Zhao, Xudong
    Niu, Ben
    Yang, Man
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (10) : 6538 - 6548
  • [9] Predefined-time tracking control of multiplicative systems
    Munoz-Vazquez, Aldo Jonathan
    Sanchez-Torres, Juan Diego
    Fernandez-Anaya, Guillermo
    Martinez-Fuentes, Oscar
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (13) : 8581 - 8589
  • [10] Predefined-time tracking control for high-order nonlinear systems with control saturation
    Gong, Youmin
    Guo, Yanning
    Li, Dongyu
    Ma, Guangfu
    Ran, Guangtao
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2022, 32 (11) : 6218 - 6235