Adaptive reinforcement learning optimal tracking control for strict-feedback nonlinear systems with prescribed performance

被引:30
|
作者
Huang, Zongsheng [1 ]
Bai, Weiwei [1 ]
Li, Tieshan [1 ,2 ,3 ,5 ,6 ,7 ]
Long, Yue [1 ]
Chen, C. L. Philip [1 ,4 ]
Liang, Hongjing [1 ]
Yang, Hanqing [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Automation Engn, Chengdu 611731, Sichuan, Peoples R China
[2] Univ Elect Sci & Technol China, Yangtze Delta Reg Inst, Huzhou 313000, Peoples R China
[3] Lab Electromagnet Space Cognit & Intelligent Contr, Beijing 100089, Peoples R China
[4] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510641, Guangdong, Peoples R China
[5] Univ Elect Sci & Technol China, Sch Automation Engn, Chengdu 611731, Sichuan, Peoples R China
[6] Univ Elect Sci & Technol China, Yangtze Delta Reg Inst, Huzhou 313000, Peoples R China
[7] Lab Electromagnet Space Cognit & Intelligent Contr, Beijing 100089, Peoples R China
基金
中国国家自然科学基金;
关键词
Reinforcement learning; Prescribed performance control; Adaptive dynamic programming; Tracking control; Strict-feedback nonlinear systems; OPTIMAL-CONTROL DESIGN; NEURAL-CONTROL;
D O I
10.1016/j.ins.2022.11.109
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The reinforcement learning-based prescribed performance optimal tracking control prob-lem is considered for a class of strict-feedback nonlinear systems in this paper. The unknown nonlinearities and cost function are approximated by radial-basis-function (RBF) neural network (NN). The overall controller consists of an adaptive controller and an optimal compensation term. Firstly, the adaptive controller is designed by backstepping control method. Subsequently, the optimal compensation term is derived via policy itera-tion by minimizing cost function. In addition, depending on the prescribed performance control, the tracking error can be limited in the prescribed area. Therefore, the whole con-trol scheme can effectively guarantee that the tracking error converges to a bound with prescribed performance while the cost function is minimized. The stability analysis shows that all signals in the closed-loop system are bounded. Finally, the effectiveness and advan-tages of the designed control strategy are illustrated by the simulation examples.(c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:407 / 423
页数:17
相关论文
共 50 条
  • [1] Adaptive Neural Tracking Control with Prescribed Performance for Strict-feedback Stochastic Nonlinear Systems
    Yan, Xiaohui
    Wu, Qingxian
    Chen, Mou
    Shao, Shuyi
    PROCEEDINGS OF THE 28TH CHINESE CONTROL AND DECISION CONFERENCE (2016 CCDC), 2016, : 1438 - 1443
  • [2] Adaptive prescribed performance tracking control for strict-feedback nonlinear systems with zero dynamics
    Liu, Cungen
    Wang, Huanqing
    Liu, Xiaoping
    Zhou, Yucheng
    Lu, Shouyin
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2019, 29 (18) : 6507 - 6521
  • [3] Learning-Based Adaptive Optimal Tracking Control of Strict-Feedback Nonlinear Systems
    Gao, Weinan
    Jiang, Zhong-Ping
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (06) : 2614 - 2624
  • [4] Reinforcement learning-based adaptive predefined-time optimal tracking control for strict-feedback nonlinear systems
    Chen, Yilin
    Pan, Yingnan
    Lu, Qing
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2024, 38 (02) : 492 - 512
  • [5] Prescribed performance event-triggered fuzzy optimal tracking control for strict-feedback nonlinear systems
    Huang, Zongsheng
    Gao, Xiaoyang
    Li, Tieshan
    Long, Yue
    Yang, Hanqing
    INFORMATION SCIENCES, 2024, 658
  • [6] Adaptive prescribed performance optimal control for strict-feedback nonlinear systems with input delay and input quantization
    Xia, Xiaonan
    Li, Chun
    Zhang, Tianping
    Fang, Yu
    JOURNAL OF THE FRANKLIN INSTITUTE, 2025, 362 (04)
  • [7] Adaptive Fuzzy Tracking Control With Global Prescribed-Time Prescribed Performance for Uncertain Strict-Feedback Nonlinear Systems
    Mao, Bing
    Wu, Xiaoqun
    Liu, Hui
    Xu, Yuhua
    Lu, Jinhu
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (09) : 5217 - 5230
  • [8] Prescribed-time tracking with prescribed performance for a class of strict-feedback nonlinear systems
    Li, Yichen
    Ma, Ruicheng
    Tian, Xiaoyi
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2024, 361 (04):
  • [9] Fuzzy adaptive output-feedback tracking control for nonlinear strict-feedback systems in prescribed finite time
    Yuan, Xu
    Chen, Bing
    Lin, Chong
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2021, 358 (15): : 7309 - 7332
  • [10] Adaptive fuzzy control for strict-feedback canonical nonlinear systems with H∞ tracking performance
    Wang, WY
    Chan, ML
    Lee, TT
    Liu, CH
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2000, 30 (06): : 878 - 885