Data-Based Optimal Tracking Control of Nonaffine Nonlinear Discrete-Time Systems

被引:0
|
作者
Luo, Biao [1 ]
Liu, Derong [2 ]
Huang, Tingwen [3 ]
Li, Chao [1 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
[3] Texas A&M Univ Qatar, POB 23874, Doha, Qatar
关键词
Optimal tracking control; Data-based; Q-learning; Critic-only; H-INFINITY CONTROL; LINEAR-SYSTEMS; CONTROL SCHEME; APPROXIMATION; ITERATION;
D O I
10.1007/978-3-319-46681-1_68
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The optimal tracking control problem of nonaffine nonlinear discrete-time systems is considered in this paper. The problem relies on the solution of the so-called tracking Hamilton-Jacobi-Bellman equation, which is extremely difficult to be solved even for simple systems. To overcome this difficulty, the data-based Q-learning algorithm is proposed by learning the optimal tracking control policy from data of the practical system. For its implementation purpose, the critic-only neural network structure is developed, where only critic neural network is required to estimate the Q-function and the least-square scheme is employed to update the weight of neural network.
引用
收藏
页码:573 / 581
页数:9
相关论文
共 50 条
  • [21] Internal Model Based Optimal Tracking Control for Nonlinear Discrete-time Systems with Sinusoidal Disturbances
    Wang Haihong
    Sun Liang
    PROCEEDINGS OF THE 27TH CHINESE CONTROL CONFERENCE, VOL 2, 2008, : 403 - +
  • [22] An Adaptive Terminal Iterative Learning Control for Nonaffine Nonlinear Discrete-Time Systems
    Chien, Chiang-Ju
    Wang, Ying-Chung
    Chi, Ronghu
    Shen, Dong
    2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 1090 - 1094
  • [23] Predictive compensation based quantization iterative learning control for nonlinear nonaffine discrete-time systems
    Zhang, Huimin
    Chi, Ronghu
    Huang, Biao
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2023, 33 (07) : 4028 - 4055
  • [24] Adaptive Neuro-Fuzzy Control for Discrete-Time Nonaffine Nonlinear Systems
    Gil, Paulo
    Oliveira, Tiago
    Palma, Luis
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2019, 27 (08) : 1602 - 1615
  • [25] Data-based robust optimal control of discrete-time systems with uncertainties via adaptive dynamic programming
    Liu, Yang
    Xing, Zuoxia
    Chen, Zhe
    Xu, Jian
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2023, 44 (03): : 1290 - 1304
  • [26] Adaptive NN Tracking Control of Uncertain Nonlinear Discrete-Time Systems With Nonaffine Dead-Zone Input
    Liu, Yan-Jun
    Tong, Shaocheng
    IEEE TRANSACTIONS ON CYBERNETICS, 2015, 45 (03) : 497 - 505
  • [27] Optimal Tracking Control for a Class of Nonlinear Discrete-Time Systems with Time Delays Based on Heuristic Dynamic Programming
    Zhang, Huaguang
    Song, Ruizhuo
    Wei, Qinglai
    Zhang, Tieyan
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (12): : 1851 - 1862
  • [28] Optimal Control of Affine Nonlinear Discrete-time Systems
    Dierks, Travis
    Jagannthan, S.
    MED: 2009 17TH MEDITERRANEAN CONFERENCE ON CONTROL & AUTOMATION, VOLS 1-3, 2009, : 1390 - 1395
  • [29] Adaptive Optimal Control for Nonlinear Discrete-Time Systems
    Qin, Chunbin
    Zhang, Huaguang
    Luo, Yanhong
    PROCEEDINGS OF THE 2013 IEEE SYMPOSIUM ON ADAPTIVE DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING (ADPRL), 2013, : 13 - 18
  • [30] Optimal discrete-time control for nonlinear cascade systems
    Haddad, WM
    Fausz, JL
    Chellaboina, V
    Abdallah, CT
    PROCEEDINGS OF THE 1997 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 1997, : 2175 - 2176