Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming

被引：333
|
作者：
Wang, Ding [1 ]
Liu, Derong [1 ]
Wei, Qinglai [1 ]
Zhao, Dongbin [1 ]
Jin, Ning [2 ]
机构：
[1] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[2] Univ Illinois, Dept Elect & Comp Engn, Chicago, IL 60607 USA
来源：
AUTOMATICA | 2012年 / 48卷 / 08期
基金：
北京市自然科学基金; 中国国家自然科学基金;
关键词：
Adaptive critic designs; Adaptive dynamic programming; Approximate dynamic programming; Globalized dual heuristic programming; Intelligent control; Neural network; Optimal control; FEEDBACK-CONTROL; REINFORCEMENT; ADP;
D O I：
10.1016/j.automatica.2012.05.049
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
An intelligent-optimal control scheme for unknown nonaffine nonlinear discrete-time systems with discount factor in the cost function is developed in this paper. The iterative adaptive dynamic programming algorithm is introduced to solve the optimal control problem with convergence analysis. Then, the implementation of the iterative algorithm via globalized dual heuristic programming technique is presented by using three neural networks, which will approximate at each iteration the cost function, the control law, and the unknown nonlinear system, respectively. In addition, two simulation examples are provided to verify the effectiveness of the developed optimal control approach. (C) 2012 Elsevier Ltd. All rights reserved.
引用
收藏
页码：1825 / 1832
页数：8
相关论文
共 50 条
  • [31] Twin Deterministic Policy Gradient Adaptive Dynamic Programming for Optimal Control of Affine Nonlinear Discrete-time Systems
    Jiahui Xu
    Jingcheng Wang
    Jun Rao
    Yanjiu Zhong
    Shangwei Zhao
    [J]. International Journal of Control, Automation and Systems, 2022, 20 : 3098 - 3109
  • [32] Adaptive Dynamic Programming for Finite-Horizon Optimal Control of Discrete-Time Nonlinear Systems with ε-Error Bound
    Wang, Fei-Yue
    Jin, Ning
    Liu, Derong
    Wei, Qinglai
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (01): : 24 - 36
  • [33] Optimal output tracking control of linear discrete-time systems with unknown dynamics by adaptive dynamic programming and output feedback
    Cai, Xuan
    Wang, Chaoli
    Liu, Shuxin
    Chen, Guochu
    Wang, Gang
    [J]. INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2022, 53 (16) : 3426 - 3448
  • [34] Online optimal control of nonlinear discrete-time systems using approximate dynamic programming
    Travis DIERKS
    Sarangapani JAGANNATHAN
    [J]. Control Theory and Technology, 2011, 9 (03) : 361 - 369
  • [35] Online optimal control of nonlinear discrete-time systems using approximate dynamic programming
    Dierks T.
    Jagannathan S.
    [J]. Journal of Control Theory and Applications, 2011, 9 (3): : 361 - 369
  • [36] Optimal Tracking Control for a Class of Nonlinear Discrete-Time Systems with Time Delays Based on Heuristic Dynamic Programming
    Zhang, Huaguang
    Song, Ruizhuo
    Wei, Qinglai
    Zhang, Tieyan
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (12): : 1851 - 1862
  • [37] Adaptive Event-Triggered Control Based on Heuristic Dynamic Programming for Nonlinear Discrete-Time Systems
    Dong, Lu
    Zhong, Xiangnan
    Sun, Changyin
    He, Haibo
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (07) : 1594 - 1605
  • [38] Design of Fuzzy Adaptive Iterative Learning Control for Nonaffine Nonlinear Discrete-Time Systems
    Chien, Chiang-Ju
    Wang, Ying-Chung
    Shen, Dong
    Chi, Ronghu
    [J]. 2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 3218 - 3223
  • [39] Stable Adaptive Neural Network Control of MIMO Nonaffine Nonlinear Discrete-Time Systems
    Zhai, Lianfei
    Chai, Tianyou
    Yang, Chenguang
    Ge, Shuzhi Sam
    Lee, Tong Heng
    [J]. 47TH IEEE CONFERENCE ON DECISION AND CONTROL, 2008 (CDC 2008), 2008, : 3646 - 3651
  • [40] Adaptive dynamic programming for optimal control of discrete-time nonlinear system with state constraints based on control barrier function
    Xu, Jiahui
    Wang, Jingcheng
    Rao, Jun
    Zhong, Yanjiu
    Wang, Hongyuan
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2022, 32 (06) : 3408 - 3424
12345