Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming

被引：333
|
作者：
Wang, Ding [1 ]
Liu, Derong [1 ]
Wei, Qinglai [1 ]
Zhao, Dongbin [1 ]
Jin, Ning [2 ]
机构：
[1] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[2] Univ Illinois, Dept Elect & Comp Engn, Chicago, IL 60607 USA
来源：
AUTOMATICA | 2012年 / 48卷 / 08期
基金：
北京市自然科学基金; 中国国家自然科学基金;
关键词：
Adaptive critic designs; Adaptive dynamic programming; Approximate dynamic programming; Globalized dual heuristic programming; Intelligent control; Neural network; Optimal control; FEEDBACK-CONTROL; REINFORCEMENT; ADP;
D O I：
10.1016/j.automatica.2012.05.049
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
An intelligent-optimal control scheme for unknown nonaffine nonlinear discrete-time systems with discount factor in the cost function is developed in this paper. The iterative adaptive dynamic programming algorithm is introduced to solve the optimal control problem with convergence analysis. Then, the implementation of the iterative algorithm via globalized dual heuristic programming technique is presented by using three neural networks, which will approximate at each iteration the cost function, the control law, and the unknown nonlinear system, respectively. In addition, two simulation examples are provided to verify the effectiveness of the developed optimal control approach. (C) 2012 Elsevier Ltd. All rights reserved.
引用
收藏
页码：1825 / 1832
页数：8
相关论文
共 50 条
  • [21] Optimal Learning Control for Discrete-Time Nonlinear Systems Using Generalized Policy Iteration Based Adaptive Dynamic Programming
    Wei, Qinglai
    Liu, Derong
    [J]. 2014 11TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2014, : 1781 - 1786
  • [22] Adaptive Optimal Control for Nonlinear Discrete-Time Systems
    Qin, Chunbin
    Zhang, Huaguang
    Luo, Yanhong
    [J]. PROCEEDINGS OF THE 2013 IEEE SYMPOSIUM ON ADAPTIVE DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING (ADPRL), 2013, : 13 - 18
  • [23] Invariant Adaptive Dynamic Programming for Discrete-Time Optimal Control
    Zhu, Yuanheng
    Zhao, Dongbin
    He, Haibo
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2020, 50 (11): : 3959 - 3971
  • [24] Adaptive Neuro-Fuzzy Control for Discrete-Time Nonaffine Nonlinear Systems
    Gil, Paulo
    Oliveira, Tiago
    Palma, Luis
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2019, 27 (08) : 1602 - 1615
  • [25] Adaptive Dynamic Programming for Discrete-time LQR Optimal Tracking Control Problems with Unknown Dynamics
    Liu, Yang
    Luo, Yanhong
    Zhang, Huaguang
    [J]. 2014 IEEE SYMPOSIUM ON ADAPTIVE DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING (ADPRL), 2014, : 212 - 217
  • [26] Model-Free Adaptive Control for Unknown MIMO Nonaffine Nonlinear Discrete-Time Systems With Experimental Validation
    Xiong, Shuangshuang
    Hou, Zhongsheng
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (04) : 1727 - 1739
  • [27] MRAC for unknown discrete-time nonlinear systems based on supervised neural dynamic programming
    Fu, Hao
    Chen, Xin
    Wang, Wei
    Wu, Min
    [J]. NEUROCOMPUTING, 2020, 384 : 130 - 141
  • [28] A discrete-time multivariable neuro-adaptive control for nonlinear unknown dynamic systems
    Hwang, CL
    Lin, CH
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2000, 30 (06): : 865 - 877
  • [29] Twin Deterministic Policy Gradient Adaptive Dynamic Programming for Optimal Control of Affine Nonlinear Discrete-time Systems
    Xu, Jiahui
    Wang, Jingcheng
    Rao, Jun
    Zhong, Yanjiu
    Zhao, Shangwei
    [J]. INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2022, 20 (09) : 3098 - 3109
  • [30] Policy Optimization Adaptive Dynamic Programming for Optimal Control of Input-Affine Discrete-Time Nonlinear Systems
    Lin, Mingduo
    Zhao, Bo
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (07): : 4339 - 4350
12345