Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming

被引：333
|
作者：
Wang, Ding [1 ]
Liu, Derong [1 ]
Wei, Qinglai [1 ]
Zhao, Dongbin [1 ]
Jin, Ning [2 ]
机构：
[1] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[2] Univ Illinois, Dept Elect & Comp Engn, Chicago, IL 60607 USA
来源：
AUTOMATICA | 2012年 / 48卷 / 08期
基金：
北京市自然科学基金; 中国国家自然科学基金;
关键词：
Adaptive critic designs; Adaptive dynamic programming; Approximate dynamic programming; Globalized dual heuristic programming; Intelligent control; Neural network; Optimal control; FEEDBACK-CONTROL; REINFORCEMENT; ADP;
D O I：
10.1016/j.automatica.2012.05.049
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
An intelligent-optimal control scheme for unknown nonaffine nonlinear discrete-time systems with discount factor in the cost function is developed in this paper. The iterative adaptive dynamic programming algorithm is introduced to solve the optimal control problem with convergence analysis. Then, the implementation of the iterative algorithm via globalized dual heuristic programming technique is presented by using three neural networks, which will approximate at each iteration the cost function, the control law, and the unknown nonlinear system, respectively. In addition, two simulation examples are provided to verify the effectiveness of the developed optimal control approach. (C) 2012 Elsevier Ltd. All rights reserved.
引用
收藏
页码：1825 / 1832
页数：8
相关论文
共 50 条
  • [1] Adaptive dynamic programming-based optimal control of unknown nonaffine nonlinear discrete-time systems with proof of convergence
    Zhang, Xin
    Zhang, Huaguang
    Sun, Qiuye
    Luo, Yanhong
    [J]. NEUROCOMPUTING, 2012, 91 : 48 - 55
  • [2] Optimal Control of Nonaffine Nonlinear Discrete-Time Systems Using Kernel-based Adaptive Dynamic Programming
    Tan, Fuxiao
    Liu, Zhongrui
    Yang, Tongtong
    [J]. 2015 5TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST), 2015, : 588 - 593
  • [3] Adaptive Dynamic Programming-based Optimal Control of Unknown Affine Nonlinear Discrete-time Systems
    Dierks, Travis
    Thumati, Balaje T.
    Jagannathan, S.
    [J]. IJCNN: 2009 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1- 6, 2009, : 1368 - 1373
  • [4] Online optimal control of unknown discrete-time nonlinear systems by using time-based adaptive dynamic programming
    Xiao, Geyang
    Zhang, Huaguang
    Luo, Yanhong
    [J]. NEUROCOMPUTING, 2015, 165 : 163 - 170
  • [5] Optimal Control for Unknown Discrete-Time Nonlinear Markov Jump Systems Using Adaptive Dynamic Programming
    Zhong, Xiangnan
    He, Haibo
    Zhang, Huaguang
    Wang, Zhanshan
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (12) : 2141 - 2155
  • [6] An iterative adaptive dynamic programming algorithm for optimal control of unknown discrete-time nonlinear systems with constrained inputs
    Liu, Derong
    Wang, Ding
    Yang, Xiong
    [J]. INFORMATION SCIENCES, 2013, 220 : 331 - 342
  • [7] Feedback-linearization-based neural adaptive control for unknown nonaffine nonlinear discrete-time systems
    Deng, Hua
    Li, Han-Xiong
    Wu, Yi-Hu
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (09): : 1615 - 1625
  • [8] Adaptive dynamic programming and optimal control of nonlinear nonaffine systems
    Bian, Tao
    Jiang, Yu
    Jiang, Zhong-Ping
    [J]. AUTOMATICA, 2014, 50 (10) : 2624 - 2632
  • [9] Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems
    Wei, Qinglai
    Liu, Derong
    Lin, Hanquan
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (03) : 840 - 853
  • [10] H∞ Control of Unknown Discrete-Time Nonlinear Systems with Control Constraints Using Adaptive Dynamic Programming
    Liu, Derong
    Li, Hongliang
    Wang, Ding
    [J]. 2012 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2012,
12345