Adaptive dynamic programming and optimal control of nonlinear nonaffine systems

被引：176
|
作者：
Bian, Tao [1 ]
Jiang, Yu [1 ]
Jiang, Zhong-Ping [1 ]
机构：
[1] NYU, Polytech Sch Engn, Dept Elect & Comp Engn, Control & Networks Lab, Brooklyn, NY 11201 USA
来源：
AUTOMATICA | 2014年 / 50卷 / 10期
基金：
美国国家科学基金会;
关键词：
Adaptive optimal control; Adaptive dynamic programming; Nonaffine systems; CONTINUOUS-TIME; APPROXIMATION;
D O I：
10.1016/j.automatica.2014.08.023
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
In this paper, a novel optimal control design scheme is proposed for continuous-time nonaffine nonlinear dynamic systems with unknown dynamics by adaptive dynamic programming (ADP). The proposed methodology iteratively updates the control policy online by using the state and input information without identifying the system dynamics. An ADP algorithm is developed, and can be applied to a general class of nonlinear control design problems. The convergence analysis for the designed control scheme is presented, along with rigorous stability analysis for the closed-loop system. The effectiveness of this new algorithm is illustrated by two simulation examples. (C) 2014 Elsevier Ltd. All rights reserved.
引用
收藏
页码：2624 / 2632
页数：9
相关论文
共 50 条
  • [1] Adaptive Dynamic Programming for Nonlinear Nonaffine Systems
    Bian, Tao
    Jiang, Yu
    Jiang, Zhong-Ping
    [J]. 2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 3603 - 3608
  • [2] Adaptive dynamic programming for nonaffine nonlinear optimal control problem with state constraints
    Duan, Jingliang
    Liu, Zhengyu
    Li, Shengbo Eben
    Sun, Qi
    Jia, Zhenzhong
    Cheng, Bo
    [J]. NEUROCOMPUTING, 2022, 484 : 128 - 141
  • [3] Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming
    Wang, Ding
    Liu, Derong
    Wei, Qinglai
    Zhao, Dongbin
    Jin, Ning
    [J]. AUTOMATICA, 2012, 48 (08) : 1825 - 1832
  • [4] Optimal Control of Nonaffine Nonlinear Discrete-Time Systems Using Kernel-based Adaptive Dynamic Programming
    Tan, Fuxiao
    Liu, Zhongrui
    Yang, Tongtong
    [J]. 2015 5TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST), 2015, : 588 - 593
  • [5] Adaptive dynamic surface control for uncertain nonaffine nonlinear systems
    Liu, Yong-Hua
    Huang, Liangpei
    Xiao, Dongming
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2017, 27 (04) : 535 - 546
  • [6] Adaptive dynamic programming-based optimal control of unknown nonaffine nonlinear discrete-time systems with proof of convergence
    Zhang, Xin
    Zhang, Huaguang
    Sun, Qiuye
    Luo, Yanhong
    [J]. NEUROCOMPUTING, 2012, 91 : 48 - 55
  • [7] Value Iteration, Adaptive Dynamic Programming, and Optimal Control of Nonlinear Systems
    Bian, Tao
    Jiang, Zhong-Ping
    [J]. 2016 IEEE 55TH CONFERENCE ON DECISION AND CONTROL (CDC), 2016, : 3375 - 3380
  • [8] Nearly finite-horizon optimal control for a class of nonaffine time-delay nonlinear systems based on adaptive dynamic programming
    Song, Ruizhuo
    Wei, Qinglai
    Sun, Qiuye
    [J]. NEUROCOMPUTING, 2015, 156 : 166 - 175
  • [9] Optimal control of nonlinear systems with dynamic programming
    Tawiah, Isaac
    Song, Yinglei
    [J]. INTERNATIONAL JOURNAL OF NONLINEAR SCIENCES AND NUMERICAL SIMULATION, 2021, 22 (02) : 145 - 168
  • [10] An Adaptive Dynamic Programming Algorithm to Solve Optimal Control of Uncertain Nonlinear Systems
    Cui, Xiaohong
    Luo, Yanhong
    Zhang, Huaguang
    [J]. 2014 IEEE SYMPOSIUM ON ADAPTIVE DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING (ADPRL), 2014, : 259 - 264
12345