Adaptive Optimal Control Algorithm for Continuous-Time Nonlinear Systems Based on Policy Iteration

被引：40
|
作者：
Vrabie, D. [1 ]
Lewis, F. L. [1 ]
机构：
[1] Univ Texas Arlington, Automat & Robot Res Inst, Ft Worth, TX 76118 USA
来源：
47TH IEEE CONFERENCE ON DECISION AND CONTROL, 2008 (CDC 2008) | 2008年
关键词：
D O I：
10.1109/CDC.2008.4738955
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
In this paper we develop a new online adaptive control scheme, for partially unknown nonlinear systems, which converges to the optimal state feedback control solution for affine in the inputs nonlinear systems. The derivation of the optimal adaptive control algorithm is presented in a continuous-time framework. The optimal control solution will be obtained in a direct fashion, without system identification. The algorithm is an online approach to policy iterations based on an adaptive critic structure to find an approximate solution to the state feedback, infinite-horizon, optimal control problem.
引用
收藏
页码：73 / 79
页数：7
相关论文
共 50 条
  • [1] Adaptive optimal control for continuous-time linear systems based on policy iteration
    Vrabie, D.
    Pastravanu, O.
    Abu-Khalaf, M.
    Lewis, F. L.
    [J]. AUTOMATICA, 2009, 45 (02) : 477 - 484
  • [2] Linear-Like Policy Iteration Based Optimal Control for Continuous-Time Nonlinear Systems
    Tahirovic, Adnan
    Astolfi, Alessandro
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (10) : 5837 - 5849
  • [3] Optimal Control for Continuous-time Nonlinear Systems based on a Linear-like Policy Iteration
    Tahirovic, Adnan
    Astolfi, Alessandro
    [J]. 2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 5238 - 5243
  • [4] Adaptive optimal tracking control for nonlinear continuous-time systems with time delay using value iteration algorithm
    Shi, Jing
    Yue, Dong
    Xie, Xiangpeng
    [J]. NEUROCOMPUTING, 2020, 396 : 172 - 178
  • [5] Adaptive optimal control of continuous-time nonlinear affine systems via hybrid iteration
    Qasem, Omar
    Gao, Weinan
    Vamvoudakis, Kyriakos G.
    [J]. AUTOMATICA, 2023, 157
  • [6] Value Iteration and Adaptive Optimal Control for Linear Continuous-time Systems
    Bian, Tao
    Jiang, Zhong-Ping
    [J]. PROCEEDINGS OF THE 2015 7TH IEEE INTERNATIONAL CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEMS (CIS) AND ROBOTICS, AUTOMATION AND MECHATRONICS (RAM), 2015, : 53 - 58
  • [7] Reinforcement Learning and Adaptive Optimal Control for Continuous-Time Nonlinear Systems: A Value Iteration Approach
    Bian, Tao
    Jiang, Zhong-Ping
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (07) : 2781 - 2790
  • [8] Policy-Iteration-Based Adaptive Optimal Control for Uncertain Continuous-Time Linear Systems with Excitation Signals
    Lee, Jae Young
    Park, Jin Bae
    Choi, Yoon Ho
    [J]. INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2010), 2010, : 646 - 651
  • [9] Online adaptive optimal control for continuous-time Markov jump linear systems using a novel policy iteration algorithm
    He, Shuping
    Song, Jun
    Ding, Zhengtao
    Liu, Fei
    [J]. IET CONTROL THEORY AND APPLICATIONS, 2015, 9 (10): : 1536 - 1543
  • [10] Policy Iteration-based Indirect Adaptive Optimal Control for Completely Unknown Continuous-Time LTI Systems
    Jha, Sumit Kumar
    Roy, Sayan Basu
    Bhasin, Shubhendu
    [J]. 2017 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2017, : 448 - 454
12345