Local Policy Iteration Adaptive Dynamic Programming for Discrete-Time Nonlinear Systems

被引：0

作者：

Wei, Qinglai ^{[1
]}

Xu, Yancai ^{[1
]}

Lin, Qiao ^{[1
]}

Liu, Derong ^{[2
]}

Song, Ruizhuo ^{[2
]}

机构：

[1] Univ Chinese Acad Sci, Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China

[2] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China

来源：

ADVANCES IN NEURAL NETWORKS, PT II | 2017年 / 10262卷

基金：

中国国家自然科学基金;

关键词：

Nonlinear systems; Approximate dynamic programming; Local policy iteration; Optimal control; Discrete time; DESIGN; GAMES;

D O I：

10.1007/978-3-319-59081-3_18

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Adaptive dynamic programming is a hot research topic nowadays. Therefore, the paper concerns a new local policy adaptive iterative dynamic programming (ADP) algorithm. Moreover, this algorithm is designed for the discrete-time nonlinear systems, which are used to solve problems concerning infinite horizon optimal control. The new local policy iteration ADP algorithm has the characteristics of updating the iterative control law and value function within one subset of the state space. Morevover, detailed iteration process of the local policy iteration is presented thereafter. The simulation example is listed to show the good performance of the newly developed algorithm.

引用

页码：148 / 153

页数：6

共 50 条

[1] Policy Iteration Adaptive Dynamic Programming Algorithm for Discrete-Time Nonlinear Systems
Liu, Derong
Wei, Qinglai
[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (03) : 621 - 634
[2] Generalized Policy Iteration Adaptive Dynamic Programming for Discrete-Time Nonlinear Systems
Liu, Derong
Wei, Qinglai
Yan, Pengfei
[J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2015, 45 (12): : 1577 - 1591
[3] Policy Approximation in Policy Iteration Approximate Dynamic Programming for Discrete-Time Nonlinear Systems
Guo, Wentao
Si, Jennie
Liu, Feng
Mei, Shengwei
[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (07) : 2794 - 2807
[4] Discrete-Time Optimal Control via Local Policy Iteration Adaptive Dynamic Programming
Wei, Qinglai
Liu, Derong
Lin, Qiao
Song, Ruizhuo
[J]. IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (10) : 3367 - 3379
[5] Adaptive Dynamic Programming with Stable Value Iteration Algorithm for Discrete-Time Nonlinear Systems
Wei, Qinglai
Liu, Derong
[J]. 2012 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2012,
[6] Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems
Wei, Qinglai
Liu, Derong
Lin, Hanquan
[J]. IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (03) : 840 - 853
[7] Modified λ-Policy Iteration Based Adaptive Dynamic Programming for Unknown Discrete-Time Linear Systems
Jiang, Huaiyuan
Zhou, Bin
Duan, Guang-Ren
[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 3291 - 3301
[8] A Generalized Policy Iteration Adaptive Dynamic Programming Algorithm for Optimal Control of Discrete-Time Nonlinear Systems with Actuator Saturation
Lin, Qiao
Wei, Qinglai
Zhao, Bo
[J]. ADVANCES IN NEURAL NETWORKS, PT II, 2017, 10262 : 60 - 65
[9] Optimal Learning Control for Discrete-Time Nonlinear Systems Using Generalized Policy Iteration Based Adaptive Dynamic Programming
Wei, Qinglai
Liu, Derong
[J]. 2014 11TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2014, : 1781 - 1786
[10] Discrete-Time Local Value Iteration Adaptive Dynamic Programming: Convergence Analysis
Wei, Qinglai
Lewis, Frank L.
Liu, Derong
Song, Ruizhuo
Lin, Hanquan
[J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2018, 48 (06): : 875 - 891

← 1 2 3 4 5 →