Data-based decentralized learning scheme for nonlinear systems with mismatched interconnections

被引:2
|
作者
Mu, Chaoxu [1 ]
Peng, Jiangwen [1 ]
Luo, Hao [1 ]
Wang, Ke [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
Integral reinforcement learning; Neural network; Experience replay; Off-policy; H-INFINITY CONTROL; TRACKING; GAMES;
D O I
10.1016/j.neucom.2021.11.002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, the decentralized learning scheme for nonlinear systems with mismatched interconnec-tions is developed by using the off-policy integral reinforcement leaning algorithm. First, the decentral-ized control of the overall system is transformed into the optimal control of each subsystem by introducing an auxiliary control. In order to relax the knowledge of system dynamics, a model-free policy iteration algorithm is derived based on the off-policy integral reinforcement learning. Then, the model-free policy iteration algorithm is used to solve the related Hamilton-Jacobi-Bellman equations, where only the collected system data is required. For implementation purpose, neural networks are employed to approximate the optimal cost functions and the optimal control policies, respectively. Moreover, the least squares method and the experience replay technique are combined to learn neural network weights. Finally, a mismatched interconnected system and a photovoltaic power system are presented to verify the effectiveness of the proposed algorithm. (c) 2021 Published by Elsevier B.V.
引用
收藏
页码:127 / 137
页数:11
相关论文
共 50 条
  • [1] Decentralized Stabilization for Nonlinear Systems with Unknown Mismatched Interconnections
    Zhao, Bo
    Wang, Ding
    Shi, Guang
    Liu, Derong
    Li, Yuanchun
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2016, PT III, 2016, 9949 : 185 - 192
  • [2] Data-based learning control for optimization of nonlinear systems
    Wei, Qinglai
    Song, Ruizhuo
    Zhang, Pinjia
    Wu, Zongze
    [J]. OPTIMAL CONTROL APPLICATIONS & METHODS, 2023, 44 (03): : 1055 - 1057
  • [3] Adaptive dynamic programming for decentralized neuro-control of nonlinear systems subject to mismatched interconnections
    Tang, Yuhong
    Yang, Xiong
    Dong, Na
    [J]. OPTIMAL CONTROL APPLICATIONS & METHODS, 2022, 43 (05): : 1501 - 1519
  • [4] Decentralized Control for Large-Scale Nonlinear Systems With Unknown Mismatched Interconnections via Policy Iteration
    Zhao, Bo
    Wang, Ding
    Shi, Guang
    Liu, Derong
    Li, Yuanchun
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2018, 48 (10): : 1725 - 1735
  • [5] Adaptive Dynamic Programming for Decentralized Stabilization of Uncertain Nonlinear Large-Scale Systems With Mismatched Interconnections
    Yang, Xiong
    He, Haibo
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2020, 50 (08): : 2870 - 2882
  • [6] Decoupled Data-Based Approach for Learning to Control Nonlinear Dynamical Systems
    Wang, Ran
    Parunandi, Karthikeya S.
    Yu, Dan
    Kalathil, Dileep
    Chakravorty, Suman
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (07) : 3582 - 3589
  • [7] Data-Based Control for Learning Systems With Nonlinear Dynamics: A Case Study
    Wu, Yuxin
    Meng, Deyuan
    [J]. IFAC PAPERSONLINE, 2023, 56 (02): : 1913 - +
  • [8] Data-based optimal control design with reinforcement learning for nonlinear PDE systems
    Zheng, Yuqing
    Zhang, Guoshan
    [J]. 2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 345 - 350
  • [9] Data-Based Optimization Control for Learning Systems
    Wang, Chenchao
    Meng, Deyuan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (07) : 2560 - 2564
  • [10] Decentralized adaptive optimal stabilization of nonlinear systems with matched interconnections
    Chaoxu Mu
    Changyin Sun
    Ding Wang
    Aiguo Song
    Chengshan Qian
    [J]. Soft Computing, 2018, 22 : 2705 - 2715