Differential neural network robust constrained controller using approximate dynamic programming

被引:0
|
作者
Noriega-Marquez, Sebastian [1 ]
Poznyak, Alexander [1 ]
Hernandez-Sanchez, Alejandra [2 ]
Chairez, Isaac [3 ]
机构
[1] Inst Politecn Nacl, Ctr Invest & Estudios Avanzados, Automat Control Dept, Mexico City 1043, Mexico
[2] Tecnol Monterrey, Inst Adv Mat Sustainable Mfg, Mexico City 695014, Mexico
[3] Tecnol Monterrey, Inst Adv Mat Sustainable Mfg, Zapopan 695571, Jalisco, Mexico
关键词
Min-max optimal control; System with uncertain model; Differential neural network; Neural network approximation; Lagrange multipliers; SYSTEMS;
D O I
10.1016/j.ejcon.2024.101003
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study focuses on developing a continuous differential neural network (DNN) approximating min-max robust control by applying dynamic neural programming. The suggested controller is applied to a class of nonlinear perturbed systems providing satisfactory dynamics for a given cost function depending on both the trajectories of the perturbed system and the designed constrained control actions. The min-max formulation for dynamic programming offers reliable control for restricted modeling uncertainties and perturbations. The suggested design considers control norm restrictions in the optimization problem. DNN's approximation of the worst (with respect to the admissible class of perturbations and uncertainties) value function of the Hamilton- Jacobi-Bellman (HJB) equation enables the estimation of the closed -loop formulation of the controller. The robust version of the HJB partial differential equation is studied to create the learning law class for the timevarying weights in the DNN. The controller employs a time -varying Lyapunov-like differential equation and the solution of the corresponding learning laws. A recurrent algorithm based on the Kiefer-Wolfowitz technique can be used by modifying the weights' initial conditions to fulfill the specified cost function's end requirements. A numerical example tests the robust control proposed in this study, validating the robust optimal solution based on the DNN approximation for Bellman's value function.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Single Network Approximate Dynamic Programming based Constrained Optimal Controller for Nonlinear Systems with Uncertainties
    Ding, Jie
    Balakrishnan, S. N.
    49TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2010, : 3054 - 3059
  • [2] A single network approximate dynamic programming based constrained optimal controller for nonlinear systems with uncertainties
    Department of Mech. and Aerospace Engg., Missouri Univ. of Science and Tech., Rolla, MO 65401, United States
    Proc IEEE Conf Decis Control, (3054-3059):
  • [3] The RBF neural network in approximate dynamic programming
    Ster, B
    Dobnikar, A
    ARTIFICIAL NEURAL NETS AND GENETIC ALGORITHMS, 1999, : 161 - 165
  • [4] Approximate dynamic programming for communication-constrained sensor network management
    Williams, Jason L.
    Fisher, John W., III
    Willsky, Alan S.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2007, 55 (08) : 4300 - 4311
  • [5] Controller design (from scratch) using approximate dynamic programming
    Lendaris, GG
    Schultz, LJ
    PROCEEDINGS OF THE 2000 IEEE INTERNATIONAL SYMPOSIUM ON INTELLIGENT CONTROL, 2000, : 31 - 36
  • [6] Dynamic Energy Management of a Microgrid Using Approximate Dynamic Programming and Deep Recurrent Neural Network Learning
    Zeng, Peng
    Li, Hepeng
    He, Haibo
    Li, Shuhui
    IEEE TRANSACTIONS ON SMART GRID, 2019, 10 (04) : 4435 - 4445
  • [7] Robust Differential Dynamic Programming
    Gramlich, Dennis
    Scherer, Carsten W.
    Ebenbauer, Christian
    2022 IEEE 61ST CONFERENCE ON DECISION AND CONTROL (CDC), 2022, : 1714 - 1721
  • [8] Design of robust optimal controller using neural network
    Kim, Min-Chan
    Park, Seung-Kyu
    Kwak, Gun-Pyong
    2007 INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS, VOLS 1-6, 2007, : 2254 - 2257
  • [9] Equality Constrained Differential Dynamic Programming
    El Kazdadi, Sarah
    Carpentier, Justin
    Ponce, Jean
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 8053 - 8059
  • [10] Constrained Differential Dynamic Programming Revisited
    Aoyama, Yuichiro
    Boutselis, George
    Patel, Akash
    Theodorou, Evangelos A.
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 9738 - 9744