Approximate Optimal Indirect Regulation of an Unknown Agent With a Lyapunov-Based Deep Neural Network

被引:3
|
作者
Makumi, Wanjiku A. [1 ]
Bell, Zachary I. [2 ]
Dixon, Warren E. [1 ]
机构
[1] Univ Florida, Dept Mech & Aerosp Engn, Gainesville, FL 32611 USA
[2] Air Force Res Lab, Munit Directorate, Eglin AFB, FL 32542 USA
来源
IEEE CONTROL SYSTEMS LETTERS | 2023年 / 7卷
关键词
Deep learning; System identification; Function approximation; Real-time systems; Optimal control; Artificial neural networks; Aerodynamics; Deep neural networks; reinforcement learning; adaptive control; Lyapunov methods; nonlinear control systems; MULTIPLE TARGETS; TIME;
D O I
10.1109/LCSYS.2023.3289474
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
An approximate optimal policy is developed for a pursuing agent to indirectly regulate an evading agent coupled by an unknown interaction dynamic. Approximate dynamic programming is used to design a controller for the pursuing agent to optimally influence the evading agent to a goal location. Since the interaction dynamic between the agents is unknown, integral concurrent learning is used to update a Lyapunov-based deep neural network to facilitate sustained learning and system identification. A Lyapunov-based stability analysis is used to show uniformly ultimately bounded convergence. Simulation results demonstrate the performance of the developed method.
引用
收藏
页码:2773 / 2778
页数:6
相关论文
共 50 条
  • [1] Collaborative Approximate Optimal Indirect Regulation of Uncooperative Agents with a Lyapunov-Based Deep Neural Network
    Makumi, Wanjiku A.
    Bell, Zachary I.
    Philor, Jhyv N.
    Dixon, Warren E.
    AIAA SCITECH 2024 FORUM, 2024,
  • [2] Deep Neural Network-Based Approximate Optimal Tracking for Unknown Nonlinear Systems
    Greene, Max L.
    Bell, Zachary I.
    Nivison, Scott
    Dixon, Warren E.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (05) : 3171 - 3177
  • [3] Deep Residual Neural Network (ResNet)-Based Adaptive Control: A Lyapunov-Based Approach
    Patil, Omkar Sudhir
    Le, Duc M.
    Griffis, Emily J.
    Dixon, Warren E.
    2022 IEEE 61ST CONFERENCE ON DECISION AND CONTROL (CDC), 2022, : 3487 - 3492
  • [4] Composite Adaptive Lyapunov-Based Deep Neural Network (Lb-DNN) Controller
    Patil, Omkar Sudhir
    Griffis, Emily J.
    Makumi, Wanjiku A.
    Dixon, Warren E.
    arXiv, 2023,
  • [5] Lyapunov-Based Real-Time and Iterative Adjustment of Deep Neural Networks
    Sun, Runhan
    Greene, Max L.
    Le, Duc M.
    Bell, Zachary I.
    Chowdhary, Girish
    Dixon, Warren E.
    IEEE CONTROL SYSTEMS LETTERS, 2022, 6 : 193 - 198
  • [6] Lyapunov-based continuous-time nonlinear control using deep neural network applied to underactuated systems
    Rego, Rosana C. B.
    de Araujo, Fabio Meneghetti U.
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 107
  • [7] Lyapunov-based temperature regulation by flow reorientation
    Lensvelt, Ruud
    Speetjens, Michel
    Nijmeijer, Henk
    2021 EUROPEAN CONTROL CONFERENCE (ECC), 2021, : 1432 - 1437
  • [8] Optimal Lyapunov-based quantum control for quantum systems
    Hou, S. C.
    Khan, M. A.
    Yi, X. X.
    Dong, Daoyi
    Petersen, Ian R.
    PHYSICAL REVIEW A, 2012, 86 (02):
  • [9] Optimal Lyapunov-Based States Transfer for Superconducting Qubits
    Ji, Yinghua
    Huang, Jianhua
    Hu, Juju
    2016 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION (ICIA), 2016, : 849 - 852
  • [10] Optimal Lyapunov-based backward horizon adaptive stabilization
    Venugopal, R
    Rao, VG
    Bernstein, DS
    PROCEEDINGS OF THE 2000 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 2000, : 1654 - 1658