Approximate Optimal Indirect Regulation of an Unknown Agent With a Lyapunov-Based Deep Neural Network

被引:3
|
作者
Makumi, Wanjiku A. [1 ]
Bell, Zachary I. [2 ]
Dixon, Warren E. [1 ]
机构
[1] Univ Florida, Dept Mech & Aerosp Engn, Gainesville, FL 32611 USA
[2] Air Force Res Lab, Munit Directorate, Eglin AFB, FL 32542 USA
来源
IEEE CONTROL SYSTEMS LETTERS | 2023年 / 7卷
关键词
Deep learning; System identification; Function approximation; Real-time systems; Optimal control; Artificial neural networks; Aerodynamics; Deep neural networks; reinforcement learning; adaptive control; Lyapunov methods; nonlinear control systems; MULTIPLE TARGETS; TIME;
D O I
10.1109/LCSYS.2023.3289474
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
An approximate optimal policy is developed for a pursuing agent to indirectly regulate an evading agent coupled by an unknown interaction dynamic. Approximate dynamic programming is used to design a controller for the pursuing agent to optimally influence the evading agent to a goal location. Since the interaction dynamic between the agents is unknown, integral concurrent learning is used to update a Lyapunov-based deep neural network to facilitate sustained learning and system identification. A Lyapunov-based stability analysis is used to show uniformly ultimately bounded convergence. Simulation results demonstrate the performance of the developed method.
引用
收藏
页码:2773 / 2778
页数:6
相关论文
共 50 条
  • [31] A Lyapunov-based model reference control scheme with CMAC neural network - art. no. 63583R
    Hu Hongjie
    Miao Yuqiao
    Sensors, Automatic Measurement, Control, and Computer Simulation, Pts 1 and 2, 2006, 6358 : R3583 - R3583
  • [32] Lyapunov-Based Physics-Informed Long Short-Term Memory (LSTM) Neural Network-Based Adaptive Control
    Hart R.G.
    Griffis E.J.
    Patil O.S.
    Dixon W.E.
    IEEE Control Systems Letters, 2024, 8 : 13 - 18
  • [33] Optimal strategy for low-thrust spiral trajectories using Lyapunov-based guidance
    Yang Dalin
    Xu Bo
    Gao Youtao
    ADVANCES IN SPACE RESEARCH, 2015, 56 (05) : 865 - 878
  • [34] A novel deep neural network for identification of sex and ethnicity based on unknown skulls
    Zhang, Haibo
    Li, Qianhong
    Wang, Xizhi
    Wu, Qianyi
    Ma, Chaohui
    Zhou, Mingquan
    Geng, Guohua
    PATTERN RECOGNITION, 2025, 162
  • [35] Adaptive and Robust Routing With Lyapunov-Based Deep RL in MEC Networks Enabled by Blockchains
    Zhuang, Zirui
    Wang, Jingyu
    Qi, Qi
    Liao, Jianxin
    Han, Zhu
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (04) : 2208 - 2225
  • [36] A Lyapunov-Based Method of Reducing Activation Functions of Recurrent Neural Networks for Stability Analysis
    Yuno, Tsuyoshi
    Fukuchi, Kazuma
    Ebihara, Yoshio
    IEEE CONTROL SYSTEMS LETTERS, 2024, 8 : 1102 - 1107
  • [37] Hierarchical Approximate Memory for Deep Neural Network Applications
    Ha, Minho
    Hwang, Seokha
    Kim, Jeonghun
    Lee, Youngjoo
    Lee, Sunggu
    2020 54TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2020, : 261 - 266
  • [38] A Deep Convolutional Neural Network Based Virtual Elderly Companion Agent
    Lee, Ming Che
    Yeh, Sheng Cheng
    Chiu, Sheng Yu
    Chang, Jia Wei
    PROCEEDINGS OF THE 8TH ACM MULTIMEDIA SYSTEMS CONFERENCE (MMSYS'17), 2017, : 235 - 238
  • [39] Construction of neural network based Lyapunov functions
    Petridis, Vassilios
    Petridis, Stavros
    2006 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORK PROCEEDINGS, VOLS 1-10, 2006, : 5059 - 5065
  • [40] Calculation of Lyapunov exponents based on the neural network
    Tian, B.G.
    Jiang, L.
    Gu, K.
    Xitong Gongcheng Lilun yu Shijian/System Engineering Theory and Practice, 2001, 21 (08):