Event-triggered H∞ consensus control for input-constrained multi-agent systems via reinforcement learning

被引:0
|
作者
Zhang, Jinxuan [1 ]
Ren, Chang-E [1 ]
机构
[1] Capital Normal Univ, Coll Informat Engn, Beijing 100089, Peoples R China
关键词
H-infinity; optimal control; Input constrains; Multi-agent systems (MASs); Reinforcement learning (RL); TIME NONLINEAR-SYSTEMS; TRACKING CONTROL; HJB EQUATION;
D O I
10.1007/s11768-023-00177-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article presents an event-triggered H-infinity consensus control scheme using reinforcement learning (RL) for nonlinear second-order multi-agent systems (MASs) with control constraints. First, considering control constraints, the constrained H-infinity consensus problem is transformed into a multi-player zero-sum game with non-quadratic performance functions. Then, an event-triggered control method is presented to conserve communication resources and a new triggering condition is developed for each agent to make the triggering threshold independent of the disturbance attenuation level. To derive the optimal controller that can minimize the cost function in the case of worst disturbance, a constrained Hamilton-Jacobi-Bellman (HJB) equation is defined. Since it is difficult to solve analytically due to its strongly non-linearity, reinforcement learning (RL) is implemented to obtain the optimal controller. In specific, the optimal performance function and the worst-case disturbance are approximated by a time-triggered critic network; meanwhile, the optimal controller is approximated by event-triggered actor network. After that, Lyapunov analysis is utilized to prove the uniformly ultimately bounded (UUB) stability of the system and that the network weight errors are UUB. Finally, a simulation example is utilized to demonstrate the effectiveness of the control strategy provided.
引用
收藏
页码:25 / 38
页数:14
相关论文
共 50 条
  • [31] Event-triggered control for multi-agent systems
    多智能体系统的事件驱动控制
    [J]. Wang, Long (longwang@pku.edu.cn), 2018, South China University of Technology (35):
  • [32] Fixed-time consensus of multi-agent systems with input delay and uncertain disturbances via event-triggered control
    Liu, Jian
    Zhang, Yanling
    Sun, Changyin
    Yu, Yao
    [J]. INFORMATION SCIENCES, 2019, 480 : 261 - 272
  • [33] Event-triggered optimal containment control for multi-agent systems subject to state constraints via reinforcement learning
    Jiahong Xu
    Lijie Wang
    Yang Liu
    Hong Xue
    [J]. Nonlinear Dynamics, 2022, 109 : 1651 - 1670
  • [34] Event-triggered optimal containment control for multi-agent systems subject to state constraints via reinforcement learning
    Xu, Jiahong
    Wang, Lijie
    Liu, Yang
    Xue, Hong
    [J]. NONLINEAR DYNAMICS, 2022, 109 (03) : 1651 - 1670
  • [35] Dynamic Event-Triggered Reinforcement Learning-Based Consensus Tracking of Nonlinear Multi-Agent Systems
    Xu, Bo
    Li, Yuan-Xin
    Hou, Zhongsheng
    Ahn, Choon Ki
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2023, 70 (05) : 2120 - 2132
  • [36] Adaptive Event-Triggered Consensus Tracking Control Schemes for Uncertain Constrained Nonlinear Multi-Agent Systems
    Wang, Xiaomei
    Niu, Ben
    Zhang, Jiaming
    Wang, Huanqing
    Jiang, Yuqiang
    Wang, Ding
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2023, 21 (04) : 1 - 11
  • [37] Fully distributed consensus of linear multi-agent systems via dynamic event-triggered control☆
    Chen, Tongtong
    Wang, Fuyong
    Feng, Meiling
    Xia, Chengyi
    Chen, Zengqiang
    [J]. NEUROCOMPUTING, 2024, 569
  • [38] Almost sure consensus of stochastic nonlinear multi-agent systems via event-triggered control
    Zunjie Yu
    Weihai Zhang
    [J]. Nonlinear Dynamics, 2023, 111 : 3469 - 3478
  • [39] Consensus of Second-Order Multi-Agent Systems via Event-Triggered Impulsive Control
    Ni, Junchao
    Liu, Jiayun
    Yang, Qingquan
    Dai, Hao
    [J]. 2017 CHINESE AUTOMATION CONGRESS (CAC), 2017, : 4346 - 4350
  • [40] Almost sure consensus of stochastic nonlinear multi-agent systems via event-triggered control
    Yu, Zunjie
    Zhang, Weihai
    [J]. NONLINEAR DYNAMICS, 2023, 111 (04) : 3469 - 3478