Event-triggered H∞ consensus control for input-constrained multi-agent systems via reinforcement learning

被引:0
|
作者
Zhang, Jinxuan [1 ]
Ren, Chang-E [1 ]
机构
[1] Capital Normal Univ, Coll Informat Engn, Beijing 100089, Peoples R China
关键词
H-infinity; optimal control; Input constrains; Multi-agent systems (MASs); Reinforcement learning (RL); TIME NONLINEAR-SYSTEMS; TRACKING CONTROL; HJB EQUATION;
D O I
10.1007/s11768-023-00177-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article presents an event-triggered H-infinity consensus control scheme using reinforcement learning (RL) for nonlinear second-order multi-agent systems (MASs) with control constraints. First, considering control constraints, the constrained H-infinity consensus problem is transformed into a multi-player zero-sum game with non-quadratic performance functions. Then, an event-triggered control method is presented to conserve communication resources and a new triggering condition is developed for each agent to make the triggering threshold independent of the disturbance attenuation level. To derive the optimal controller that can minimize the cost function in the case of worst disturbance, a constrained Hamilton-Jacobi-Bellman (HJB) equation is defined. Since it is difficult to solve analytically due to its strongly non-linearity, reinforcement learning (RL) is implemented to obtain the optimal controller. In specific, the optimal performance function and the worst-case disturbance are approximated by a time-triggered critic network; meanwhile, the optimal controller is approximated by event-triggered actor network. After that, Lyapunov analysis is utilized to prove the uniformly ultimately bounded (UUB) stability of the system and that the network weight errors are UUB. Finally, a simulation example is utilized to demonstrate the effectiveness of the control strategy provided.
引用
收藏
页码:25 / 38
页数:14
相关论文
共 50 条
  • [21] Event-Triggered Consensus of Linear Multi-agent Systems with Input Time Delay
    Wu, Yonghui
    Wang, Zhuping
    Zhang, Hao
    Zhang, Changzhu
    [J]. 2020 IEEE 16TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION (ICCA), 2020, : 1404 - 1409
  • [22] Event-triggered group consensus for multi-agent systems subject to input saturation
    Hu, Aihua
    Cao, Jinde
    Hu, Manfeng
    Guo, Liuxiao
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2018, 355 (15): : 7384 - 7400
  • [23] Toward Multi-Agent Reinforcement Learning for Distributed Event-Triggered Control
    Kesper, Lukas
    Trimpe, Sebastian
    Baumann, Dominik
    [J]. LEARNING FOR DYNAMICS AND CONTROL CONFERENCE, VOL 211, 2023, 211
  • [24] Event-triggered based consensus control for a type of multi-agent systems
    Shi, Jiantao
    [J]. PROCEEDINGS OF 2020 IEEE 9TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE (DDCLS'20), 2020, : 870 - 873
  • [25] Event-triggered communication and control of networked systems for multi-agent consensus
    Nowzari, Cameron
    Garcia, Eloy
    Cortes, Jorge
    [J]. AUTOMATICA, 2019, 105 : 1 - 27
  • [26] Consensus control for nonlinear multi-agent systems with event-triggered communications
    Zhang, Juan
    Zhang, Huaguang
    Cai, Yuliang
    Wang, Wei
    [J]. APPLIED MATHEMATICS AND COMPUTATION, 2021, 408
  • [27] Event-triggered consensus of multi-agent systems with noises
    Hu, Aihua
    Cao, Jinde
    Hu, Manfeng
    Guo, Liuxiao
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2015, 352 (09): : 3489 - 3503
  • [28] Event-triggered Consensus for Heterogeneous Multi-agent Systems
    Huang Na
    Duan Zhisheng
    Zhao Yu
    [J]. 2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, : 1259 - 1264
  • [29] Event-triggered Control for Multi-Agent Systems
    Dimarogonas, Dimos V.
    Johansson, Karl H.
    [J]. PROCEEDINGS OF THE 48TH IEEE CONFERENCE ON DECISION AND CONTROL, 2009 HELD JOINTLY WITH THE 2009 28TH CHINESE CONTROL CONFERENCE (CDC/CCC 2009), 2009, : 7131 - 7136
  • [30] Fixed-time consensus of multi-agent systems with input delay and uncertain disturbances via event-triggered control
    Liu, Jian
    Zhang, Yanling
    Sun, Changyin
    Yu, Yao
    [J]. INFORMATION SCIENCES, 2019, 480 : 261 - 272