Event-triggered H∞ consensus control for input-constrained multi-agent systems via reinforcement learning

被引:0
|
作者
Zhang, Jinxuan [1 ]
Ren, Chang-E [1 ]
机构
[1] Capital Normal Univ, Coll Informat Engn, Beijing 100089, Peoples R China
关键词
H-infinity; optimal control; Input constrains; Multi-agent systems (MASs); Reinforcement learning (RL); TIME NONLINEAR-SYSTEMS; TRACKING CONTROL; HJB EQUATION;
D O I
10.1007/s11768-023-00177-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article presents an event-triggered H-infinity consensus control scheme using reinforcement learning (RL) for nonlinear second-order multi-agent systems (MASs) with control constraints. First, considering control constraints, the constrained H-infinity consensus problem is transformed into a multi-player zero-sum game with non-quadratic performance functions. Then, an event-triggered control method is presented to conserve communication resources and a new triggering condition is developed for each agent to make the triggering threshold independent of the disturbance attenuation level. To derive the optimal controller that can minimize the cost function in the case of worst disturbance, a constrained Hamilton-Jacobi-Bellman (HJB) equation is defined. Since it is difficult to solve analytically due to its strongly non-linearity, reinforcement learning (RL) is implemented to obtain the optimal controller. In specific, the optimal performance function and the worst-case disturbance are approximated by a time-triggered critic network; meanwhile, the optimal controller is approximated by event-triggered actor network. After that, Lyapunov analysis is utilized to prove the uniformly ultimately bounded (UUB) stability of the system and that the network weight errors are UUB. Finally, a simulation example is utilized to demonstrate the effectiveness of the control strategy provided.
引用
收藏
页码:25 / 38
页数:14
相关论文
共 50 条
  • [1] Consensus of linear multi-agent systems via event-triggered control
    Zhang, Zhiqiang
    Hao, Fei
    Zhang, Lin
    Wang, Long
    [J]. INTERNATIONAL JOURNAL OF CONTROL, 2014, 87 (06) : 1243 - 1251
  • [2] Consensus of multi-agent systems via intermittent event-triggered control
    Hu, Aihua
    Cao, Jinde
    [J]. INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2017, 48 (02) : 280 - 287
  • [3] Event-Triggered H∞ Consensus Control for Multi-agent Systems with Disturbance
    Huan, Yu
    Liu, Yang
    [J]. PROCEEDINGS OF THE 2015 CHINESE INTELLIGENT SYSTEMS CONFERENCE, VOL 2, 2016, 360 : 341 - 352
  • [4] Event-triggered cooperative robust formation control of multi-agent systems via reinforcement learning
    Zhang, Yongwei
    Zhang, Jiantao
    Xiong, Juntao
    [J]. APPLIED INTELLIGENCE, 2024, 54 (17-18) : 8367 - 8383
  • [5] Consensus of multi-agent systems via fully distributed event-triggered control
    Li, Xianwei
    Tang, Yang
    Karimi, Hamid Reza
    [J]. AUTOMATICA, 2020, 116
  • [6] Performance Constrained Distributed Event-triggered Consensus in Multi-agent Systems
    Amini, Amir
    Zeinaly, Zahra
    Mohammadi, Arash
    Asif, Amir
    [J]. 2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 1830 - 1835
  • [7] Distributed event-triggered consensus of multi-agent systems with input delay
    Li, Yunhan
    Zhang, Pengyu
    Wang, Chunyan
    Wang, Dandan
    Wang, Jianan
    [J]. IFAC PAPERSONLINE, 2020, 53 (02): : 2550 - 2555
  • [8] Distributed event-triggered control for global consensus of multi-agent systems with input saturation
    Yi, Xinlei
    Yang, Tao
    Wu, Junfeng
    Johansson, Karl H.
    [J]. AUTOMATICA, 2019, 100 : 1 - 9
  • [9] Adaptive Event-Triggered Consensus Control for Multi-Agent Systems Subject to Input Saturation
    Yin, Xiuxia
    Yue, Dong
    Hu, Songlin
    [J]. 2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 7245 - 7250
  • [10] Distributed event-triggered control for consensus of multi-agent systems
    Zhang, Hao
    Yang, Ruohan
    Yan, Huaicheng
    Chen, Qijun
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2015, 352 (09): : 3476 - 3488