Deep reinforcement learning of event-triggered communication and control for multi-agent cooperative transport

被引:5
|
作者
Shibata, Kazuki [1 ,2 ]
Jimbo, Tomohiko [1 ]
Matsubara, Takamitsu [2 ]
机构
[1] Toyota Cent Res & Dev Labs Inc, Data Analyt Res Domain, Autonomous Distributed Cooperat Control Program, 41-1 Yokomichi, Nagakute, Aichi, Japan
[2] Nara Inst Sci & Technol, Grad Sch Sci & Technol, Div Informat Sci, Nara, Japan
关键词
MANIPULATION;
D O I
10.1109/ICRA48506.2021.9561274
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we explore a multi-agent reinforcement learning approach to address the design problem of communication and control strategies for multi-agent cooperative transport. Typical end-to-end deep neural network policies may be insufficient for covering communication and control; these methods cannot decide the timing of communication and can only work with fixed-rate communications. Therefore, our framework exploits event-triggered architecture, namely, a feedback controller that computes the communication input and a triggering mechanism that determines when the input has to be updated again. Such event-triggered control policies are efficiently optimized using a multi-agent deep deterministic policy gradient. We confirmed that our approach could balance the transport performance and communication savings through numerical simulations.
引用
收藏
页码:8671 / 8677
页数:7
相关论文
共 50 条
  • [31] A review of cooperative multi-agent deep reinforcement learning
    Oroojlooy, Afshin
    Hajinezhad, Davood
    [J]. APPLIED INTELLIGENCE, 2023, 53 (11) : 13677 - 13722
  • [32] Cooperative Exploration for Multi-Agent Deep Reinforcement Learning
    Liu, Iou-Jen
    Jain, Unnat
    Yeh, Raymond A.
    Schwing, Alexander G.
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [33] Edge event-triggered control for multi-agent systems under directed communication topologies
    Wei, Bo
    Xiao, Feng
    Dai, Ming-Zhe
    [J]. INTERNATIONAL JOURNAL OF CONTROL, 2018, 91 (04) : 887 - 896
  • [34] Adaptive formation control of nonlinear multi-agent systems with dynamic event-triggered communication
    Pham, Thiem V.
    Nguyen, Quynh T. Thanh
    [J]. SYSTEMS & CONTROL LETTERS, 2023, 181
  • [35] Event-Triggered Communication Mechanism for Distributed Flocking Control of Nonholonomic Multi-agent System
    Xun, Weiwei
    Yi, Wei
    Liu, Xi
    Yi, Xiaodong
    Wang, Yanzhen
    [J]. ADVANCES IN SWARM INTELLIGENCE, ICSI 2018, PT II, 2018, 10942 : 53 - 65
  • [36] Consensus for multi-agent systems with distributed adaptive control and an event-triggered communication strategy
    Xie, Duosi
    Xu, Shengyuan
    Zhang, Baoyong
    Li, Yongmin
    Chu, Yuming
    [J]. IET CONTROL THEORY AND APPLICATIONS, 2016, 10 (13): : 1547 - 1555
  • [37] Consensus Control of Multi-Agent Systems With Different State Constraints and Event-Triggered Communication
    Wang, Gang
    Zuo, Zongyu
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2024, 71 (02) : 817 - 821
  • [38] Event-triggered tracking control for heterogeneous multi-agent systems with Markov communication delays
    Yin, Xiuxia
    Yue, Dong
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2013, 350 (05): : 1312 - 1334
  • [39] Event-triggered consensus control of linear multi-agent systems under intermittent communication
    Sun, Jian
    Zhang, Jianxin
    Liu, Lei
    Shan, Qihe
    Zhang, Junxing
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2024, 361 (05):
  • [40] Multi-agent event triggered hierarchical security reinforcement learning
    Sun, Hui-Hui
    Hu, Chun-He
    Zhang, Jun-Guo
    [J]. Kongzhi yu Juece/Control and Decision, 2024, 39 (11): : 3755 - 3762