Deep reinforcement learning of event-triggered communication and control for multi-agent cooperative transport

被引:5
|
作者
Shibata, Kazuki [1 ,2 ]
Jimbo, Tomohiko [1 ]
Matsubara, Takamitsu [2 ]
机构
[1] Toyota Cent Res & Dev Labs Inc, Data Analyt Res Domain, Autonomous Distributed Cooperat Control Program, 41-1 Yokomichi, Nagakute, Aichi, Japan
[2] Nara Inst Sci & Technol, Grad Sch Sci & Technol, Div Informat Sci, Nara, Japan
关键词
MANIPULATION;
D O I
10.1109/ICRA48506.2021.9561274
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we explore a multi-agent reinforcement learning approach to address the design problem of communication and control strategies for multi-agent cooperative transport. Typical end-to-end deep neural network policies may be insufficient for covering communication and control; these methods cannot decide the timing of communication and can only work with fixed-rate communications. Therefore, our framework exploits event-triggered architecture, namely, a feedback controller that computes the communication input and a triggering mechanism that determines when the input has to be updated again. Such event-triggered control policies are efficiently optimized using a multi-agent deep deterministic policy gradient. We confirmed that our approach could balance the transport performance and communication savings through numerical simulations.
引用
收藏
页码:8671 / 8677
页数:7
相关论文
共 50 条
  • [1] Event-triggered cooperative robust formation control of multi-agent systems via reinforcement learning
    Zhang, Yongwei
    Zhang, Jiantao
    Xiong, Juntao
    [J]. APPLIED INTELLIGENCE, 2024, 54 (17-18) : 8367 - 8383
  • [2] Toward Multi-Agent Reinforcement Learning for Distributed Event-Triggered Control
    Kesper, Lukas
    Trimpe, Sebastian
    Baumann, Dominik
    [J]. LEARNING FOR DYNAMICS AND CONTROL CONFERENCE, VOL 211, 2023, 211
  • [3] Deep reinforcement learning of event-triggered communication and consensus-based control for distributed cooperative transport
    Shibata, Kazuki
    Jimbo, Tomohiko
    Matsubara, Takamitsu
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2023, 159
  • [4] Optimal Cooperative Control of Multi-Agent Systems Through Event-Triggered Model-Free Reinforcement Learning
    Mu, Chaoxu
    Tang, Zhuo
    Wang, Ke
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024,
  • [5] Event-triggered cooperative learning from output feedback control for multi-agent systems
    Gao, Fei
    Chen, Weisheng
    Li, Zhiwu
    Li, Jing
    [J]. NEUROCOMPUTING, 2018, 322 : 70 - 79
  • [6] Event-Triggered Communication Network With Limited-Bandwidth Constraint for Multi-Agent Reinforcement Learning
    Hu, Guangzheng
    Zhu, Yuanheng
    Zhao, Dongbin
    Zhao, Mengchen
    Hao, Jianye
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (08) : 3966 - 3978
  • [7] Event-triggered cooperative control for uncertain multi-agent systems and applications
    Wang, Shihao
    Zheng, Shiqi
    Ahn, Choon Ki
    Shi, Peng
    Jiang, Xiaowei
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2023, 33 (12) : 7221 - 7245
  • [8] Deep Reinforcement Learning for Event-Triggered Control
    Baumann, Dominik
    Zhu, Jia-Jie
    Martius, Georg
    Trimpe, Sebastian
    [J]. 2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 943 - 950
  • [9] Event-triggered control for multi-agent network with limited digital communication
    Gao, Lan
    Liao, Xiaofeng
    Li, Huaqing
    Chen, Guo
    [J]. NONLINEAR DYNAMICS, 2015, 82 (04) : 1659 - 1669
  • [10] Event-triggered control for multi-agent network with limited digital communication
    Lan Gao
    Xiaofeng Liao
    Huaqing Li
    Guo Chen
    [J]. Nonlinear Dynamics, 2015, 82 : 1659 - 1669