Learning to Ground Multi-Agent Communication with Autoencoders

被引:0
|
作者
Lin, Toru [1 ]
Huh, Minyoung [1 ]
Stauffer, Chris [2 ]
Lim, Ser-Nam [2 ]
Isola, Phillip [1 ]
机构
[1] MIT, CSAIL, Cambridge, MA 02139 USA
[2] Facebook AI, New York, NY USA
关键词
EVOLUTION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Communication requires having a common language, a lingua franca, between agents. This language could emerge via a consensus process, but it may require many generations of trial and error. Alternatively, the lingua franca can be given by the environment, where agents ground their language in representations of the observed world. We demonstrate a simple way to ground language in learned representations, which facilitates decentralized multi-agent communication and coordination. We find that a standard representation learning algorithm - autoencoding - is sufficient for arriving at a grounded common language. When agents broadcast these representations, they learn to understand and respond to each other's utterances and achieve surprisingly strong task performance across a variety of multi-agent communication environments.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Multi-Agent Reinforcement Learning With Distributed Targeted Multi-Agent Communication
    Xu, Chi
    Zhang, Hui
    Zhang, Ya
    [J]. 2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 2915 - 2920
  • [2] Learning communication for multi-agent systems
    Giles, CL
    Jim, KC
    [J]. INNOVATIVE CONCPTS FOR AGENT-BASED SYSTEMS, 2002, 2564 : 377 - 390
  • [3] Learning and communication in multi-agent systems
    Friedrich, H
    Kaiser, M
    Rogalla, O
    Dillmann, R
    [J]. DISTRIBUTED ARTIFICIAL INTELLIGENCE MEETS MACHINE LEARNING: LEARNING IN MULTI-AGENT ENVIRONMENTS, 1997, 1221 : 259 - 275
  • [4] Air-Ground Coordination Communication by Multi-Agent Deep Reinforcement Learning
    Ding, Ruijin
    Gao, Feifei
    Yang, Guanghua
    Shen, Xuemin Sherman
    [J]. IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [5] Learning structured communication for multi-agent reinforcement learning
    Sheng, Junjie
    Wang, Xiangfeng
    Jin, Bo
    Yan, Junchi
    Li, Wenhao
    Chang, Tsung-Hui
    Wang, Jun
    Zha, Hongyuan
    [J]. AUTONOMOUS AGENTS AND MULTI-AGENT SYSTEMS, 2022, 36 (02)
  • [6] Learning structured communication for multi-agent reinforcement learning
    Junjie Sheng
    Xiangfeng Wang
    Bo Jin
    Junchi Yan
    Wenhao Li
    Tsung-Hui Chang
    Jun Wang
    Hongyuan Zha
    [J]. Autonomous Agents and Multi-Agent Systems, 2022, 36
  • [7] Learning Attentional Communication for Multi-Agent Cooperation
    Jiang, Jiechuan
    Lu, Zongqing
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [8] Coordinating Multi-Agent Navigation by Learning Communication
    Hildreth, Dalto N.
    Guy, Stephen J.
    [J]. PROCEEDINGS OF THE ACM ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES, 2019, 2 (02)
  • [9] A communication architecture for multi-agent learning systems
    Ireson, N
    Cao, YJ
    Bull, L
    Miles, R
    [J]. REAL-WORLD APPLICATIONS OF EVOLUTIONARY COMPUTING, PROCEEDINGS, 2000, 1803 : 255 - 266
  • [10] Communication-robust multi-agent learning by adaptable auxiliary multi-agent adversary generation
    Lei Yuan
    Feng Chen
    Zongzhang Zhang
    Yang Yu
    [J]. Frontiers of Computer Science, 2024, 18