A Model-Based Reinforcement Learning Algorithm for Multi-Agent Cooperation Nash Equilibrium With Unstable Communication

被引:1
|
作者
Jiang, Yuannan [1 ,2 ]
Jiang, Shengming [1 ]
Wang, Xiaofeng [1 ]
机构
[1] Shanghai Maritime Univ, Coll Informat Engn, Shanghai 201306, Peoples R China
[2] East China Univ Sci & Technol, Sch Informat Sci & Technol, Shanghai 200237, Peoples R China
基金
中国国家自然科学基金;
关键词
GRAPHICAL GAMES; CONSENSUS;
D O I
10.1109/TCSII.2023.3263297
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Solving Nash equilibrium is important to multi-agent systems, in which the communication is an important factor. However, many proposed reinforcement learning (RL) based algorithms take into account the communication factors by assuming stable communication conditions, which does not hold in the real environment. In this brief, we analyze the effect of a typical RL algorithm in the cases of unstable communication and communication failure, which causes information loss between agents, leading to isolation of agents and affecting algorithm convergence. Then, we propose a model-based RL algorithm to solve Nash equilibrium for multi-agent systems when agents are isolated, and prove its convergence and rationality through mathematical proofs. The simulations results show the effectiveness of the proposed algorithm.
引用
收藏
页码:4743 / 4747
页数:5
相关论文
共 50 条
  • [21] Learning structured communication for multi-agent reinforcement learning
    Junjie Sheng
    Xiangfeng Wang
    Bo Jin
    Junchi Yan
    Wenhao Li
    Tsung-Hui Chang
    Jun Wang
    Hongyuan Zha
    Autonomous Agents and Multi-Agent Systems, 2022, 36
  • [22] A Multi-agent Reinforcement Learning Algorithm Based on Stackelberg Game
    Cheng, Chi
    Zhu, Zhangqing
    Xin, Bo
    Chen, Chunlin
    2017 6TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS (DDCLS), 2017, : 727 - 732
  • [23] Traffic Distribution Algorithm Based on Multi-Agent Reinforcement Learning
    Cheng C.
    Teng J.-J.
    Zhao Y.-L.
    Song M.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2019, 42 (06): : 43 - 48and57
  • [24] Multi-Agent Reinforcement Learning Algorithm Based on Action Prediction
    童亮
    陆际联
    Journal of Beijing Institute of Technology(English Edition), 2006, (02) : 133 - 137
  • [25] Multi-agent reinforcement learning algorithm based on neural networks
    Tang, Lianggui
    Yang, Hu
    An, Bo
    Cheng, Daijie
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 1569 - 1574
  • [26] Multi-agent Reinforcement Learning Algorithm Based on Local Information
    Li, Chonglun
    He, Zhaoxiong
    Wang, Bingzheng
    Wang, Zhen
    Li, Lingbin
    PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 3080 - 3091
  • [27] A two-layered multi-agent reinforcement learning model and algorithm
    Wang, Ben-Nian
    Gao, Yang
    Chen, Zhao-Qian
    Xie, Jun-Yuan
    Chen, Shi-Fu
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2007, 30 (04) : 1366 - 1376
  • [28] Learning Individually Inferred Communication for Multi-Agent Cooperation
    Ding, Ziluo
    Huang, Tiejun
    Lu, Zongqing
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [29] HyperComm: Hypergraph-based communication in multi-agent reinforcement learning
    Zhu, Tianyu
    Shi, Xinli
    Xu, Xiangping
    Gui, Jie
    Cao, Jinde
    NEURAL NETWORKS, 2024, 178
  • [30] Multi-agent reinforcement learning: an approach based on agents' cooperation for a common goal
    Wang, GQ
    Yu, HB
    PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, VOL 1, 2004, : 336 - 339