A Model-Based Reinforcement Learning Algorithm for Multi-Agent Cooperation Nash Equilibrium With Unstable Communication

被引:1
|
作者
Jiang, Yuannan [1 ,2 ]
Jiang, Shengming [1 ]
Wang, Xiaofeng [1 ]
机构
[1] Shanghai Maritime Univ, Coll Informat Engn, Shanghai 201306, Peoples R China
[2] East China Univ Sci & Technol, Sch Informat Sci & Technol, Shanghai 200237, Peoples R China
基金
中国国家自然科学基金;
关键词
GRAPHICAL GAMES; CONSENSUS;
D O I
10.1109/TCSII.2023.3263297
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Solving Nash equilibrium is important to multi-agent systems, in which the communication is an important factor. However, many proposed reinforcement learning (RL) based algorithms take into account the communication factors by assuming stable communication conditions, which does not hold in the real environment. In this brief, we analyze the effect of a typical RL algorithm in the cases of unstable communication and communication failure, which causes information loss between agents, leading to isolation of agents and affecting algorithm convergence. Then, we propose a model-based RL algorithm to solve Nash equilibrium for multi-agent systems when agents are isolated, and prove its convergence and rationality through mathematical proofs. The simulations results show the effectiveness of the proposed algorithm.
引用
收藏
页码:4743 / 4747
页数:5
相关论文
共 50 条
  • [1] A Model-Free Deep Reinforcement Learning Algorithm for Solving Multi-Agent Nash Equilibrium With Unstable Communication
    Jiang, Yuannan
    Jiang, Shengming
    Wang, Xiaofeng
    IEEE ACCESS, 2025, 13 : 43973 - 43980
  • [2] Efficient Model-based Multi-agent Reinforcement Learning via Optimistic Equilibrium Computation
    Sessa, Pier Giuseppe
    Kamgarpour, Maryam
    Krause, Andreas
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022, : 19580 - 19597
  • [3] Filtered Observations for Model-Based Multi-agent Reinforcement Learning
    Meng, Linghui
    Xiong, Xuantang
    Zang, Yifan
    Zhang, Xi
    Li, Guoqi
    Xing, Dengpeng
    Xu, Bo
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT IV, 2023, 14172 : 540 - 555
  • [4] A cooperation model using reinforcement learning for multi-agent
    Lee, M
    Lee, J
    Jeong, HJ
    Lee, Y
    Choi, S
    Gatton, TM
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2006, PT 5, 2006, 3984 : 675 - 681
  • [5] Multi-agent communication cooperation based on deep reinforcement learning and information theory
    Gao, Bing
    Zhang, Zhejie
    Zou, Qijie
    Liu, Zhiguo
    Zhao, Xiling
    Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2024, 45 (18):
  • [6] Research on cooperation and reinforcement learning algorithm in multi-agent systems
    Zheng, Shuli
    Han, Jianghong
    Luo, Xiangfeng
    Jiang, Jianwen
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2002, 15 (04): : 453 - 457
  • [7] An Enhanced Model-Free Reinforcement Learning Algorithm to Solve Nash Equilibrium for Multi-Agent Cooperative Game Systems
    Jiang, Yuannan
    Tan, Fuxiao
    IEEE ACCESS, 2020, 8 : 223743 - 223755
  • [8] Multi-Agent Cognition Difference Reinforcement Learning for Multi-Agent Cooperation
    Wang, Huimu
    Qiu, Tenghai
    Liu, Zhen
    Pu, Zhiqiang
    Yi, Jianqiang
    Yuan, Wanmai
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [9] LMRL: A multi-agent reinforcement learning model and algorithm
    Wang, BN
    Gao, Y
    Chen, ZQ
    Xie, JY
    Chen, SF
    Third International Conference on Information Technology and Applications, Vol 1, Proceedings, 2005, : 303 - 307
  • [10] Multi-agent reinforcement learning based on local communication
    Zhang, Wenxu
    Ma, Lei
    Li, Xiaonan
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 6): : 15357 - 15366