Learning Cooperative Intrinsic Motivation in Multi-Agent Reinforcement Learning

被引:0
|
作者
Hong, Seung-Jin [1 ]
Lee, Sang-Kwang [2 ]
机构
[1] Univ Sci & Technol, Sch ICT, Daejeon, South Korea
[2] Elect & Telecommun Res Inst, Daejeon, South Korea
关键词
D O I
10.1109/ICTC52510.2021.9620745
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The cooperative behavior is important skill in many real-world applications. Recently, many works have used the multi-agent platform to solve the real-world applications. However, it is difficult to learn the cooperative behaviors with equal rewards that the environment provides without considering the contributions. In this paper, we propose a method for learning cooperative behaviors in the centralized multi-agent environment. Firstly, we implement a reward model to predict the average rewards of all agents. And then, we use the reward model for calculating the contributions. The proposed method allows the model to distinguish which agent behaves better for team success. In order to evaluate the performance of the proposed method, we compute the average team rewards on the multi-agent battle environment. Experimental results show that the proposed method has better performance than the baseline using the cooperative behaviors.
引用
收藏
页码:1697 / 1699
页数:3
相关论文
共 50 条
  • [1] Social Influence as Intrinsic Motivation for Multi-Agent Deep Reinforcement Learning
    Jaques, Natasha
    Lazaridou, Angeliki
    Hughes, Edward
    Gulcehre, Caglar
    Ortega, Pedro A.
    Strouse, D. J.
    Leibo, Joel Z.
    de Freitas, Nando
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [2] Intrinsic Reward with Peer Incentives for Cooperative Multi-Agent Reinforcement Learning
    Zhang, Tianle
    Liu, Zhen
    Wu, Shiguang
    Pu, Zhiqiang
    Yi, Jianqiang
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [3] Intrinsic Action Tendency Consistency for Cooperative Multi-Agent Reinforcement Learning
    Zhang, Junkai
    Zhang, Yifan
    Zhang, Xi Sheryl
    Zang, Yifan
    Cheng, Jian
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 16, 2024, : 17600 - 17608
  • [4] Consensus Learning for Cooperative Multi-Agent Reinforcement Learning
    Xu, Zhiwei
    Zhang, Bin
    Li, Dapeng
    Zhang, Zeren
    Zhou, Guangchong
    Chen, Hao
    Fan, Guoliang
    [J]. THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 10, 2023, : 11726 - 11734
  • [5] Collective Intrinsic Motivation of a Multi-agent System Based on Reinforcement Learning Algorithms
    Bolshakov, Vladislav
    Sakulin, Sergey
    Alfimtsev, Alexander
    [J]. INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 4, INTELLISYS 2023, 2024, 825 : 655 - 670
  • [6] On the Robustness of Cooperative Multi-Agent Reinforcement Learning
    Lin, Jieyu
    Dzeparoska, Kristina
    Zhang, Sai Qian
    Leon-Garcia, Alberto
    Papernot, Nicolas
    [J]. 2020 IEEE SYMPOSIUM ON SECURITY AND PRIVACY WORKSHOPS (SPW 2020), 2020, : 62 - 68
  • [7] LJIR: Learning Joint-Action Intrinsic Reward in cooperative multi-agent reinforcement learning
    Chen, Zihan
    Luo, Biao
    Hu, Tianmeng
    Xu, Xiaodong
    [J]. NEURAL NETWORKS, 2023, 167 : 450 - 459
  • [8] Multi-Agent Uncertainty Sharing for Cooperative Multi-Agent Reinforcement Learning
    Chen, Hao
    Yang, Guangkai
    Zhang, Junge
    Yin, Qiyue
    Huang, Kaiqi
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [9] Cooperative Learning of Multi-Agent Systems Via Reinforcement Learning
    Wang, Xin
    Zhao, Chen
    Huang, Tingwen
    Chakrabarti, Prasun
    Kurths, Juergen
    [J]. IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2023, 9 : 13 - 23
  • [10] Cooperative Multi-Agent Reinforcement Learning With Approximate Model Learning
    Park, Young Joon
    Lee, Young Jae
    Kim, Seoung Bum
    [J]. IEEE ACCESS, 2020, 8 : 125389 - 125400