A Fairness-Aware Cooperation Strategy for Multi-Agent Systems Driven by Deep Reinforcement Learning

被引:0
|
作者
Liu, Zhixiang [1 ,2 ]
Shi, Huaguang [1 ,2 ]
Yan, Wenhao [1 ,2 ]
Jin, Zhanqi [1 ,2 ]
Zhou, Yi [1 ,2 ]
机构
[1] Henan Univ, Sch Artificial Intelligence, Zhengzhou 450046, Peoples R China
[2] Int Joint Res Lab Cooperat Vehicular Networks Hen, Zhengzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-agent collaboration; Fairness; MADDPG; Gini coefficient;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The research on multi-agent cooperation strategies has been attracting widespread concerns in recent years. However, the current deep reinforcement learning algorithms mainly focus on improving cooperation efficiency while ignore fairness. Taking into account both collaboration efficiency and fairness is a complex multi-objective optimization problem. To address this concern, we design a Fair-Efficiency Multi-Agent Deep Deterministic Policy Gradient (FE-MADDPG) algonthm. First, we design a fair and efficient reward function which sets the resource occupancy rate as the ratio of each agent's average reward to the total reward to ensure the fairness of each agent. Then, we improve the MADDPG algonthm by utlhzmg the reward function and make comparisons of the efficiency of agents. Finally, we employ the Gini coefficient and the time consumed for completing the task as evaluation indicators to verify the fairness and efficiency. Simulation results show that the FE-MADDPG algonthm significantly improves the efficiency of the system under the premise of ensuring fairness for each agent.
引用
收藏
页码:4943 / 4948
页数:6
相关论文
共 50 条
  • [1] Multi-Agent Reinforcement Learning-Based Fairness-Aware Scheduling for Bursty Traffic
    Yuan, Mingqi
    Cao, Qi
    Pun, Man-On
    Chen, Yi
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [2] Fairness-aware multi-agent reinforcement learning and visual perception for adaptive traffic signal control
    FANG Wanqing
    ZHAO Xintian
    ZHANG Chengwei
    [J]. Optoelectronics Letters, 2024, 20 (12) : 764 - 768
  • [3] Fairness-aware multi-agent reinforcement learning and visual perception for adaptive traffic signal control
    Fang, Wanqing
    Zhao, Xintian
    Zhang, Chengwei
    [J]. Optoelectronics Letters, 2024, 20 (12) : 764 - 768
  • [4] Hindsight-aware deep reinforcement learning algorithm for multi-agent systems
    Chengjing Li
    Li Wang
    Zirong Huang
    [J]. International Journal of Machine Learning and Cybernetics, 2022, 13 : 2045 - 2057
  • [5] Hindsight-aware deep reinforcement learning algorithm for multi-agent systems
    Li, Chengjing
    Wang, Li
    Huang, Zirong
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (07) : 2045 - 2057
  • [6] Learning to Teach Fairness-Aware Deep Multi-task Learning
    Roy, Arjun
    Ntoutsi, Eirini
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT I, 2023, 13713 : 710 - 726
  • [7] Research on cooperation and reinforcement learning algorithm in multi-agent systems
    Zheng, Shuli
    Han, Jianghong
    Luo, Xiangfeng
    Jiang, Jianwen
    [J]. Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2002, 15 (04): : 453 - 457
  • [8] Multi-Agent Deep Reinforcement Learning for Walker Systems
    Park, Inhee
    Moh, Teng-Sheng
    [J]. 20TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2021), 2021, : 490 - 495
  • [9] Multi-agent deep reinforcement learning strategy for distributed energy
    Xi, Lei
    Sun, Mengmeng
    Zhou, Huan
    Xu, Yanchun
    Wu, Junnan
    Li, Yanying
    [J]. MEASUREMENT, 2021, 185
  • [10] Learning Fairness in Multi-Agent Systems
    Jiang, Jiechuan
    Lu, Zongqing
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32