Extended replicator dynamics as a key to reinforcement learning in multi-agent systems

被引：0

作者：

Tuyls, K ^{[1
]}

Heytens, D ^{[1
]}

Nowe, A ^{[1
]}

Manderick, B ^{[1
]}

机构：

[1] Free Univ Brussels, Dept Comp Sci, Computat Modeling Lab, Brussels, Belgium

来源：

MACHINE LEARNING: ECML 2003 | 2003年 / 2837卷

关键词：

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Modeling learning agents in the context of Multi-agent Systems requires an adequate understanding of their dynamic behaviour. Evolutionary Game Theory provides a dynamics which describes how strategies evolve over time. Borgers et al. [1] and Tuyls et al. [11] have shown how classical Reinforcement Learning (RL) techniques such as Cross-learning and Q-learning relate to the Replicator Dynamics (RD). This provides a better understanding of the learning process. In this paper, we introduce an extension of the Replicator Dynamics from Evolutionary Game Theory. Based on this new dynamics, a Reinforcement Learning algorithm is developed that attains a stable Nash equilibrium for all types of games. Such an algorithm is lacking for the moment. This kind of dynamics opens an interesting perspective for introducing new Reinforcement Learning algorithms in multi-state games and Multi-Agent Systems.

引用

页码：421 / 431

页数：11

共 50 条

[21] Multi-agent Reinforcement Learning for Control Systems: Challenges and Proposals
Grana, Manuel
Fernandez-Gauna, Borja
[J]. INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2015, 2015, 9375 : 18 - 25
[22] Distributed Inverse Constrained Reinforcement Learning for Multi-agent Systems
Liu, Shicheng
Zhu, Minghui
[J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
[23] Reinforcement Learning Approach for Cooperative Control of Multi-Agent Systems
Javalera-Rincon, Valeria
Puig Cayuela, Vicenc
Morcego Seix, Bernardo
Orduna-Cabrera, Fernando
[J]. PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE (ICAART), VOL 2, 2019, : 80 - 91
[24] Output synchronization of multi-agent systems via reinforcement learning
Liu, Yingying
Wang, Zhanshan
[J]. NEUROCOMPUTING, 2022, 508 : 110 - 119
[25] Reinforcement Learning for Multi-Agent Systems with Temporal Logic Specifications
Terashima, Keita
Kobayashi, Koichi
Yamashita, Yuh
[J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2024, E107A (01) : 31 - 37
[26] Reinforcement learning approaches to coordination in cooperative multi-agent systems
Kapetanakis, S
Kudenko, D
Strens, MJA
[J]. ADAPTIVE AGENTS AND MULTI-AGENT SYSTEMS: ADAPTATION AND MULTI-AGENT LEARNING, 2003, 2636 : 18 - 32
[27] Research on cooperation and reinforcement learning algorithm in multi-agent systems
Zheng, Shuli
Han, Jianghong
Luo, Xiangfeng
Jiang, Jianwen
[J]. Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2002, 15 (04): : 453 - 457
[28] Reinforcement learning of coordination in heterogeneous cooperative multi-agent systems
Kapetanakis, S
Kudenko, D
[J]. ADAPTIVE AGENTS AND MULTI-AGENT SYSTEMS II: ADAPTATION AND MULTI-AGENT LEARNING, 2005, 3394 : 119 - 131
[29] Argumentation Accelerated Reinforcement Learning for Cooperative Multi-Agent Systems
Gao, Yang
Toni, Francesca
[J]. 21ST EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE (ECAI 2014), 2014, 263 : 333 - 338
[30] Building Collaboration in Multi-agent Systems Using Reinforcement Learning
Aydin, Mehmet Emin
Fellows, Ryan
[J]. COMPUTATIONAL COLLECTIVE INTELLIGENCE, ICCCI 2018, PT II, 2018, 11056 : 201 - 212

← 1 2 3 4 5 →