Development Of Deep Reinforcement Learning Multi-Agent Framework Design Using Self-Organizing Map

被引:0
|
作者
Setyawan, Gembong Edhi [1 ]
Cholissodin, Imam [1 ]
机构
[1] Univ Brawijaya, Fac Comp Sci, Malang, Indonesia
关键词
framework design; deep reinforcement learning; q-learning; multi-agent; artificial neural network; self-organizing map;
D O I
10.1109/siet48054.2019.8986121
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The developmental steps and paradigm changes in the use of automation technology using deep reinforcement learning (RL) are very rapid because they are also widely accompanied by the development of deep learning combination, which combines RL algorithms. One of the combinations is Q-learning algorithm with one of the deep learning algorithms family of artificial neural networks (ANN) and part of the artificial intelligence science. The combination also becomes a challenge for many researchers because so far it is very difficult to find the right combination in accordance with the case resolved although there are also those that combine with non-ANN. In addition, most RLs only use a single combination, which means that they have not found the ideal combination, whether it should be a single one of the algorithms of ANN or some of it. This study proposes a framework design using the Self-Organizing Map (SOM) algorithm that adaptively combines and plays as the actor to calculate the final Q-value value that is updated from a single or multiple Q-value values in a sustainable and dynamic manner. The result of the formed framework indicates that SOM is able to provide an adaptive combination for the algorithms that should be used in deep RL.
引用
收藏
页码:246 / 250
页数:5
相关论文
共 50 条
  • [31] Multi-agent deep reinforcement learning: a survey
    Sven Gronauer
    Klaus Diepold
    Artificial Intelligence Review, 2022, 55 : 895 - 943
  • [32] Deep Multi-Agent Reinforcement Learning: A Survey
    Liang X.-X.
    Feng Y.-H.
    Ma Y.
    Cheng G.-Q.
    Huang J.-C.
    Wang Q.
    Zhou Y.-Z.
    Liu Z.
    Zidonghua Xuebao/Acta Automatica Sinica, 2020, 46 (12): : 2537 - 2557
  • [33] Lenient Multi-Agent Deep Reinforcement Learning
    Palmer, Gregory
    Tuyls, Karl
    Bloembergen, Daan
    Savani, Rahul
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS (AAMAS' 18), 2018, : 443 - 451
  • [34] Multi-agent deep reinforcement learning: a survey
    Gronauer, Sven
    Diepold, Klaus
    ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (02) : 895 - 943
  • [35] Learning to Communicate with Deep Multi-Agent Reinforcement Learning
    Foerster, Jakob N.
    Assael, Yannis M.
    de Freitas, Nando
    Whiteson, Shimon
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [36] An acquisition of the relation between vision and action using self-organizing map and reinforcement learning
    Terada, K
    Takeda, H
    Nishida, T
    1998 SECOND INTERNATIONAL CONFERENCE ON KNOWLEDGE-BASED INTELLIGENT ELECTRONIC SYSTEMS, KES'98 PROCEEDINGS, VOL 1, 1998, : 429 - 434
  • [37] Self-organizing multi-agent systems by means of Scout Movement
    Paletta, Mauricio
    Recent Patents on Computer Science, 2012, 5 (03): : 197 - 210
  • [38] Characterizing complex behavior in (self-organizing) multi-agent systems
    Hu, BC
    Liu, JM
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2005, PT 2, 2005, 3481 : 1274 - 1283
  • [39] Self-organizing multi-agent systems for the control of complex systems
    Boes, Jeremy
    Migeon, Frederic
    JOURNAL OF SYSTEMS AND SOFTWARE, 2017, 134 : 12 - 28
  • [40] Optimal Message Interchange in a Self-organizing Multi-agent System
    Gonzalez-Pardo, Antonio
    Varona, Pablo
    Camacho, David
    Rodriguez Ortiz, Francisco de Borja
    INTELLIGENT DISTRIBUTED COMPUTING IV, 2010, 315 : 131 - 141