Development Of Deep Reinforcement Learning Multi-Agent Framework Design Using Self-Organizing Map

被引:0
|
作者
Setyawan, Gembong Edhi [1 ]
Cholissodin, Imam [1 ]
机构
[1] Univ Brawijaya, Fac Comp Sci, Malang, Indonesia
关键词
framework design; deep reinforcement learning; q-learning; multi-agent; artificial neural network; self-organizing map;
D O I
10.1109/siet48054.2019.8986121
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The developmental steps and paradigm changes in the use of automation technology using deep reinforcement learning (RL) are very rapid because they are also widely accompanied by the development of deep learning combination, which combines RL algorithms. One of the combinations is Q-learning algorithm with one of the deep learning algorithms family of artificial neural networks (ANN) and part of the artificial intelligence science. The combination also becomes a challenge for many researchers because so far it is very difficult to find the right combination in accordance with the case resolved although there are also those that combine with non-ANN. In addition, most RLs only use a single combination, which means that they have not found the ideal combination, whether it should be a single one of the algorithms of ANN or some of it. This study proposes a framework design using the Self-Organizing Map (SOM) algorithm that adaptively combines and plays as the actor to calculate the final Q-value value that is updated from a single or multiple Q-value values in a sustainable and dynamic manner. The result of the formed framework indicates that SOM is able to provide an adaptive combination for the algorithms that should be used in deep RL.
引用
收藏
页码:246 / 250
页数:5
相关论文
共 50 条
  • [21] Modeling a Multi-agent Self-organizing Architecture in MATSim
    Inedjaren, Youssef
    Zeddini, Besma
    Maachaoui, Mohamed
    Barbot, Jean-Pierre
    AGENTS AND MULTI-AGENT SYSTEMS: TECHNOLOGIES AND APPLICATIONS 2019, 2020, 148 : 311 - 321
  • [22] Integrating Self-Organizing Neural Network and Motivated Learning for Coordinated Multi-Agent Reinforcement Learning in Multi-Stage Stochastic Game
    Teng, Teck-Hou
    Tan, Ah-Hwee
    Starzyk, Janusz A.
    Tan, Yuan-Sin
    Teow, Loo-Nin
    PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 4229 - 4236
  • [23] Word Learning Using a Self-Organizing Map
    Li, Lishu
    Chen, Qinghua
    Cui, Jiaxin
    Fang, Fukang
    2008 INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION TECHNOLOGY APPLICATION, VOL II, PROCEEDINGS, 2008, : 336 - +
  • [24] A multi-agent deep reinforcement learning framework for automated driving on highways
    Bakker, Louis
    Grammatico, Sergio
    2020 28TH MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION (MED), 2020, : 770 - 775
  • [25] A Multi-Agent Deep Reinforcement Learning Framework for VWAP Strategy Optimization
    Ye, Jiaqi
    Li, Xiaodong
    Wang, Yingying
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [26] Decentralized Multi-Agent Pursuit Using Deep Reinforcement Learning
    de Souza, Cristino, Jr.
    Newbury, Rhys
    Cosgun, Akansel
    Castillo, Pedro
    Vidolov, Boris
    Kulic, Dana
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03): : 4552 - 4559
  • [27] Image inpainting based on self-organizing maps by using multi-agent implementation
    Favorskaya, Margarita
    Jain, Lakhmi C.
    Bolgov, Andrey
    KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS 18TH ANNUAL CONFERENCE, KES-2014, 2014, 35 : 861 - 870
  • [28] Scenario Control for (Serious) Games using Self-organizing Multi-Agent Systems
    Pons, Luc
    Bernon, Carole
    Glize, Pierre
    PROCEEDINGS OF 2012 INTERNATIONAL CONFERENCE ON COMPLEX SYSTEMS (ICCS12), 2012, : 180 - 185
  • [29] HALFTONING WITH MULTI-AGENT DEEP REINFORCEMENT LEARNING
    Jiang, Haitian
    Xiong, Dongliang
    Jiang, Xiaowen
    Yin, Aiguo
    Ding, Li
    Huang, Kai
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 641 - 645
  • [30] Deep reinforcement learning for multi-agent interaction
    Ahmed, Ibrahim H.
    Brewitt, Cillian
    Carlucho, Ignacio
    Christianos, Filippos
    Dunion, Mhairi
    Fosong, Elliot
    Garcin, Samuel
    Guo, Shangmin
    Gyevnar, Balint
    McInroe, Trevor
    Papoudakis, Georgios
    Rahman, Arrasy
    Schafer, Lukas
    Tamborski, Massimiliano
    Vecchio, Giuseppe
    Wang, Cheng
    Albrecht, Stefano, V
    AI COMMUNICATIONS, 2022, 35 (04) : 357 - 368