Cooperative multi-agent system for production control using reinforcement learning

被引:29
|
作者
Dittrich, Marc-Andre [1 ]
Fohlmeister, Silas [1 ]
机构
[1] Leibniz Univ Hannover, Inst Prod Engn & Machine Tools IFW, Hannover, Germany
关键词
Production planning; Machine learning; Multi-agent system;
D O I
10.1016/j.cirp.2020.04.005
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Multi-agent systems can limit the control problem in complex production systems and solve them more efficiently. However, they often show local optimization tendencies. This paper presents a novel approach for a cooperative multi-agent system, which uses reinforcement learning and considers global key performance indicators. For this purpose, a central deep q-learning module transfers its knowledge to the cooperative order agents. The order agent's experience is stored in a replay memory for subsequent reinforcement learning. Interdependencies between the characteristics of nonlinear production systems and learning parameters are investigated and the performance is evaluated in comparison to conventional methods of production control. (C) 2020 CIRP. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:389 / 392
页数:4
相关论文
共 50 条
  • [41] Cooperative Optimization Strategy for Distributed Energy Resource System using Multi-Agent Reinforcement Learning
    Liu, Zhaoyang
    Xiang, Tianchun
    Wang, Tianhao
    Mu, Chaoxu
    [J]. 2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [42] Multi-Agent Deep Reinforcement Learning for Decentralized Cooperative Traffic Signal Control
    Zhao, Yang
    Hu, Jian-Ming
    Gao, Ming-Yang
    Zhang, Zuo
    [J]. CICTP 2020: TRANSPORTATION EVOLUTION IMPACTING FUTURE MOBILITY, 2020, : 458 - 470
  • [43] Cooperative Multi-agent Reinforcement Learning Models (CMRLM) for Intelligent Traffic Control
    Vidhate, Deepak A.
    Kulkarni, Parag
    [J]. 2017 1ST INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND INFORMATION MANAGEMENT (ICISIM), 2017, : 325 - 331
  • [44] Traffic flow control using multi-agent reinforcement learning
    Zeynivand, A.
    Javadpour, A.
    Bolouki, S.
    Sangaiah, A. K.
    Jafari, F.
    Pinto, P.
    Zhang, W.
    [J]. JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2022, 207
  • [45] Highway Merging Control Using Multi-Agent Reinforcement Learning
    Irshayyid, Ali
    Chen, Jun
    [J]. 2024 IEEE 3RD INTERNATIONAL CONFERENCE ON COMPUTING AND MACHINE INTELLIGENCE, ICMI 2024, 2024,
  • [46] Optimal control in microgrid using multi-agent reinforcement learning
    Li, Fu-Dong
    Wu, Min
    He, Yong
    Chen, Xin
    [J]. ISA TRANSACTIONS, 2012, 51 (06) : 743 - 751
  • [47] Cooperative Reinforcement Learning Algorithm to Distributed Power System Based on Multi-Agent
    Gao, La-mei
    Zeng, Jun
    Wu, Jie
    Li, Min
    [J]. 2009 3RD INTERNATIONAL CONFERENCE ON POWER ELECTRONICS SYSTEMS AND APPLICATIONS: ELECTRIC VEHICLE AND GREEN ENERGY, 2009, : 53 - 53
  • [48] Fast reinforcement learning approach to cooperative behavior acquisition in multi-agent system
    Piao, S
    Hong, B
    [J]. 2002 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-3, PROCEEDINGS, 2002, : 871 - 875
  • [49] Improving Cooperative Multi-Target Tracking Control for UAV Swarm Using Multi-Agent Reinforcement Learning
    Yue, Longfei
    Lv, Maolong
    Yan, Mengda
    Zhao, Xiaoru
    Wu, Ao
    Li, Leyan
    Zuo, Jialiang
    [J]. 2023 9TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS, ICCAR, 2023, : 179 - 186
  • [50] Route Guidance System Using Multi-agent Reinforcement Learning
    Arokhlo, Mortaza Zolfpour
    Selamat, Ali
    Hashim, Siti Zaiton Mohd
    Selamat, Md Hafiz
    [J]. 2011 7TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY IN ASIA (CITA 11), 2011,