A review of the applications of multi-agent reinforcement learning in smart factories

被引:12
|
作者
Bahrpeyma, Fouad [1 ]
Reichelt, Dirk [1 ]
机构
[1] HTW Dresden, Smart Prod Syst, Dresden, Germany
来源
关键词
Industry; 4.0; multi-agent reinforcement learning; smart factory; smart manufacturing; smart production systems; reinforcement learning; Artificial Intelligence; SYSTEM; TIME; OPTIMIZATION; MODEL;
D O I
10.3389/frobt.2022.1027340
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
The smart factory is at the heart of Industry 4.0 and is the new paradigm for establishing advanced manufacturing systems and realizing modern manufacturing objectives such as mass customization, automation, efficiency, and self-organization all at once. Such manufacturing systems, however, are characterized by dynamic and complex environments where a large number of decisions should be made for smart components such as production machines and the material handling system in a real-time and optimal manner. AI offers key intelligent control approaches in order to realize efficiency, agility, and automation all at once. One of the most challenging problems faced in this regard is uncertainty, meaning that due to the dynamic nature of the smart manufacturing environments, sudden seen or unseen events occur that should be handled in real-time. Due to the complexity and high-dimensionality of smart factories, it is not possible to predict all the possible events or prepare appropriate scenarios to respond. Reinforcement learning is an AI technique that provides the intelligent control processes needed to deal with such uncertainties. Due to the distributed nature of smart factories and the presence of multiple decision-making components, multi-agent reinforcement learning (MARL) should be incorporated instead of single-agent reinforcement learning (SARL), which, due to the complexities involved in the development process, has attracted less attention. In this research, we will review the literature on the applications of MARL to tasks within a smart factory and then demonstrate a mapping connecting smart factory attributes to the equivalent MARL features, based on which we suggest MARL to be one of the most effective approaches for implementing the control mechanism for smart factories.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Hierarchical multi-agent reinforcement learning
    Ghavamzadeh, Mohammad
    Mahadevan, Sridhar
    Makar, Rajbala
    AUTONOMOUS AGENTS AND MULTI-AGENT SYSTEMS, 2006, 13 (02) : 197 - 229
  • [22] Partitioning in multi-agent reinforcement learning
    Sun, R
    Peterson, T
    FROM ANIMALS TO ANIMATS 6, 2000, : 325 - 332
  • [23] The Dynamics of Multi-Agent Reinforcement Learning
    Dickens, Luke
    Broda, Krysia
    Russo, Alessandra
    ECAI 2010 - 19TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2010, 215 : 367 - 372
  • [24] Multi-agent reinforcement learning: A survey
    Busoniu, Lucian
    Babuska, Robert
    De Schutter, Bart
    2006 9TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION, VOLS 1- 5, 2006, : 1133 - +
  • [25] Multi-Agent Deep Reinforcement Learning for Multi-Robot Applications: A Survey
    Orr, James
    Dutta, Ayan
    SENSORS, 2023, 23 (07)
  • [26] Multi-Agent Deep Reinforcement Learning Applications in Cybersecurity: challenges and perspectives
    Tolba, Zakaria
    Dehimi, Nour El Houda
    Galland, Stephane
    Boukelloul, Soufiene
    Guassmi, Djaber
    2024 1ST INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER, TELECOMMUNICATION AND ENERGY TECHNOLOGIES, ECTE-TECH, 2024,
  • [27] Applications of Multi-Agent Reinforcement Learning in Future Internet: A Comprehensive Survey
    Li, Tianxu
    Zhu, Kun
    Nguyen Cong Luong
    Niyato, Dusit
    Wu, Qihui
    Zhang, Yang
    Chen, Bing
    IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2022, 24 (02): : 1240 - 1279
  • [28] Spectrum allocation algorithm based on multi-agent reinforcement learning in smart grid
    Yan F.
    Lin X.
    Li Z.
    Xu X.
    Xia W.
    Shen L.
    Tongxin Xuebao/Journal on Communications, 2023, 44 (09): : 12 - 24
  • [29] MAGNet: Multi-agent Graph Network for Deep Multi-agent Reinforcement Learning
    Malysheva, Aleksandra
    Kudenko, Daniel
    Shpilman, Aleksei
    2019 XVI INTERNATIONAL SYMPOSIUM PROBLEMS OF REDUNDANCY IN INFORMATION AND CONTROL SYSTEMS (REDUNDANCY), 2019, : 171 - 176
  • [30] TEAM POLICY LEARNING FOR MULTI-AGENT REINFORCEMENT LEARNING
    Cassano, Lucas
    Alghunaim, Sulaiman A.
    Sayed, Ali H.
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 3062 - 3066