A review of the applications of multi-agent reinforcement learning in smart factories

被引:12
|
作者
Bahrpeyma, Fouad [1 ]
Reichelt, Dirk [1 ]
机构
[1] HTW Dresden, Smart Prod Syst, Dresden, Germany
来源
关键词
Industry; 4.0; multi-agent reinforcement learning; smart factory; smart manufacturing; smart production systems; reinforcement learning; Artificial Intelligence; SYSTEM; TIME; OPTIMIZATION; MODEL;
D O I
10.3389/frobt.2022.1027340
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
The smart factory is at the heart of Industry 4.0 and is the new paradigm for establishing advanced manufacturing systems and realizing modern manufacturing objectives such as mass customization, automation, efficiency, and self-organization all at once. Such manufacturing systems, however, are characterized by dynamic and complex environments where a large number of decisions should be made for smart components such as production machines and the material handling system in a real-time and optimal manner. AI offers key intelligent control approaches in order to realize efficiency, agility, and automation all at once. One of the most challenging problems faced in this regard is uncertainty, meaning that due to the dynamic nature of the smart manufacturing environments, sudden seen or unseen events occur that should be handled in real-time. Due to the complexity and high-dimensionality of smart factories, it is not possible to predict all the possible events or prepare appropriate scenarios to respond. Reinforcement learning is an AI technique that provides the intelligent control processes needed to deal with such uncertainties. Due to the distributed nature of smart factories and the presence of multiple decision-making components, multi-agent reinforcement learning (MARL) should be incorporated instead of single-agent reinforcement learning (SARL), which, due to the complexities involved in the development process, has attracted less attention. In this research, we will review the literature on the applications of MARL to tasks within a smart factory and then demonstrate a mapping connecting smart factory attributes to the equivalent MARL features, based on which we suggest MARL to be one of the most effective approaches for implementing the control mechanism for smart factories.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Multi-agent reinforcement learning for online scheduling in smart factories
    Zhou, Tong
    Tang, Dunbing
    Zhu, Haihua
    Zhang, Zequn
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2021, 72
  • [2] Multi-Agent Reinforcement Learning: A Review of Challenges and Applications
    Canese, Lorenzo
    Cardarilli, Gian Carlo
    Di Nunzio, Luca
    Fazzolari, Rocco
    Giardino, Daniele
    Re, Marco
    Spano, Sergio
    APPLIED SCIENCES-BASEL, 2021, 11 (11):
  • [3] A Review of Multi-agent Reinforcement Learning Theory and Applications
    Chen, Zhuoran
    Liu, Zeyang
    Wan, Lipeng
    Chen, Xingyu
    Zhu, Yameng
    Wang, Chengze
    Cheng, Xiang
    Zhang, Ya
    Zhang, Senlin
    Wang, Xiaohui
    Lan, Xuguang
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2024, 37 (10): : 851 - 872
  • [4] A Review of Multi-Agent Reinforcement Learning Algorithms
    Liang, Jiaxin
    Miao, Haotian
    Li, Kai
    Tan, Jianheng
    Wang, Xi
    Luo, Rui
    Jiang, Yueqiu
    ELECTRONICS, 2025, 14 (04):
  • [5] Multi-Agent Reinforcement Learning for Smart Community Energy Management
    Wilk, Patrick
    Wang, Ning
    Li, Jie
    ENERGIES, 2024, 17 (20)
  • [6] Smart Grid for Industry Using Multi-Agent Reinforcement Learning
    Roesch, Martin
    Linder, Christian
    Zimmermann, Roland
    Rudolf, Andreas
    Hohmann, Andrea
    Reinhart, Gunther
    APPLIED SCIENCES-BASEL, 2020, 10 (19): : 1 - 20
  • [7] A review of cooperative multi-agent deep reinforcement learning
    Afshin Oroojlooy
    Davood Hajinezhad
    Applied Intelligence, 2023, 53 : 13677 - 13722
  • [8] A review of cooperative multi-agent deep reinforcement learning
    Oroojlooy, Afshin
    Hajinezhad, Davood
    APPLIED INTELLIGENCE, 2023, 53 (11) : 13677 - 13722
  • [9] Multi-Agent Reinforcement Learning
    Stankovic, Milos
    2016 13TH SYMPOSIUM ON NEURAL NETWORKS AND APPLICATIONS (NEUREL), 2016, : 43 - 43
  • [10] A Survey on Multi-Agent Reinforcement Learning Applications in the Internet of Vehicles
    Mianji, Elham Mohammadzadeh
    Fardad, Mohammad
    Muntean, Gabriel-Miro
    Tal, Irina
    2024 IEEE 99TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2024-SPRING, 2024,