Deep Reinforcement Learning for Semiconductor Production Scheduling

被引:0
|
作者
Waschneck, Bernd [1 ]
Reichstaller, Andre [2 ]
Belzner, Lenz [3 ]
Altenmueller, Thomas [4 ]
Bauernhansl, Thomas [5 ]
Knapp, Alexander [2 ]
Kyek, Andreas [4 ]
机构
[1] Univ Stuttgart, GSaME, Nobelstr 12, D-70569 Stuttgart, Germany
[2] Univ Augsburg, Inst Software & Syst Engn, Augsburg, Germany
[3] Lenz Belzner AI Consulting, Munich, Germany
[4] Infineon Technol AG, Campeon 1-12, D-85579 Neubiberg, Germany
[5] Fraunhofer Inst Mfg Engn & Automat IPA, Nobelstr 12, D-70569 Stuttgart, Germany
关键词
Production Scheduling; Reinforcement Learning; Machine Learning; Semiconductor Manufacturing;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Despite producing tremendous success stories by identifying cat videos [1] or solving computer as well as board games [2], [3], the adoption of deep learning in the semiconductor industry is moderatre. In this paper, we apply Google DeepMind's Deep Q Network (DQN) agent algorithm for Reinforcement Learning (RL) to semiconductor production scheduling. In an RL environment several cooperative DQN agents, which utilize deep neural networks, are trained with flexible user-defined objectives. We show benchmarks comparing standard dispatching heuristics with the DQN agents in an abstract frontend-of-line semiconductor production facility. Results are promising and show that DQN agents optimize production autonomously for different targets.
引用
下载
收藏
页码:301 / 306
页数:6
相关论文
共 50 条
  • [1] Deep reinforcement learning based scheduling within production plan in semiconductor fabrication
    Lee, Young Hoon
    Lee, Seunghoon
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 191
  • [2] A Practical Deep Reinforcement Learning Approach to Semiconductor Equipment Scheduling
    Lee, Changhee
    Lee, Sunghee
    2021 22ND IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), 2021, : 979 - 985
  • [3] Optimization of global production scheduling with deep reinforcement learning
    Waschneck, Bernd
    Reichstaller, Andre
    Belzner, Lenz
    Altenmueller, Thomas
    Bauernhansl, Thomas
    Knapp, Alexander
    Kyek, Andreas
    51ST CIRP CONFERENCE ON MANUFACTURING SYSTEMS, 2018, 72 : 1264 - 1269
  • [4] A deep reinforcement learning approach for chemical production scheduling
    Hubbs, Christian D.
    Li, Can
    Sahinidis, Nikolaos, V
    Grossmann, Ignacio E.
    Wassick, John M.
    COMPUTERS & CHEMICAL ENGINEERING, 2020, 141
  • [5] Scalable Scheduling of Semiconductor Packaging Facilities Using Deep Reinforcement Learning
    Park, In-Beom
    Park, Jonghun
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (06) : 3518 - 3531
  • [6] Deep Reinforcement Learning for Long Term Hydropower Production Scheduling
    Riemer-Sorensen, Signe
    Rosenlund, Gjert H.
    2020 INTERNATIONAL CONFERENCE ON SMART ENERGY SYSTEMS AND TECHNOLOGIES (SEST), 2020,
  • [7] Deep reinforcement learning optimization scheduling algorithm for continuous production line
    Zhu, Guang-He
    Zhu, Zhi-Qiang
    Yuan, Yi-Ping
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2024, 54 (07): : 2086 - 2092
  • [8] Injection Mold Production Sustainable Scheduling Using Deep Reinforcement Learning
    Lee, Seunghoon
    Cho, Yongju
    Lee, Young Hoon
    SUSTAINABILITY, 2020, 12 (20) : 1 - 17
  • [9] Production Scheduling Using Deep Reinforcement Learning and Discrete Event Simulation
    Hubert, Stefan
    Meintschel, Jonas
    Bleidorn, Dominik
    Ortmanns, Yak
    Wallrath, Roderich
    CHEMIE INGENIEUR TECHNIK, 2023, 95 (07) : 1003 - 1011
  • [10] A Deep Reinforcement Learning Approach for Production Scheduling with the Use of Dispatch Rules
    Mavrothalassitis, Panagiotis
    Bakopoulos, Emmanouil
    Siatras, Vasilis
    Nikolakis, Nikolaos
    Alexopoulos, Kosmas
    ADVANCES IN ARTIFICIAL INTELLIGENCE IN MANUFACTURING, ESAIM 2023, 2024, : 43 - 50