Smart Short Term Capacity Planning: A Reinforcement Learning Approach

被引:3
|
作者
Schneckenreither, Manuel [1 ]
Windmueller, Sebastian [1 ]
Haeussler, Stefan [1 ]
机构
[1] Univ Innsbruck, Dept Informat Syst Prod & Logist, Innsbruck, Austria
关键词
Reinforcement learning; Capacity planning; Simulation; DYNAMIC CONTROL POLICIES; WEIGHTED TARDINESS; OVERTIME COSTS; SEARCH;
D O I
10.1007/978-3-030-85874-2_27
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Capacity planning is an important production control function that significantly influences firm performance. Especially, in the short term, we face a dynamically changing system which calls for an adaptive capacity planning system that reacts based on the current state of the shop floor. Thus, this paper analyzes the performance of a reinforcement learning (RL) algorithm for overtime planning for a make-to-order job shop. We compare the performance of the RL algorithm to mechanisms that set overtime-hours statically or randomly over time. Performance is measured in total costs which consist of overtime, holding and backorder costs. The results show that our tested benchmarks can be outperformed by the RL algorithm, where the major savings were achieved due to less needed overtime.
引用
收藏
页码:258 / 266
页数:9
相关论文
共 50 条
  • [1] A Deep Reinforcement Learning Approach for Long-term Short-term Planning on Frenet Frame
    Moghadam, Majid
    Alizadeh, Ali
    Tekin, Engin
    Elkaim, Gabriel Hugh
    2021 IEEE 17TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2021, : 1751 - 1756
  • [2] A Deep Reinforcement Learning Approach for Smart Coordination Between Production Planning and Scheduling
    Gomez-Gasquet, Pedro
    Boza, Andres
    Perez Perales, David
    Esteso, Ana
    ENTERPRISE INTEROPERABILITY X, EI 2022, 2024, 11 : 195 - 206
  • [3] Short-Term Trajectory Planning in TORCS using Deep Reinforcement Learning
    Capo, Emilio
    Loiacono, Daniele
    2020 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2020, : 2327 - 2334
  • [4] Planning Assistant for Medium-term Capacity Management using Deep Reinforcement Learning
    Kulmer, Florian
    Wolf, Matthias
    Ramsauer, Christian
    IFAC PAPERSONLINE, 2024, 58 (19): : 31 - 36
  • [5] A knowledge-free path planning approach for smart ships based on reinforcement learning
    Chen, Chen
    Chen, Xian-Qiao
    Ma, Feng
    Zeng, Xiao-Jun
    Wang, Jin
    OCEAN ENGINEERING, 2019, 189
  • [6] Deer in The Headlights: Short Term Planning via Reinforcement Learning Algorithms for Autonomous Vehicles
    Hishmeh, Lyth
    Awad, Fahed
    2020 11TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS), 2020, : 255 - 260
  • [7] A Reinforcement Learning Approach for Smart Irrigation Systems
    Campoverde, Luis Miguel Samaniego
    Palmieria, Nunzia
    AUTONOMOUS AIR AND GROUND SENSING SYSTEMS FOR AGRICULTURAL OPTIMIZATION AND PHENOTYPING VII, 2022, 12114
  • [8] Reinforcement Learning Based Approach for Smart Homes
    Mirra, Jose
    Silva, Fabio
    Analide, Cesar
    INTELLIGENT ENVIRONMENTS 2018, 2018, 23 : 38 - 47
  • [9] Short-Term Load Forecasting Method Based on Deep Reinforcement Learning for Smart Grid
    Guo, Wei
    Zhang, Kai
    Wei, Xinjie
    Liu, Mei
    MOBILE INFORMATION SYSTEMS, 2021, 2021
  • [10] A Reinforcement Learning Approach to the View Planning Problem
    Kaba, Mustafa Devrim
    Uzunbas, Mustafa Gokhan
    Lim, Ser Nam
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5094 - 5102