Deep reinforcement learning for optimal planning of assembly line maintenance

被引:5
|
作者
Geurtsen, M. [1 ,2 ]
Adan, I. [1 ]
Atan, Z. [1 ]
机构
[1] Eindhoven Univ Technol Zaale, Dept Ind Engn, NL-5600 MB Eindhoven, Netherlands
[2] Nexperia, ITEC, Jonkerbosplein 52, NL-6534 AB Nijmegen, Netherlands
关键词
Scheduling; Maintenance; Deep reinforcement learning; Simulation; Case-study; Flexibility; OPTIMAL PREVENTIVE MAINTENANCE; PRODUCTION SYSTEM; OPPORTUNISTIC MAINTENANCE; MULTICOMPONENT SYSTEMS; PERFORMANCE EVALUATION; BUFFER; POLICY; OPTIMIZATION; COST;
D O I
10.1016/j.jmsy.2023.05.011
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Discovering the optimal maintenance planning strategy can have a substantial impact on production efficiency, yet this aspect is often overlooked in favor of production planning. This is a missed opportunity as maintenance and production activities are deeply intertwined. Our study sheds light on the significance of maintenance planning, particularly in the dynamic setting of an assembly line. By maximizing the average production rate and incorporating flexible planning windows, buffer content, and machine production states, a unique problem is addressed in which a policy for planning maintenance on the final machine of a serial assembly line is developed. To achieve this, novel average-reward deep reinforcement learning techniques are employed and pitted against generic dispatching methods. Using a digital twin with real-world data, experiments demonstrate the immense potential of this new deep reinforcement learning technique, producing policies that outperform generic dispatching strategies and practitioner policies.
引用
收藏
页码:170 / 188
页数:19
相关论文
共 50 条
  • [1] Efficient Deep Reinforcement Learning for Optimal Path Planning
    Ren, Jing
    Huang, Xishi
    Huang, Raymond N.
    [J]. ELECTRONICS, 2022, 11 (21)
  • [2] A deep reinforcement learning approach for rail renewal and maintenance planning
    Mohammadi, Reza
    He, Qing
    [J]. RELIABILITY ENGINEERING & SYSTEM SAFETY, 2022, 225
  • [3] Optimal policy for structure maintenance: A deep reinforcement learning framework
    Wei, Shiyin
    Bao, Yuequan
    Li, Hui
    [J]. STRUCTURAL SAFETY, 2020, 83
  • [4] A HEURISTICALLY ACCELERATED REINFORCEMENT LEARNING METHOD FOR MAINTENANCE POLICY OF AN ASSEMBLY LINE
    Wang, Xiao
    Zhang, Guowei
    Li, Yongqiang
    Qu, Na
    [J]. JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2023, 19 (04) : 2381 - 2395
  • [5] A maintenance planning framework using online and offline deep reinforcement learning
    Bukhsh, Zaharah A.
    Molegraaf, Hajo
    Jansen, Nils
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023,
  • [6] Deep reinforcement learning for long-term pavement maintenance planning
    Yao, Linyi
    Dong, Qiao
    Jiang, Jiwang
    Ni, Fujian
    [J]. COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2020, 35 (11) : 1230 - 1245
  • [7] Optimal Planning of Emergency Communication Network Using Deep Reinforcement Learning
    Yin, Changsheng
    Yang, Ruopeng
    Zhu, Wei
    Zou, Xiaofei
    Zhang, Junda
    [J]. IEICE TRANSACTIONS ON COMMUNICATIONS, 2021, E104B (01) : 20 - 26
  • [8] A deep reinforcement learning assisted simulated annealing algorithm for a maintenance planning problem
    Kosanoglu, Fuat
    Atmis, Mahir
    Turan, Hasan Huseyin
    [J]. ANNALS OF OPERATIONS RESEARCH, 2024, 339 (1-2) : 79 - 110
  • [9] Deep reinforcement learning applied to an assembly sequence planning problem with user preferences
    Neves, Miguel
    Neto, Pedro
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2022, 122 (11-12): : 4235 - 4245
  • [10] Deep reinforcement learning applied to an assembly sequence planning problem with user preferences
    Miguel Neves
    Pedro Neto
    [J]. The International Journal of Advanced Manufacturing Technology, 2022, 122 : 4235 - 4245