A reinforcement learning-driven adaptive decomposition algorithm for multi-objective hybrid seru system scheduling considering worker transfer

被引:2
|
作者
Wu, Yuting [1 ]
Wang, Ling [1 ,2 ]
Li, Rui [1 ]
Chen, Jing-fang [1 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Huazhong Univ Sci & Technol, State Key Lab Intelligent Mfg Equipment & Technol, Wuhan 430074, Peoples R China
关键词
Hybrid seru system; Worker transfer; Deep reinforcement learning; Multi-objective optimization; Adaptive decomposition strategy; LINE; MODEL;
D O I
10.1016/j.swevo.2024.101602
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The application of hybrid seru manufacturing in real-world production often necessitates the implementation of a worker transfer strategy to overcome limitations in skill levels and realize the co-optimization of production efficiency and worker workload. Therefore, this study focuses on hybrid seru system scheduling considering worker transfer (HSSWT) to minimize both the makespan and the total labor time. The presence of multiple optimization objectives and coupled subproblems results in a considerably large search space, which poses challenges that existing optimization frameworks cannot effectively address. Thus, we propose a reinforcement learning-driven adaptive decomposition algorithm (RLADA) to address this issue. First, to minimize the search space, the HSSWT is decomposed into two subproblems, each utilizing distinct search strategies to explore specific areas. Elite-driven population evolution and a lower bound-guided greedy search are proposed to solve the individual subproblems. Second, a deep Q-network has been developed to adaptively select the subproblem to optimize in each generation by dynamically dividing the objective space. Finally, to narrow the search space, the lower bound is used to filter out unpromising solutions, thereby avoiding invalid searches. Additionally, the lower bound is utilized to determine the search depth according to the optimization margin, helping to conserve computing resources. Extensive comparative results demonstrate the effectiveness of the specialized designs, and the RLADA outperforms state-of-the-art algorithms in terms of solution convergence and diversity when addressing the HSSWT.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] A Multi-objective Reinforcement Learning Algorithm for JS']JSSP
    Mendez-Hernandez, Beatriz M.
    Rodriguez-Bazan, Erick D.
    Martinez-Jimenez, Yailen
    Libin, Pieter
    Nowe, Ann
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: THEORETICAL NEURAL COMPUTATION, PT I, 2019, 11727 : 567 - 584
  • [22] A Fuzzy Simulated Evolution Algorithm for Multi-Objective Homecare Worker Scheduling
    Mutingi, M.
    Mbohwa, C.
    2013 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING AND ENGINEERING MANAGEMENT (IEEM 2013), 2013, : 586 - 590
  • [23] A Novel Adaptive Weight Selection Algorithm for Multi-Objective Multi-Agent Reinforcement Learning
    Van Moffaert, Kristof
    Brys, Tim
    Chandra, Arjun
    Esterle, Lukas
    Lewis, Peter R.
    Nowe, Ann
    PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 2306 - 2314
  • [24] Multi-objective flow shop optimal scheduling considering worker's load
    Sun, Bao-Feng
    Ren, Xin-Xin
    Zheng, Zai-Si
    Li, Guo-Yi
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2021, 51 (03): : 900 - 909
  • [25] Adaptive Objective Selection for Correlated Objectives in Multi-Objective Reinforcement Learning
    Brys, Tim
    Van Moffaert, Kristof
    Nowe, Ann
    Taylor, Matthew E.
    AAMAS'14: PROCEEDINGS OF THE 2014 INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS & MULTIAGENT SYSTEMS, 2014, : 1349 - 1350
  • [26] A deep reinforcement learning-driven multi-objective optimization and its applications on aero-engine maintenance strategy
    Wei, Zeqi
    Zhao, Zhibin
    Zhou, Zheng
    Ren, Jiaxin
    Tang, Yajun
    Yan, Ruqiang
    JOURNAL OF MANUFACTURING SYSTEMS, 2024, 74 : 316 - 328
  • [27] Multi-Objective Reinforcement Learning Based on Decomposition: A Taxonomy and Framework
    Felten, Florian
    Talbi, El-Ghazali
    Danoy, Gregoire
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2024, 79 : 679 - 723
  • [28] Multi-objective Reconfigurable Manufacturing System Scheduling Optimisation: A Deep Reinforcement Learning Approach
    Tang, Jiecheng
    Haddad, Yousef
    Patsavellas, John
    Salonitis, Konstantinos
    IFAC PAPERSONLINE, 2023, 56 (02): : 11082 - 11087
  • [29] Scheduling of Continuous Annealing With a Multi-Objective Differential Evolution Algorithm Based on Deep Reinforcement Learning
    Li, Tianyang
    Meng, Ying
    Tang, Lixin
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, 21 (02) : 1767 - 1780
  • [30] Transfer Learning Based Multi-Objective Evolutionary Algorithm for Dynamic Workflow Scheduling in the Cloud
    Xie, Huamao
    Ding, Ding
    Zhao, Lihong
    Kang, Kaixuan
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2024, 12 (04) : 1200 - 1217