A reinforcement learning-driven adaptive decomposition algorithm for multi-objective hybrid seru system scheduling considering worker transfer

被引:2
|
作者
Wu, Yuting [1 ]
Wang, Ling [1 ,2 ]
Li, Rui [1 ]
Chen, Jing-fang [1 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Huazhong Univ Sci & Technol, State Key Lab Intelligent Mfg Equipment & Technol, Wuhan 430074, Peoples R China
关键词
Hybrid seru system; Worker transfer; Deep reinforcement learning; Multi-objective optimization; Adaptive decomposition strategy; LINE; MODEL;
D O I
10.1016/j.swevo.2024.101602
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The application of hybrid seru manufacturing in real-world production often necessitates the implementation of a worker transfer strategy to overcome limitations in skill levels and realize the co-optimization of production efficiency and worker workload. Therefore, this study focuses on hybrid seru system scheduling considering worker transfer (HSSWT) to minimize both the makespan and the total labor time. The presence of multiple optimization objectives and coupled subproblems results in a considerably large search space, which poses challenges that existing optimization frameworks cannot effectively address. Thus, we propose a reinforcement learning-driven adaptive decomposition algorithm (RLADA) to address this issue. First, to minimize the search space, the HSSWT is decomposed into two subproblems, each utilizing distinct search strategies to explore specific areas. Elite-driven population evolution and a lower bound-guided greedy search are proposed to solve the individual subproblems. Second, a deep Q-network has been developed to adaptively select the subproblem to optimize in each generation by dynamically dividing the objective space. Finally, to narrow the search space, the lower bound is used to filter out unpromising solutions, thereby avoiding invalid searches. Additionally, the lower bound is utilized to determine the search depth according to the optimization margin, helping to conserve computing resources. Extensive comparative results demonstrate the effectiveness of the specialized designs, and the RLADA outperforms state-of-the-art algorithms in terms of solution convergence and diversity when addressing the HSSWT.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Multi-objective Reinforcement Learning Algorithm for MOSDMP in Unknown Environment
    Zhao, Yun
    Chen, Qingwei
    Hu, Weili
    2010 8TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2010, : 3190 - 3194
  • [42] A Generalized Algorithm for Multi-Objective Reinforcement Learning and Policy Adaptation
    Yang, Runzhe
    Sun, Xingyuan
    Narasimhan, Karthik
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [43] Scheduling multi-objective open shop scheduling using a hybrid immune algorithm
    B. Naderi
    M. Mousakhani
    M. Khalili
    The International Journal of Advanced Manufacturing Technology, 2013, 66 : 895 - 905
  • [44] An Improved Multi-objective Optimization Algorithm Based on Reinforcement Learning
    Liu, Jun
    Zhou, Yi
    Qiu, Yimin
    Li, Zhongfeng
    ADVANCES IN SWARM INTELLIGENCE, ICSI 2022, PT I, 2022, : 501 - 513
  • [45] SIMULATION BASED MULTI-OBJECTIVE FAB SCHEDULING BY USING REINFORCEMENT LEARNING
    Lee, Won-Jun
    Kim, Byung-Hee
    Ko, Keyhoon
    Shin, Hayong
    2019 WINTER SIMULATION CONFERENCE (WSC), 2019, : 2236 - 2247
  • [46] Scheduling multi-objective open shop scheduling using a hybrid immune algorithm
    Naderi, B.
    Mousakhani, M.
    Khalili, M.
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2013, 66 (5-8): : 895 - 905
  • [47] Multi-Objective Resource Scheduling for IoT Systems Using Reinforcement Learning
    Shresthamali, Shaswot
    Kondo, Masaaki
    Nakamura, Hiroshi
    JOURNAL OF LOW POWER ELECTRONICS AND APPLICATIONS, 2022, 12 (04)
  • [48] An efficient and invertible machine learning-driven multi-objective optimization architecture for light olefins separation system
    Yang, Lu
    Liu, Shuoshi
    Chang, Chenglin
    Yang, Siyu
    Shen, Weifeng
    CHEMICAL ENGINEERING SCIENCE, 2024, 285
  • [49] A hybrid genetic algorithm for multi-objective flexible job shop scheduling problem considering transportation time
    Huang, Xiabao
    Yang, Lixi
    INTERNATIONAL JOURNAL OF INTELLIGENT COMPUTING AND CYBERNETICS, 2019, 12 (02) : 154 - 174
  • [50] An adaptive multi-objective algorithm based on decomposition and large neighborhood search for a green machine scheduling problem
    Cota, Luciano P.
    Guimaraes, Frederico G.
    Ribeiro, Roberto G.
    Meneghini, Ivan R.
    de Oliveira, Fernando B.
    Souza, Marcone J. F.
    Siarry, Patrick
    SWARM AND EVOLUTIONARY COMPUTATION, 2019, 51