A reinforcement learning-driven adaptive decomposition algorithm for multi-objective hybrid seru system scheduling considering worker transfer

被引:2
|
作者
Wu, Yuting [1 ]
Wang, Ling [1 ,2 ]
Li, Rui [1 ]
Chen, Jing-fang [1 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Huazhong Univ Sci & Technol, State Key Lab Intelligent Mfg Equipment & Technol, Wuhan 430074, Peoples R China
关键词
Hybrid seru system; Worker transfer; Deep reinforcement learning; Multi-objective optimization; Adaptive decomposition strategy; LINE; MODEL;
D O I
10.1016/j.swevo.2024.101602
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The application of hybrid seru manufacturing in real-world production often necessitates the implementation of a worker transfer strategy to overcome limitations in skill levels and realize the co-optimization of production efficiency and worker workload. Therefore, this study focuses on hybrid seru system scheduling considering worker transfer (HSSWT) to minimize both the makespan and the total labor time. The presence of multiple optimization objectives and coupled subproblems results in a considerably large search space, which poses challenges that existing optimization frameworks cannot effectively address. Thus, we propose a reinforcement learning-driven adaptive decomposition algorithm (RLADA) to address this issue. First, to minimize the search space, the HSSWT is decomposed into two subproblems, each utilizing distinct search strategies to explore specific areas. Elite-driven population evolution and a lower bound-guided greedy search are proposed to solve the individual subproblems. Second, a deep Q-network has been developed to adaptively select the subproblem to optimize in each generation by dynamically dividing the objective space. Finally, to narrow the search space, the lower bound is used to filter out unpromising solutions, thereby avoiding invalid searches. Additionally, the lower bound is utilized to determine the search depth according to the optimization margin, helping to conserve computing resources. Extensive comparative results demonstrate the effectiveness of the specialized designs, and the RLADA outperforms state-of-the-art algorithms in terms of solution convergence and diversity when addressing the HSSWT.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] A reinforcement learning driven two-stage evolutionary optimisation for hybrid seru system scheduling with worker transfer
    Wu, Yuting
    Wang, Ling
    Chen, Jing-fang
    Zheng, Jie
    Pan, Zixiao
    INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2024, 62 (11) : 3952 - 3971
  • [2] Multi-objective scheduling algorithm for one worker job shop considering learning effect
    Hu J.
    Liu Z.
    Ma W.
    Wu Y.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2021, 27 (05): : 1361 - 1370
  • [3] Decomposition based Multi-Objective Evolutionary Algorithm in XCS for Multi-Objective Reinforcement Learning
    Cheng, Xiu
    Browne, Will N.
    Zhang, Mengjie
    2018 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2018, : 622 - 629
  • [4] Seru scheduling problem with lot streaming and worker transfers: A multi-objective approach
    Yilmaz, Beren Gursoy
    Yilmaz, Omer Faruk
    Akcali, Elif
    Cevikcan, Emre
    COMPUTERS & OPERATIONS RESEARCH, 2025, 177
  • [5] Multi-Objective Order Scheduling via Reinforcement Learning
    Chen, Sirui
    Tian, Yuming
    An, Lingling
    ALGORITHMS, 2023, 16 (11)
  • [6] A reinforcement learning-driven brain storm optimisation algorithm for multi-objective energy-efficient distributed assembly no-wait flow shop scheduling problem
    Zhao, Fuqing
    Hu, Xiaotong
    Wang, Ling
    Xu, Tianpeng
    Zhu, Ningning
    Zhu, Ningning
    INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2023, 61 (09) : 2853 - 2871
  • [7] An adaptive multi-objective multi-task scheduling method by hierarchical deep reinforcement learning
    Zhang, Jianxiong
    Guo, Bing
    Ding, Xuefeng
    Hu, Dasha
    Tang, Jun
    Du, Ke
    Tang, Chao
    Jiang, Yuming
    APPLIED SOFT COMPUTING, 2024, 154
  • [8] Reinforcement Learning Driven Cross-Trained Worker Assignment Approach Based on Big Models: A Study for A Hybrid Seru Production System Considering Learning Effect
    Li, Taixin
    Ye, Chenxi
    Wu, Lang
    Liu, Feng
    Yu, Chengxiao
    Computational Intelligence, 2025, 41 (02)
  • [9] An Intelligent Scheduling Strategy in Fog Computing System Based on Multi-Objective Deep Reinforcement Learning Algorithm
    Ibrahim, Media Ali
    Askar, Shavan
    IEEE ACCESS, 2023, 11 : 133607 - 133622
  • [10] Multi-Objective Reinforcement Learning Algorithm and Its Application in Drive System
    Zhang Huajun
    Zhao Jin
    Wang Rui
    Ma Tan
    IECON 2008: 34TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, VOLS 1-5, PROCEEDINGS, 2008, : 225 - 230