A reinforcement learning-driven adaptive decomposition algorithm for multi-objective hybrid seru system scheduling considering worker transfer

被引:2
|
作者
Wu, Yuting [1 ]
Wang, Ling [1 ,2 ]
Li, Rui [1 ]
Chen, Jing-fang [1 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Huazhong Univ Sci & Technol, State Key Lab Intelligent Mfg Equipment & Technol, Wuhan 430074, Peoples R China
关键词
Hybrid seru system; Worker transfer; Deep reinforcement learning; Multi-objective optimization; Adaptive decomposition strategy; LINE; MODEL;
D O I
10.1016/j.swevo.2024.101602
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The application of hybrid seru manufacturing in real-world production often necessitates the implementation of a worker transfer strategy to overcome limitations in skill levels and realize the co-optimization of production efficiency and worker workload. Therefore, this study focuses on hybrid seru system scheduling considering worker transfer (HSSWT) to minimize both the makespan and the total labor time. The presence of multiple optimization objectives and coupled subproblems results in a considerably large search space, which poses challenges that existing optimization frameworks cannot effectively address. Thus, we propose a reinforcement learning-driven adaptive decomposition algorithm (RLADA) to address this issue. First, to minimize the search space, the HSSWT is decomposed into two subproblems, each utilizing distinct search strategies to explore specific areas. Elite-driven population evolution and a lower bound-guided greedy search are proposed to solve the individual subproblems. Second, a deep Q-network has been developed to adaptively select the subproblem to optimize in each generation by dynamically dividing the objective space. Finally, to narrow the search space, the lower bound is used to filter out unpromising solutions, thereby avoiding invalid searches. Additionally, the lower bound is utilized to determine the search depth according to the optimization margin, helping to conserve computing resources. Extensive comparative results demonstrate the effectiveness of the specialized designs, and the RLADA outperforms state-of-the-art algorithms in terms of solution convergence and diversity when addressing the HSSWT.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] A Multi-Objective Scheduling Algorithm Suitable for WiMAX System
    Zhao JinKui
    Gu XueMai
    Sh Shuo
    PROCEEDINGS OF THE 14TH YOUTH CONFERENCE ON COMMUNICATION, 2009, : 834 - 837
  • [32] A hybrid algorithm for multi-objective job shop scheduling problem
    Li, Junqing
    Pan, Quanke
    Xie, Shengxian
    Gao, Kaizhou
    Wang, Yuting
    2011 CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-6, 2011, : 3630 - 3634
  • [33] Multi-Objective Optimization Using Adaptive Distributed Reinforcement Learning
    Tan, Jing
    Khalili, Ramin
    Karl, Holger
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (09) : 10777 - 10789
  • [34] Hybrid Evolutionary Algorithm for Multi-Objective Job Shop Scheduling
    Qin, Chaoyong
    Zhu, Jianjun
    Zheng, Jianguo
    2009 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND INTELLIGENT SYSTEMS, PROCEEDINGS, VOL 2, 2009, : 168 - +
  • [35] A hybrid multi-objective immune algorithm for predictive and reactive scheduling
    Paprocka, Iwona
    Skolud, Bozena
    JOURNAL OF SCHEDULING, 2017, 20 (02) : 165 - 182
  • [36] An adaptive disturbance multi-objective evolutionary algorithm based on decomposition
    Shi, Yanfang
    Shi, Jianguo
    INTERNATIONAL JOURNAL OF MODELLING IDENTIFICATION AND CONTROL, 2022, 41 (04) : 306 - 315
  • [37] A hybrid multi-objective immune algorithm for predictive and reactive scheduling
    Iwona Paprocka
    Bożena Skołud
    Journal of Scheduling, 2017, 20 : 165 - 182
  • [38] A Data-Driven Reinforcement Learning Based Multi-Objective Route Recommendation System
    Sarker, Ankur
    Shen, Haiying
    Kowsari, Kamran
    2020 IEEE 17TH INTERNATIONAL CONFERENCE ON MOBILE AD HOC AND SMART SYSTEMS (MASS 2020), 2020, : 103 - 111
  • [39] An XCS-based Algorithm for Multi-Objective Reinforcement Learning
    Cheng, Xiu
    Chen, Gang
    Zhang, Mengjie
    2016 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2016, : 4007 - 4014
  • [40] A Multi-objective Hybrid Genetic Algorithm for Energy Saving Task Scheduling in CMP System
    Miao, Lei
    Qi, Yong
    Hou, Di
    Dai, Yue-hua
    Shi, Yi
    2008 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), VOLS 1-6, 2008, : 197 - 201