Genetic Programming and Reinforcement Learning on Learning Heuristics for Dynamic Scheduling: A Preliminary Comparison

被引:2
|
作者
Xu, Meng [1 ]
Mei, Yi [1 ]
Zhang, Fangfang [1 ]
Zhang, Mengjie [1 ]
机构
[1] Victoria Univ Wellington, Wellington, New Zealand
关键词
Job shop scheduling; Processor scheduling; Heuristic algorithms; Training data; Genetic programming; Reinforcement learning; Dynamic scheduling;
D O I
10.1109/MCI.2024.3363970
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Scheduling heuristics are commonly used to solve dynamic scheduling problems in real-world applications. However, designing effective heuristics can be time-consuming and often leads to suboptimal performance. Genetic programming has been widely used to automatically learn scheduling heuristics. In recent years, reinforcement learning has also gained attention in this field. Understanding their strengths and weaknesses is crucial for developing effective scheduling heuristics. This paper takes a typical genetic programming method and a typical reinforcement learning method in dynamic flexible job shop scheduling for investigation. The results show that the investigated genetic programming algorithm outperforms the studied reinforcement learning method in the examined scenarios. Also, the study reveals that the compared reinforcement learning method is more stable as the amount of training data changes, and the investigated genetic programming method can learn more effective scheduling heuristics as training data increases. Additionally, the study highlights the potential and value of genetic programming in real-world applications due to its good generalization ability and interpretability. Based on the results, this paper suggests using the investigated reinforcement learning method when training data is limited and stable results are required, and using the investigated genetic programming method when training data is sufficient and high interpretability is required.
引用
收藏
页码:18 / 33
页数:16
相关论文
共 50 条
  • [1] Learning Strategies on Scheduling Heuristics of Genetic Programming in Dynamic Flexible Job Shop Scheduling
    Zhang, Fangfang
    Mei, Yi
    Nguyen, Su
    Zhang, Mengjie
    [J]. 2022 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2022,
  • [2] Importance-Aware Genetic Programming for Automated Scheduling Heuristics Learning in Dynamic Flexible Job Shop Scheduling
    Zhang, Fangfang
    Mei, Yi
    Nguyen, Su
    Zhang, Mengjie
    [J]. PARALLEL PROBLEM SOLVING FROM NATURE - PPSN XVII, PPSN 2022, PT II, 2022, 13399 : 48 - 62
  • [3] Sample-Aware Surrogate-Assisted Genetic Programming for Scheduling Heuristics Learning in Dynamic Flexible Job Shop Scheduling
    Zhu, Luyao
    Zhang, Fangfang
    Zhu, Xiaodong
    Chen, Ke
    Zhang, Mengjie
    [J]. PROCEEDINGS OF THE 2023 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, GECCO 2023, 2023, : 384 - 392
  • [4] Learning single-machine scheduling heuristics subject to machine breakdowns with genetic programming
    Yin, WJ
    Liu, M
    Wu, C
    [J]. CEC: 2003 CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1-4, PROCEEDINGS, 2003, : 1050 - 1055
  • [5] Genetic Programming Methods for Reinforcement Learning
    Babuska, Robert
    [J]. PROCEEDINGS OF THE 2019 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (GECCO'19), 2019, : 2 - 2
  • [6] A reinforcement learning algorithm to improve scheduling search heuristics with the SVM
    Gersmann, K
    Hammer, B
    [J]. 2004 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2004, : 1811 - 1816
  • [7] Dynamic learning in genetic programming
    Chiu, CC
    [J]. INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL I AND II, 1999, : 416 - 422
  • [8] A comparison of hybrid incremental Reuse strategies for reinforcement learning in genetic programming
    Harmon, S
    Rodríguez, E
    Zhong, C
    Hsu, W
    [J]. GENETIC AND EVOLUTIONARY COMPUTATION GECCO 2004 , PT 2, PROCEEDINGS, 2004, 3103 : 706 - 707
  • [9] Genetic Programming Approach to Learning Multi-pass Heuristics for Resource Constrained Job Scheduling
    Su Nguyen
    Thiruvady, Dhananjay
    Ernst, Andreas
    Alahakoon, Damminda
    [J]. GECCO'18: PROCEEDINGS OF THE 2018 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2018, : 1167 - 1174
  • [10] Interpretable policies for reinforcement learning by genetic programming
    Hein, Daniel
    Udluft, Steffen
    Runkler, Thomas A.
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2018, 76 : 158 - 169