Improved meta-heuristics with Q-learning for solving distributed assembly permutation flowshop scheduling problems

被引:24
|
作者
Yu, Hui [1 ]
Gao, Kai-Zhou [1 ]
Ma, Zhen-Fang [1 ]
Pan, Yu-Xia [2 ]
机构
[1] Macau Univ Sci & Technol, Macau Inst Syst Engn, Macau 999078, Peoples R China
[2] Huzhou Vocat & Tech Coll, Informat Engn & Internet Things, Huzhou 313000, Peoples R China
基金
海南省自然科学基金; 中国国家自然科学基金;
关键词
Distributed assembly permutation flowshop; scheduling; Meta; -heuristic; Total flowtime; Q; -learning; JAYA ALGORITHM; JOB-SHOP;
D O I
10.1016/j.swevo.2023.101335
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study addresses a distributed assembly permutation flowshop scheduling problem, which is of great sig-nificance in practical manufacturing systems. We aim to sequence products and jobs, and assign jobs to the appropriate factory to minimize the total flowtime of products. First, a mathematical model is developed to describe the concerned problems. Then, four meta-heuristics, e.g., artificial bee colony, particle swarm optimi-zation, genetic algorithm, and Jaya algorithm, and their variants are proposed. Three initialization strategies are developed to generate high-quality initial solutions. Four local search operators are designed to improve the performance of the algorithms. Q-learning is embedded to select the premium local search strategy during it-erations. Based on 81 large-scale benchmark instances, comprehensive numerical experiments are carried out to evaluate the effectiveness of the proposed algorithms. The experimental results show that the proposed Jaya with Q-learning-based local search has strong competitiveness, and it updates optimal solutions for 51 out of 81 benchmark instances.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Energy-efficient multi-objective distributed assembly permutation flowshop scheduling by Q-learning based meta-heuristics
    Yu, Hui
    Gao, Kaizhou
    Li, Zhiwu
    Suganthan, Ponnuthurai Nagaratnam
    [J]. APPLIED SOFT COMPUTING, 2024, 166
  • [2] Effective constructive heuristics and meta-heuristics for the distributed assembly permutation flowshop scheduling problem
    Pan, Quan-Ke
    Gao, Liang
    Li Xin-Yu
    Jose, Framinan M.
    [J]. APPLIED SOFT COMPUTING, 2019, 81
  • [3] Learning to select operators in meta-heuristics: An integration of Q-learning into the iterated greedy algorithm for the permutation flowshop scheduling problem
    Karimi-Mamaghan, Maryam
    Mohammadi, Mehrdad
    Pasdeloup, Bastien
    Meyer, Patrick
    [J]. EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2023, 304 (03) : 1296 - 1330
  • [4] Ensemble meta-heuristics and Q-learning for solving unmanned surface vessels scheduling problems
    Gao, Minglong
    Gao, Kaizhou
    Ma, Zhenfang
    Tang, Weiyu
    [J]. SWARM AND EVOLUTIONARY COMPUTATION, 2023, 82
  • [5] Improved Meta-Heuristics for Solving Distributed Lot-Streaming Permutation Flow Shop Scheduling Problems
    Pan, Yuxia
    Gao, Kaizhou
    Li, Zhiwu
    Wu, Naiqi
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2023, 20 (01) : 361 - 371
  • [6] Problem feature based meta-heuristics with Q-learning for solving urban traffic light scheduling problems
    Wang, Liang
    Gao, Kaizhou
    Lin, Zhongjie
    Huang, Wuze
    Suganthan, Ponnuthurai Nagaratnam
    [J]. APPLIED SOFT COMPUTING, 2023, 147
  • [7] Solving Heterogeneous USV Scheduling Problems by Problem-Specific Knowledge Based Meta-Heuristics with Q-Learning
    Ma, Zhenfang
    Gao, Kaizhou
    Yu, Hui
    Wu, Naiqi
    [J]. MATHEMATICS, 2024, 12 (02)
  • [8] Improved Q-learning algorithm for solving permutation flow shop scheduling problems
    He, Zimiao
    Wang, Kunlan
    Li, Hanxiao
    Song, Hong
    Lin, Zhongjie
    Gao, Kaizhou
    Sadollah, Ali
    [J]. IET COLLABORATIVE INTELLIGENT MANUFACTURING, 2022, 4 (01) : 35 - 44
  • [9] An improved fruit fly optimization algorithm with Q-learning for solving distributed permutation flow shop scheduling problems
    Zhao, Cai
    Wu, Lianghong
    Zuo, Cili
    Zhang, Hongqiang
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (05) : 5965 - 5988
  • [10] Heuristics in Permutation GOMEA for Solving the Permutation Flowshop Scheduling Problem
    Aalvanger, G. H.
    Luong, N. H.
    Bosman, P. A. N.
    Thierens, D.
    [J]. PARALLEL PROBLEM SOLVING FROM NATURE - PPSN XV, PT I, 2018, 11101 : 146 - 157