Deep Reinforcement Learning Approach for Material Scheduling Considering High-Dimensional Environment of Hybrid Flow-Shop Problem

被引:6
|
作者
Gil, Chang-Bae [1 ]
Lee, Jee-Hyong [2 ]
机构
[1] Sungkyunkwan Univ, Dept Digital Media & Commun Engn, Suwon 16419, South Korea
[2] Sungkyunkwan Univ, Dept Artificial Intelligence, Suwon 16419, South Korea
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 18期
关键词
deep reinforcement learning; hybrid flow-shop problem; manufacturing intelligence; scheduling; smart factory; SHOP; ALGORITHM;
D O I
10.3390/app12189332
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Manufacturing sites encounter various scheduling problems, which must be dealt with to efficiently manufacture products and reduce costs. With the development of smart factory technology, many elements at manufacturing sites have become unmanned and more complex. Moreover, owing to the mixing of several processes in one production line, the need for efficient scheduling of materials has emerged. The aim of this study is to solve the material scheduling problem of many machines in a hybrid flow-shop environment using deep reinforcement learning. Most previous work has ignored some conditions, which were critical for solving practical problems. Such critical conditions make the scheduling more complex and difficult to solve. They expand the size of the state and large action space and make learning in an environment with many machines problematic. In this study, a reinforcement learning approach was developed considering practical factors such as the processing time and material transfer to solve realistic manufacturing scheduling problems. Additionally, a method to simplify the high-dimensional environmental space at manufacturing sites for efficient learning was established to solve the problem of learning in a high-dimensional space. Through experiments, we showed that our approach could optimally schedule material scheduling in multi-process lines, which contributes to realistic manufacturing intelligence.
引用
收藏
页数:18
相关论文
共 50 条
  • [21] An Ant Colony System Algorithm for the Hybrid Flow-Shop Scheduling Problem
    Khalouli, Safa
    Ghedjati, Fatima
    Hamzaoui, Abdelaziz
    INTERNATIONAL JOURNAL OF APPLIED METAHEURISTIC COMPUTING, 2011, 2 (01) : 29 - 43
  • [22] Immune Clonal Selection Algorithm for Hybrid Flow-shop Scheduling Problem
    Liu, Feng
    Zhang, Xiang-ping
    Zou, Feng-xing
    Zeng, Ling-li
    CCDC 2009: 21ST CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-6, PROCEEDINGS, 2009, : 2605 - 2609
  • [23] Optimization Solution to Lot Sizing and Scheduling Problem in Hybrid Flow-shop
    Song Fugen
    Lei Dayang
    2012 FIFTH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2012), VOL 2, 2012, : 231 - 235
  • [24] A heuristic algorithm for solving hybrid flow-shop master scheduling problem
    Chen Zhumin
    PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE OF MANAGEMENT SCIENCE AND INFORMATION SYSTEM, VOLS 1-4, 2009, : 247 - 251
  • [25] Reentrant hybrid flow shop scheduling with stockers in automated material handling systems using deep reinforcement learning
    Lin, Chun-Cheng
    Peng, Yi-Chun
    Chang, Yung-Sheng
    Chang, Chun-Hsiang
    COMPUTERS & INDUSTRIAL ENGINEERING, 2024, 189
  • [26] A hybrid backtracking search algorithm for permutation flow-shop scheduling problem
    Lin, Qun
    Gao, Liang
    Li, Xinyu
    Zhang, Chunjiang
    COMPUTERS & INDUSTRIAL ENGINEERING, 2015, 85 : 437 - 446
  • [27] Solving flow-shop scheduling problem with a reinforcement learning algorithm that generalizes the value function with neural network
    Ren, Jianfeng
    Ye, Chunming
    Yang, Feng
    ALEXANDRIA ENGINEERING JOURNAL, 2021, 60 (03) : 2787 - 2800
  • [28] Approach to Hybrid Flow-Shop Scheduling Problem Based on Self-Guided Genetic Algorithm
    Dai, Wen-Zhan
    Xia, Kai
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2015, 19 (03) : 365 - 371
  • [29] Non-permutation flow shop scheduling problem based on deep reinforcement learning
    Xiao P.
    Zhang C.
    Meng L.
    Hong H.
    Dai W.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2021, 27 (01): : 192 - 205
  • [30] Considering bills of material in hybrid flow shop scheduling problems
    BottaGenoulaz, V
    1997 IEEE INTERNATIONAL SYMPOSIUM ON ASSEMBLY AND TASK PLANNING (ISATP'97) - TOWARDS FLEXIBLE AND AGILE ASSEMBLY AND MANUFACTURING, 1997, : 194 - 199