Deep Reinforcement Learning Approach for Material Scheduling Considering High-Dimensional Environment of Hybrid Flow-Shop Problem

被引:6
|
作者
Gil, Chang-Bae [1 ]
Lee, Jee-Hyong [2 ]
机构
[1] Sungkyunkwan Univ, Dept Digital Media & Commun Engn, Suwon 16419, South Korea
[2] Sungkyunkwan Univ, Dept Artificial Intelligence, Suwon 16419, South Korea
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 18期
关键词
deep reinforcement learning; hybrid flow-shop problem; manufacturing intelligence; scheduling; smart factory; SHOP; ALGORITHM;
D O I
10.3390/app12189332
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Manufacturing sites encounter various scheduling problems, which must be dealt with to efficiently manufacture products and reduce costs. With the development of smart factory technology, many elements at manufacturing sites have become unmanned and more complex. Moreover, owing to the mixing of several processes in one production line, the need for efficient scheduling of materials has emerged. The aim of this study is to solve the material scheduling problem of many machines in a hybrid flow-shop environment using deep reinforcement learning. Most previous work has ignored some conditions, which were critical for solving practical problems. Such critical conditions make the scheduling more complex and difficult to solve. They expand the size of the state and large action space and make learning in an environment with many machines problematic. In this study, a reinforcement learning approach was developed considering practical factors such as the processing time and material transfer to solve realistic manufacturing scheduling problems. Additionally, a method to simplify the high-dimensional environmental space at manufacturing sites for efficient learning was established to solve the problem of learning in a high-dimensional space. Through experiments, we showed that our approach could optimally schedule material scheduling in multi-process lines, which contributes to realistic manufacturing intelligence.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] A Reinforcement Learning Method for a Hybrid Flow-Shop Scheduling Problem
    Han, Wei
    Guo, Fang
    Su, Xichao
    ALGORITHMS, 2019, 12 (11)
  • [2] Solving non-permutation flow-shop scheduling problem via a novel deep reinforcement learning approach
    Wang, Zhenyu
    Cai, Bin
    Li, Jun
    Yang, Deheng
    Zhao, Yang
    Xie, Huan
    COMPUTERS & OPERATIONS RESEARCH, 2023, 151
  • [3] A Distributed Approach to Solving Hybrid Flow-shop Scheduling Problem
    Zou Feng-xing
    Zeng Ling-li
    Gao Zheng
    Liu Feng
    CCDC 2009: 21ST CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-6, PROCEEDINGS, 2009, : 2457 - 2461
  • [4] Solving the flow-shop scheduling problem with human factors and two competing agents with deep reinforcement learning
    Ren, Tao
    Dong, Zhuoran
    Qi, Fang
    Weng, Jiacheng
    Xue, Hanyu
    ENGINEERING OPTIMIZATION, 2025, 57 (03) : 671 - 687
  • [5] Deep Reinforcement Learning Based Optimization Algorithm for Permutation Flow-Shop Scheduling
    Pan, Zixiao
    Wang, Ling
    Wang, Jingjing
    Lu, Jiawen
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (04): : 983 - 994
  • [6] A hybrid genetic algorithm for the flow-shop scheduling problem
    Tseng, Lin-Yu
    Lin, Ya-Tai
    ADVANCES IN APPLIED ARTICIAL INTELLIGENCE, PROCEEDINGS, 2006, 4031 : 218 - 227
  • [7] Hybrid flow-shop scheduling problem considering joint of machine and AGV with renewable energy
    Zhu, Guangyu
    Jia, Weihong
    Li, Debiao
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2025, 51 (02): : 368 - 379
  • [8] Flow-Shop Scheduling Problem With Batch Processing Machines via Deep Reinforcement Learning for Industrial Internet of Things
    Luo, Zihui
    Jiang, Chengling
    Liu, Liang
    Zheng, Xiaolong
    Ma, Huadong
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, : 1 - 16
  • [9] Flow-Shop Scheduling Problem With Batch Processing Machines via Deep Reinforcement Learning for Industrial Internet of Things
    Luo, Zihui
    Jiang, Chengling
    Liu, Liang
    Zheng, Xiaolong
    Ma, Huadong
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (05): : 3518 - 3533
  • [10] A Deep Reinforcement Learning approach for the throughput control of a Flow-Shop production system
    Marchesano, Maria Grazia
    Guizzi, Guido
    Santillo, Liberatina Carmela
    Vespoli, Silvestro
    IFAC PAPERSONLINE, 2021, 54 (01): : 61 - 66