Scheduling algorithm for refinery crude oil storage and transportation based on SAC

被引:0
|
作者
Ma N. [1 ]
Li H. [1 ]
Liu H. [2 ,3 ]
Yang L. [2 ,3 ]
机构
[1] School of Information Science and Engineering, China University of Petroleum, Beijing
[2] Petrochina Planning and Engineering Institute, Beijing
[3] Key Laboratory of Oil Gas Business Chain Optimization, CNPC, Beijing
关键词
deep reinforcement learning; refinery crude oil storage and transportation; resource scheduling; soft actor-critic (SAC);
D O I
10.16085/j.issn.1000-6613.2023-1498
中图分类号
学科分类号
摘要
Currently, most refinery crude oil scheduling studies adopt static scheduling schemes based on mathematical programming, which cannot adjust and optimize according to environmental change in real-time. This paper established a dynamic real-time scheduling decision model subject to refinery production constraints and designed the corresponding agent interaction environment. The soft actor-critic (SAC) algorithm in deep reinforcement learning solved the model. Firstly, the crude oil resource scheduling problem was transformed into a Markov decision process, and a deep reinforcement learning algorithm based on SAC was proposed to simultaneously determine discrete decisions such as transmission target and continuous decisions such as transmission speed in the scheduling process. Extensive experimental results showed that the strategy learned by the algorithm has better usability, which effectively improved the decision-making efficiency of the algorithm and effectively controlled the influence range of random events on the overall decision-making compared with the baseline algorithm. This algorithm can provide new ideas for rapid decision-making of crude oil storage and transportation scheduling in coastal refineries. © 2024 Chemical Industry Press Co., Ltd.. All rights reserved.
引用
收藏
页码:1167 / 1177
页数:10
相关论文
共 23 条
  • [1] YUZGEC Ugur, PALAZOGLU Ahmet, ROMAGNOLI Jose A., Refinery scheduling of crude oil unloading, storage and processing using a model predictive control strategy, Computers & Chemical Engineering, 34, 10, pp. 1671-1686, (2010)
  • [2] ZHENG Wanpeng, GAO Xiaoyong, ZHU Guiyao, Et al., Research progress on crude oil operation optimization, CIESC Journal, 72, 11, pp. 5481-5501, (2021)
  • [3] LEE Heeman, PINTO Jose M, GROSSMANN Ignacio E, Et al., Mixed-integer linear programming model for refinery short-term scheduling of crude oil unloading with inventory management, Industrial & Engineering Chemistry Research, 35, 5, pp. 1630-1641, (1996)
  • [4] ZHANG Haoran, LIANG Yongtu, LIAO Qi, Et al., Mixed-time mixed-integer linear programming for optimal detailed scheduling of a crude oil port depot, Chemical Engineering Research and Design, 137, pp. 434-451, (2018)
  • [5] FURMAN Kevin C, JIA Zhenya, IERAPETRITOU Marianthi G., A robust event-based continuous time formulation for tank transfer scheduling, Industrial & Engineering Chemistry Research, 46, 26, pp. 9126-9136, (2007)
  • [6] ZHANG Shujing, XU Qiang, Refinery continuous-time crude scheduling with consideration of long-distance pipeline transportation, Computers & Chemical Engineering, 75, pp. 74-94, (2015)
  • [7] ASSIS Leonardo S, CAMPONOGARA Eduardo, GROSSMANN Ignacio E., A MILP-based clustering strategy for integrating the operational management of crude oil supply, Computers & Chemical Engineering, 145, (2021)
  • [8] ZHOU Zhiju, ZHOU Xiang, ZHOU Han, Scheduling model based on rolling-horizon algorithm for crude oil transportation, Acta Petrolei Sinica (Petroleum Processing Section), 37, 2, pp. 320-329, (2021)
  • [9] HOU Yan, WU Naiqi, ZHOU Mengchu, Et al., Pareto-optimization for scheduling of crude oil operations in refinery via genetic algorithm, IEEE Transactions on Systems, Man, and Cybernetics: Systems, 47, 3, pp. 517-530, (2017)
  • [10] HOU Yan, WU Naiqi, LI Zhiwu, Et al., Many-objective optimization for scheduling of crude oil operations based on NSGA-Ⅲ with consideration of energy efficiency, Swarm and Evolutionary Computation, 57, (2020)