Continuous control of a polymerization system with deep reinforcement learning

被引:91
|
作者
Ma, Yan [1 ]
Zhu, Wenbo [1 ]
Benton, Michael G. [1 ]
Romagnoli, Jose [1 ]
机构
[1] Louisiana State Univ, Dept Chem Engn, Baton Rouge, LA 70803 USA
关键词
Deep reinforcement learning; Polymerization; Process control;
D O I
10.1016/j.jprocont.2018.11.004
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Reinforcement learning is a branch of machine learning, where the machines gradually learn control behaviors via self-exploration of the environment. In this paper, we present a controller using deep reinforcement learning (DRL) with Deep Deterministic Policy Gradient (DDPG) for a non-linear semi-batch polymerization reaction. Several adaptations to apply DRL for chemical process control are addressed in this paper including the Markov state assumption, action boundaries and reward definition. This work illustrates that a DRL controller is capable of handling complicated control tasks for chemical processes with multiple inputs, non-linearity, large time delay and noise tolerance. The application of this Al-based framework, using DRL, is a promising direction in the field of chemical process control towards the goal of smart manufacturing. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:40 / 47
页数:8
相关论文
共 50 条
  • [41] Reinforcement learning for continuous stochastic control problems
    Munos, R
    Bourgine, P
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 10, 1998, 10 : 1029 - 1035
  • [42] Robust Optimal Control of Continuous Time Linear System using Reinforcement Learning
    Sami, Abdul
    Memon, Attaullah Y.
    [J]. 2018 AUSTRALIAN & NEW ZEALAND CONTROL CONFERENCE (ANZCC), 2018, : 154 - 159
  • [43] A reinforcement learning fuzzy system for continuous control in robotic odor plume tracking
    Chen, Xinxing
    Yang, Bo
    Huang, Jian
    Leng, Yuquan
    Fu, Chenglong
    [J]. ROBOTICA, 2023, 41 (03) : 1039 - 1054
  • [44] Navigating the Landscape of Deep Reinforcement Learning for Power System Stability Control: A Review
    Massaoudi, Mohamed Sadok
    Abu-Rub, Haitham
    Ghrayeb, Ali
    [J]. IEEE ACCESS, 2023, 11 : 134298 - 134317
  • [45] A Deep Reinforcement Learning Based Framework for Power System Load Frequency Control
    Zhang, Guanyu
    Teng, Mengjie
    Chen, Chen
    Bie, Zhaohong
    [J]. 2022 IEEE/IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA (I&CPS ASIA 2022), 2022, : 1801 - 1805
  • [46] KIcker: An Industrial Drive and Control Foosball System automated with Deep Reinforcement Learning
    De Blasi, Stefano
    Kloser, Sebastian
    Muller, Arne
    Reuben, Robin
    Sturm, Fabian
    Zerrer, Timo
    [J]. JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2021, 102 (01)
  • [47] Practical Implementation and Evaluation of Deep Reinforcement Learning Control for a Radiant Heating System
    Zhang, Zhiang
    Lam, Khee Poh
    [J]. BUILDSYS'18: PROCEEDINGS OF THE 5TH CONFERENCE ON SYSTEMS FOR BUILT ENVIRONMENTS, 2018, : 148 - 157
  • [48] Adaptive control for circulating cooling water system using deep reinforcement learning
    Xu, Jin
    Li, Han
    Zhang, Qingxin
    [J]. PLOS ONE, 2024, 19 (07):
  • [49] KIcker: An Industrial Drive and Control Foosball System automated with Deep Reinforcement Learning
    Stefano De Blasi
    Sebastian Klöser
    Arne Müller
    Robin Reuben
    Fabian Sturm
    Timo Zerrer
    [J]. Journal of Intelligent & Robotic Systems, 2021, 102
  • [50] Deep Reinforcement Learning based Command Control System for Automating Fault Diagnosis
    Yamauchi, Hiroshi
    Kimura, Tatsuaki
    [J]. 2023 19TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT, CNSM, 2023,