Continuous control of a polymerization system with deep reinforcement learning

被引:91
|
作者
Ma, Yan [1 ]
Zhu, Wenbo [1 ]
Benton, Michael G. [1 ]
Romagnoli, Jose [1 ]
机构
[1] Louisiana State Univ, Dept Chem Engn, Baton Rouge, LA 70803 USA
关键词
Deep reinforcement learning; Polymerization; Process control;
D O I
10.1016/j.jprocont.2018.11.004
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Reinforcement learning is a branch of machine learning, where the machines gradually learn control behaviors via self-exploration of the environment. In this paper, we present a controller using deep reinforcement learning (DRL) with Deep Deterministic Policy Gradient (DDPG) for a non-linear semi-batch polymerization reaction. Several adaptations to apply DRL for chemical process control are addressed in this paper including the Markov state assumption, action boundaries and reward definition. This work illustrates that a DRL controller is capable of handling complicated control tasks for chemical processes with multiple inputs, non-linearity, large time delay and noise tolerance. The application of this Al-based framework, using DRL, is a promising direction in the field of chemical process control towards the goal of smart manufacturing. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:40 / 47
页数:8
相关论文
共 50 条
  • [1] Benchmarking Deep Reinforcement Learning for Continuous Control
    Duan, Yan
    Chen, Xi
    Houthooft, Rein
    Schulman, John
    Abbeel, Pieter
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [2] Hierarchical Deep Reinforcement Learning for Continuous Action Control
    Yang, Zhaoyang
    Merrick, Kathryn
    Jin, Lianwen
    Abbass, Hussein A.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (11) : 5174 - 5184
  • [3] Continuous Control in Car Simulator with Deep Reinforcement Learning
    Yang, Fan
    Wang, Ping
    Wang, XinHong
    [J]. PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ARTIFICIAL INTELLIGENCE (CSAI 2018) / 2018 THE 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND MULTIMEDIA TECHNOLOGY (ICIMT 2018), 2018, : 566 - 570
  • [4] Autoregressive Policies for Continuous Control Deep Reinforcement Learning
    Korenkevych, Dmytro
    Mahmood, A. Rupam
    Vasan, Gautham
    Bergstra, James
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 2754 - 2762
  • [5] Deep Reinforcement Learning for Continuous Control of Material Thickness
    Dippel, Oliver
    Lisitsa, Alexei
    Peng, Bei
    [J]. ARTIFICIAL INTELLIGENCE XL, AI 2023, 2023, 14381 : 321 - 334
  • [6] Continuous Control of an Underground Loader Using Deep Reinforcement Learning
    Backman, Sofi
    Lindmark, Daniel
    Bodin, Kenneth
    Servin, Martin
    Mork, Joakim
    Lofgren, Hakan
    [J]. MACHINES, 2021, 9 (10)
  • [7] Continuous Control with Deep Reinforcement Learning for Mobile Robot Navigation
    Xiang, Jiaqi
    Li, Qingdong
    Dong, Xiwang
    Ren, Zhang
    [J]. 2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 1501 - 1506
  • [8] Policy ensemble gradient for continuous control problems in deep reinforcement learning
    Liu, Guoqiang
    Chen, Gang
    Huang, Victoria
    [J]. NEUROCOMPUTING, 2023, 548
  • [9] Multi-Task Deep Reinforcement Learning for Continuous Action Control
    Yang, Zhaoyang
    Merrick, Kathryn
    Abbass, Hussein
    Jin, Lianwen
    [J]. PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 3301 - 3307
  • [10] Deep reinforcement learning for continuous wood drying production line control
    Tremblay, Francois-Alexandre
    Durand, Audrey
    Morin, Michael
    Marier, Philippe
    Gaudreault, Jonathan
    [J]. COMPUTERS IN INDUSTRY, 2024, 154