Toward self-driving processes: A deep reinforcement learning approach to control

被引:92
|
作者
Spielberg, Steven [1 ]
Tulsyan, Aditya [1 ]
Lawrence, Nathan P. [2 ]
Loewen, Philip D. [2 ]
Gopaluni, R. Bhushan [1 ]
机构
[1] Univ British Columbia, Dept Chem & Biol Engn, Vancouver, BC V6T 1Z3, Canada
[2] Univ British Columbia, Dept Math, Vancouver, BC, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
actor-critic networks; deep learning; model-free learning; process control; reinforcement learning; MODEL-PREDICTIVE CONTROL; BAYESIAN IDENTIFICATION; ADAPTIVE-CONTROL; STATE; STRATEGY; DESIGN; MPC; GO;
D O I
10.1002/aic.16689
中图分类号
TQ [化学工业];
学科分类号
0817 ;
摘要
Advanced model-based controllers are well established in process industries. However, such controllers require regular maintenance to maintain acceptable performance. It is a common practice to monitor controller performance continuously and to initiate a remedial model re-identification procedure in the event of performance degradation. Such procedures are typically complicated and resource intensive, and they often cause costly interruptions to normal operations. In this article, we exploit recent developments in reinforcement learning and deep learning to develop a novel adaptive, model-free controller for general discrete-time processes. The deep reinforcement learning (DRL) controller we propose is a data-based controller that learns the control policy in real time by merely interacting with the process. The effectiveness and benefits of the DRL controller are demonstrated through many simulations.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] A Deep Reinforcement Learning Method for Self-driving
    Fang, Yong
    Gu, Jianfeng
    [J]. INTELLIGENT COMPUTING THEORIES AND APPLICATION, PT II, 2018, 10955 : 143 - 152
  • [2] Deep Reinforcement Learning with external control: Self-driving car application
    Youssef, Fenjiro
    Houda, Benbrahim
    [J]. 4TH INTERNATIONAL CONFERENCE ON SMART CITY APPLICATIONS (SCA' 19), 2019,
  • [3] Deep imitation reinforcement learning for self-driving by vision
    Zou, Qijie
    Xiong, Kang
    Fang, Qiang
    Jiang, Bohan
    [J]. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2021, 6 (04) : 493 - 503
  • [4] ICRAN: Intelligent Control for Self-Driving RAN Based on Deep Reinforcement Learning
    Ahmed, Azza H.
    Elmokashfi, Ahmed
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (03): : 2751 - 2766
  • [5] Toward Self-Driving Bicycles Using State-of-the-Art Deep Reinforcement Learning Algorithms
    Choi, SeungYoon
    Le, Tuyen P.
    Nguyen, Quang D.
    Abu Layek, Md
    Lee, SeungGwan
    Chung, TaeChoong
    [J]. SYMMETRY-BASEL, 2019, 11 (02):
  • [6] Self-Driving Network and Service Coordination Using Deep Reinforcement Learning
    Schneider, Stefan
    Manzoor, Adnan
    Qarawlus, Haydar
    Schellenberg, Rafael
    Karl, Holger
    Khalili, Ramin
    Hecker, Artur
    [J]. 2020 16TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT (CNSM), 2020,
  • [7] Toward a Brain-Inspired System: Deep Recurrent Reinforcement Learning for a Simulated Self-Driving Agent
    Chen, Jieneng
    Chen, Jingye
    Zhang, Ruiming
    Hu, Xiaobin
    [J]. FRONTIERS IN NEUROROBOTICS, 2019, 13
  • [8] Towards Self-Driving Radios: Physical-Layer Control using Deep Reinforcement Learning
    Joseph, Samuel
    Misra, Rakesh
    Katti, Sachin
    [J]. HOTMOBILE '19 - PROCEEDINGS OF THE 20TH INTERNATIONAL WORKSHOP ON MOBILE COMPUTING SYSTEMS AND APPLICATIONS, 2019, : 69 - 74
  • [9] A Reinforcement Learning Approach to Smart Lane Changes of Self-driving Cars
    Ye, Fangmin
    Wang, Long
    Wang, Yibing
    Guo, Jingqiu
    Papamichail, Ioannis
    Papageorgiou, Markos
    [J]. PROGRESS IN ARTIFICIAL INTELLIGENCE, EPIA 2019, PT I, 2019, 11804 : 559 - 571
  • [10] CoPace: Edge Computation Offloading and Caching for Self-Driving With Deep Reinforcement Learning
    Tian, Hao
    Xu, Xiaolong
    Qi, Lianyong
    Zhang, Xuyun
    Dou, Wanchun
    Yu, Shui
    Ni, Qiang
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (12) : 13281 - 13293