Exploring optimal control of epidemic spread using reinforcement learning

被引:0
|
作者
Abu Quwsar Ohi
M. F. Mridha
Muhammad Mostafa Monowar
Md. Abdul Hamid
机构
[1] Bangladesh University of Business and Technology,Department of Computer Science and Engineering
[2] King Abdulaziz University,Department of Information Technology, Faculty of Computing and Information Technology
来源
关键词
D O I
暂无
中图分类号
学科分类号
摘要
Pandemic defines the global outbreak of a disease having a high transmission rate. The impact of a pandemic situation can be lessened by restricting the movement of the mass. However, one of its concomitant circumstances is an economic crisis. In this article, we demonstrate what actions an agent (trained using reinforcement learning) may take in different possible scenarios of a pandemic depending on the spread of disease and economic factors. To train the agent, we design a virtual pandemic scenario closely related to the present COVID-19 crisis. Then, we apply reinforcement learning, a branch of artificial intelligence, that deals with how an individual (human/machine) should interact on an environment (real/virtual) to achieve the cherished goal. Finally, we demonstrate what optimal actions the agent perform to reduce the spread of disease while considering the economic factors. In our experiment, we let the agent find an optimal solution without providing any prior knowledge. After training, we observed that the agent places a long length lockdown to reduce the first surge of a disease. Furthermore, the agent places a combination of cyclic lockdowns and short length lockdowns to halt the resurgence of the disease. Analyzing the agent’s performed actions, we discover that the agent decides movement restrictions not only based on the number of the infectious population but also considering the reproduction rate of the disease. The estimation and policy of the agent may improve the human-strategy of placing lockdown so that an economic crisis may be avoided while mitigating an infectious disease.
引用
收藏
相关论文
共 50 条
  • [1] Exploring optimal control of epidemic spread using reinforcement learning
    Ohi, Abu Quwsar
    Mridha, M. F.
    Monowar, Muhammad Mostafa
    Hamid, Md. Abdul
    [J]. SCIENTIFIC REPORTS, 2020, 10 (01)
  • [2] Nonlinear Optimal Control Using Deep Reinforcement Learning
    Bucci, Michele Alessandro
    Semeraro, Onofrio
    Allauzen, Alexandre
    Cordier, Laurent
    Mathelin, Lionel
    [J]. IUTAM LAMINAR-TURBULENT TRANSITION, 2022, 38 : 279 - 290
  • [3] Optimal and Autonomous Control Using Reinforcement Learning: A Survey
    Kiumarsi, Bahare
    Vamvoudakis, Kyriakos G.
    Modares, Hamidreza
    Lewis, Frank L.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (06) : 2042 - 2062
  • [4] Optimal control of ship unloaders using reinforcement learning
    Scardua, LA
    Da Cruz, JJ
    Costa, AHR
    [J]. ADVANCED ENGINEERING INFORMATICS, 2002, 16 (03) : 217 - 227
  • [5] Exploring the optimal cycle for a quantum heat engine using reinforcement learning
    Deng, Gao-xiang
    Ai, Haoqiang
    Wang, Bingcheng
    Shao, Wei
    Liu, Yu
    Cui, Zheng
    [J]. PHYSICAL REVIEW A, 2024, 109 (02)
  • [6] Optimal control problem of various epidemic models with uncertainty based on deep reinforcement learning
    Hwang, Yoon-gu
    Kwon, Hee-Dae
    Lee, Jeehyun
    [J]. NUMERICAL METHODS FOR PARTIAL DIFFERENTIAL EQUATIONS, 2022, 38 (06) : 2142 - 2162
  • [7] Constrained adaptive optimal control using a reinforcement learning agent
    Lin, Wei-Song
    Zheng, Chen-Hong
    [J]. AUTOMATICA, 2012, 48 (10) : 2614 - 2619
  • [8] Optimal Balancing Control of Bipedal Robots Using Reinforcement Learning
    Peng, Fang
    Ding, Lijia
    Li, Zhijun
    Yang, Chenguang
    Su, Chun-Yi
    [J]. PROCEEDINGS OF THE 2016 12TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2016, : 2186 - 2191
  • [9] Optimal Greedy Control in Reinforcement Learning
    Gorobtsov, Alexander
    Sychev, Oleg
    Orlova, Yulia
    Smirnov, Evgeniy
    Grigoreva, Olga
    Bochkin, Alexander
    Andreeva, Marina
    [J]. SENSORS, 2022, 22 (22)
  • [10] Reinforcement Learning Informed by Optimal Control
    Onnheim, Magnus
    Andersson, Pontus
    Gustavsson, Emil
    Jirstrand, Mats
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: WORKSHOP AND SPECIAL SESSIONS, 2019, 11731 : 403 - 407