Deep Reinforcement Learning for Large-Scale Epidemic Control

被引:14
|
作者
Libin, Pieter J. K. [1 ,2 ,3 ]
Moonens, Arno [1 ]
Verstraeten, Timothy [1 ]
Perez-Sanjines, Fabian [1 ]
Hens, Niel [3 ]
Lemey, Philippe [2 ]
Nowe, Ann [1 ]
机构
[1] Vrije Univ Brussel, Brussels, Belgium
[2] Katholieke Univ Leuven, Leuven, Belgium
[3] Hasselt Univ, Hasselt, Belgium
基金
欧盟地平线“2020”;
关键词
Multi-agent systems; Epidemic control; Pandemic influenza; Deep reinforcement learning; PANDEMIC INFLUENZA; POLICIES; ENGLAND;
D O I
10.1007/978-3-030-67670-4_10
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Epidemics of infectious diseases are an important threat to public health and global economies. Yet, the development of prevention strategies remains a challenging process, as epidemics are non-linear and complex processes. For this reason, we investigate a deep reinforcement learning approach to automatically learn prevention strategies in the context of pandemic influenza. Firstly, we construct a new epidemiological meta-population model, with 379 patches (one for each administrative district in Great Britain), that adequately captures the infection process of pandemic influenza. Our model balances complexity and computational efficiency such that the use of reinforcement learning techniques becomes attainable. Secondly, we set up a ground truth such that we can evaluate the performance of the "Proximal Policy Optimization" algorithm to learn in a single district of this epidemiological model. Finally, we consider a large-scale problem, by conducting an experiment where we aim to learn a joint policy to control the districts in a community of 11 tightly coupled districts, for which no ground truth can be established. This experiment shows that deep reinforcement learning can be used to learn mitigation policies in complex epidemiological models with a large state and action space.
引用
收藏
页码:155 / 170
页数:16
相关论文
共 50 条
  • [1] Tractable large-scale deep reinforcement learning
    Sarang, Nima
    Poullis, Charalambos
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 232
  • [2] Deep reinforcement learning for scheduling in large-scale networked control systems
    Redder, Adrian
    Ramaswamy, Arunselvan
    Quevedo, Daniel E.
    [J]. IFAC PAPERSONLINE, 2019, 52 (20): : 333 - 338
  • [3] Cooperative Deep Reinforcement Learning for Large-Scale Traffic Grid Signal Control
    Tan, Tian
    Bao, Feng
    Deng, Yue
    Jin, Alex
    Dai, Qionghai
    Wang, Jie
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (06) : 2687 - 2700
  • [4] Distributed Hierarchical Deep Reinforcement Learning for Large-Scale Grid Emergency Control
    Chen, Yixi
    Zhu, Jizhong
    Liu, Yun
    Zhang, Le
    Zhou, Jialin
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2024, 39 (02) : 4446 - 4458
  • [5] Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control
    Chu, Tianshu
    Wang, Jie
    Codeca, Lara
    Li, Zhaojian
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (03) : 1086 - 1095
  • [6] Large-scale traffic control using autonomous vehicles and decentralized deep reinforcement learning
    Maske, Harshal
    Chu, Tianshu
    Kalabic, Uros
    [J]. 2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 3816 - 3821
  • [7] Large-scale power inspection: A deep reinforcement learning approach
    Guan, Qingshu
    Zhang, Xiangquan
    Xie, Minghui
    Nie, Jianglong
    Cao, Hui
    Chen, Zhao
    He, Zhouqiang
    [J]. FRONTIERS IN ENERGY RESEARCH, 2023, 10
  • [8] Large-Scale Wildfire Mitigation Through Deep Reinforcement Learning
    Altamimi, Abdulelah
    Lagoa, Constantino
    Borges, Jose G.
    McDill, Marc E.
    Andriotis, C. P.
    Papakonstantinou, K. G.
    [J]. FRONTIERS IN FORESTS AND GLOBAL CHANGE, 2022, 5
  • [9] Toward A Thousand Lights: Decentralized Deep Reinforcement Learning for Large-Scale Traffic Signal Control
    Chen, Chacha
    Wei, Hua
    Xu, Nan
    Zheng, Guanjie
    Yang, Ming
    Xiong, Yuanhao
    Xu, Kai
    Li, Zhenhui
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 3414 - 3421
  • [10] Efficient and scalable reinforcement learning for large-scale network control
    Ma, Chengdong
    Li, Aming
    Du, Yali
    Dong, Hao
    Yang, Yaodong
    [J]. NATURE MACHINE INTELLIGENCE, 2024, 6 (09) : 1006 - 1020