Optimal Drug Dosage Control Strategy of Immune Systems Using Reinforcement Learning

被引:2
|
作者
Chen, Lin [1 ]
Zhang, Yong-Wei [2 ]
Zhang, Shun-Chao [3 ]
机构
[1] Sun Yat Sen Univ, Affiliated Hosp 7, Sci Res Ctr, Shenzhen 518107, Peoples R China
[2] Guangdong Univ Technol, Sch Automation, Guangzhou 510006, Peoples R China
[3] Guangdong Univ Finance, Sch Internet Finance & Informat Engn, Guangzhou 510521, Peoples R China
关键词
Reinforcement learning; immune systems; immunotherapy; drug dosage control; robust control; neural networks; ZERO-SUM GAMES; TRACKING CONTROL; HJB SOLUTION; CANCER; HALLMARKS;
D O I
10.1109/ACCESS.2022.3233567
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, a reinforcement learning-based drug dosage control strategy is developed for immune systems with input constraints and dynamic uncertainties to sustain the number of tumor and immune cells in an acceptable level. First of all, the state of the immune system and the desired number of tumor and immune cells are constructed into an augmented state to derive an augmented immune system. By designing a discounted non-quadratic performance index function, the robust tracking control problem of immune systems with uncertainties is transformed into an optimal tracking control problem of nominal immune systems and the drug dosage can be limited within the specified range. Hereafter, a reinforcement learning algorithm and a critic-only structure are adopted to acquire the approximate optimal drug dosage control strategy. Furthermore, theoretical proof reveals that the proposed reinforcement learning-based drug dosage control strategy ensures the number of tumor and immune cells reaches the preset level under limited drug dosages and model uncertainties. Finally, simulation study verifies the availability of the developed drug dosage control strategy in different growth models of tumor cell.
引用
收藏
页码:1269 / 1279
页数:11
相关论文
共 50 条
  • [31] Optimal control of a class of nonlinear dynamic systems based on reinforcement learning
    Chen, Xue-Song
    Liu, Fu-Chun
    Kongzhi yu Juece/Control and Decision, 2013, 28 (12): : 1889 - 1893
  • [32] Reinforcement Learning for Adaptive Optimal Stationary Control of Linear Stochastic Systems
    Pang, Bo
    Jiang, Zhong-Ping
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (04) : 2383 - 2390
  • [33] Reinforcement Learning Based Optimal Control of Linear Singularly Perturbed Systems
    Zhao, Jianguo
    Yang, Chunyu
    Gao, Weinan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (03) : 1362 - 1366
  • [34] Physics-informed reinforcement learning for optimal control of nonlinear systems
    Wang, Yujia
    Wu, Zhe
    AICHE JOURNAL, 2024, 70 (10)
  • [35] Quantum optimal control of multilevel dissipative quantum systems with reinforcement learning
    An, Zheng
    Song, Hai-Jing
    He, Qi-Kai
    Zhou, D. L.
    PHYSICAL REVIEW A, 2021, 103 (01)
  • [36] Reinforcement learning for optimal control of linear impulsive systems with periodic impulses
    Wu, Yan
    Luo, Shixian
    Deng, Feiqi
    NEUROCOMPUTING, 2024, 585
  • [37] Optimal Greedy Control in Reinforcement Learning
    Gorobtsov, Alexander
    Sychev, Oleg
    Orlova, Yulia
    Smirnov, Evgeniy
    Grigoreva, Olga
    Bochkin, Alexander
    Andreeva, Marina
    SENSORS, 2022, 22 (22)
  • [38] Reinforcement Learning Informed by Optimal Control
    Onnheim, Magnus
    Andersson, Pontus
    Gustavsson, Emil
    Jirstrand, Mats
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: WORKSHOP AND SPECIAL SESSIONS, 2019, 11731 : 403 - 407
  • [39] OPTIMAL SEDATION STRATEGY FOR VENTILATED PATIENTS WITH SEPSIS USING DEEP REINFORCEMENT LEARNING
    Fukuchi, Kiyoyasu
    Osawa, Itsuki
    Ito, Honoka
    Shibata, Junichiro
    Goto, Tadahiro
    CRITICAL CARE MEDICINE, 2022, 50 (01) : 710 - 710
  • [40] Optimal Tracking Control of Partial Unknown Continuous-Time Systems Using Integral Reinforcement Learning
    Cheng, Weiran
    Xiao, Zhenfei
    Li, Jinna
    2020 35TH YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION (YAC), 2020, : 308 - 311