Optimal Drug Dosage Control Strategy of Immune Systems Using Reinforcement Learning

被引:2
|
作者
Chen, Lin [1 ]
Zhang, Yong-Wei [2 ]
Zhang, Shun-Chao [3 ]
机构
[1] Sun Yat Sen Univ, Affiliated Hosp 7, Sci Res Ctr, Shenzhen 518107, Peoples R China
[2] Guangdong Univ Technol, Sch Automation, Guangzhou 510006, Peoples R China
[3] Guangdong Univ Finance, Sch Internet Finance & Informat Engn, Guangzhou 510521, Peoples R China
关键词
Reinforcement learning; immune systems; immunotherapy; drug dosage control; robust control; neural networks; ZERO-SUM GAMES; TRACKING CONTROL; HJB SOLUTION; CANCER; HALLMARKS;
D O I
10.1109/ACCESS.2022.3233567
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, a reinforcement learning-based drug dosage control strategy is developed for immune systems with input constraints and dynamic uncertainties to sustain the number of tumor and immune cells in an acceptable level. First of all, the state of the immune system and the desired number of tumor and immune cells are constructed into an augmented state to derive an augmented immune system. By designing a discounted non-quadratic performance index function, the robust tracking control problem of immune systems with uncertainties is transformed into an optimal tracking control problem of nominal immune systems and the drug dosage can be limited within the specified range. Hereafter, a reinforcement learning algorithm and a critic-only structure are adopted to acquire the approximate optimal drug dosage control strategy. Furthermore, theoretical proof reveals that the proposed reinforcement learning-based drug dosage control strategy ensures the number of tumor and immune cells reaches the preset level under limited drug dosages and model uncertainties. Finally, simulation study verifies the availability of the developed drug dosage control strategy in different growth models of tumor cell.
引用
收藏
页码:1269 / 1279
页数:11
相关论文
共 50 条
  • [1] Event-triggered drug dosage control strategy of immune systems via safe integral reinforcement learning
    Chen, Lin
    Zhang, Yongwei
    Yang, Pan
    Jin, Xiaoyan
    EUROPEAN JOURNAL OF CONTROL, 2025, 82
  • [2] A goal-oriented reinforcement learning for optimal drug dosage control
    Zhang, Qian
    Li, Tianhao
    Li, Dengfeng
    Lu, Wei
    ANNALS OF OPERATIONS RESEARCH, 2024, 338 (2-3) : 1403 - 1423
  • [3] Optimal adaptive control of drug dosing using integral reinforcement learning
    Padmanabhan, Regina
    Meskin, Nader
    Haddad, Wassim M.
    MATHEMATICAL BIOSCIENCES, 2019, 309 : 131 - 142
  • [4] Observer-Based Optimal Backstepping Security Control for Nonlinear Systems Using Reinforcement Learning Strategy
    Wei, Qinglai
    Chen, Wendi
    Tan, Xiangmin
    Xiao, Jun
    Dong, Qi
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (11) : 7011 - 7023
  • [5] Reinforcement Learning for Optimal Control of Queueing Systems
    Liu, Bai
    Xie, Qiaomin
    Modiano, Eytan
    2019 57TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2019, : 663 - 670
  • [6] Reinforcement Learning based Data-driven Optimal Control Strategy for Systems with Disturbance
    Fan, Zhong-Xin
    Li, Shihua
    Liu, Rongjie
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 567 - 572
  • [7] Optimized tracking control using reinforcement learning strategy for a class of nonlinear systems
    Yang, Xue
    Li, Bin
    ASIAN JOURNAL OF CONTROL, 2023, 25 (03) : 2095 - 2104
  • [8] Reinforcement learning for optimal control of stochastic nonlinear systems
    Zhu, Xinji
    Wang, Yujia
    Wu, Zhe
    AICHE JOURNAL, 2025,
  • [9] Nonlinear Optimal Control Using Deep Reinforcement Learning
    Bucci, Michele Alessandro
    Semeraro, Onofrio
    Allauzen, Alexandre
    Cordier, Laurent
    Mathelin, Lionel
    IUTAM LAMINAR-TURBULENT TRANSITION, 2022, 38 : 279 - 290
  • [10] Optimal and Autonomous Control Using Reinforcement Learning: A Survey
    Kiumarsi, Bahare
    Vamvoudakis, Kyriakos G.
    Modares, Hamidreza
    Lewis, Frank L.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (06) : 2042 - 2062