Optimal Drug Dosage Control Strategy of Immune Systems Using Reinforcement Learning

被引:2
|
作者
Chen, Lin [1 ]
Zhang, Yong-Wei [2 ]
Zhang, Shun-Chao [3 ]
机构
[1] Sun Yat Sen Univ, Affiliated Hosp 7, Sci Res Ctr, Shenzhen 518107, Peoples R China
[2] Guangdong Univ Technol, Sch Automation, Guangzhou 510006, Peoples R China
[3] Guangdong Univ Finance, Sch Internet Finance & Informat Engn, Guangzhou 510521, Peoples R China
关键词
Reinforcement learning; immune systems; immunotherapy; drug dosage control; robust control; neural networks; ZERO-SUM GAMES; TRACKING CONTROL; HJB SOLUTION; CANCER; HALLMARKS;
D O I
10.1109/ACCESS.2022.3233567
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, a reinforcement learning-based drug dosage control strategy is developed for immune systems with input constraints and dynamic uncertainties to sustain the number of tumor and immune cells in an acceptable level. First of all, the state of the immune system and the desired number of tumor and immune cells are constructed into an augmented state to derive an augmented immune system. By designing a discounted non-quadratic performance index function, the robust tracking control problem of immune systems with uncertainties is transformed into an optimal tracking control problem of nominal immune systems and the drug dosage can be limited within the specified range. Hereafter, a reinforcement learning algorithm and a critic-only structure are adopted to acquire the approximate optimal drug dosage control strategy. Furthermore, theoretical proof reveals that the proposed reinforcement learning-based drug dosage control strategy ensures the number of tumor and immune cells reaches the preset level under limited drug dosages and model uncertainties. Finally, simulation study verifies the availability of the developed drug dosage control strategy in different growth models of tumor cell.
引用
收藏
页码:1269 / 1279
页数:11
相关论文
共 50 条
  • [41] Q-learning solution for optimal consensus control of discrete-time multiagent systems using reinforcement learning
    Mu, Chaoxu
    Zhao, Qian
    Gao, Zhongke
    Sun, Changyin
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2019, 356 (13): : 6946 - 6967
  • [42] Event-Based Optimal Containment Control for Constrained Multiagent Systems Using Integral Reinforcement Learning
    Guo, Zijie
    Ren, Hongru
    Li, Hongyi
    Huang, Tingwen
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2025, 12 (01): : 609 - 619
  • [43] Optimal control of building energy systems with multiple energy sources using predictive model based control and reinforcement learning
    Huang, Chenzi
    Jia, Xuehua
    Seidel, Stephan
    Paschke, Fabian
    Braeunig, Jan
    2021 26TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2021,
  • [44] Control Strategy for Anaesthetic Drug Dosage with Interaction Among Human Physiological Organs Using Optimal Fractional Order PID Controller
    Das, Saptarshi
    Das, Sourav
    Maharatna, Koushik
    2014 INTERNATIONAL CONFERENCE ON CONTROL, INSTRUMENTATION, ENERGY & COMMUNICATION (CIEC), 2014, : 66 - 70
  • [45] Optimal Control of Active Distribution Network using Deep Reinforcement Learning
    Tahir, Yameena
    Khan, Muhammad Faisal Nadeem
    Sajjad, Intisar Ali
    Martirano, Luigi
    2022 IEEE INTERNATIONAL CONFERENCE ON ENVIRONMENT AND ELECTRICAL ENGINEERING AND 2022 IEEE INDUSTRIAL AND COMMERCIAL POWER SYSTEMS EUROPE (EEEIC / I&CPS EUROPE), 2022,
  • [46] Stochastic optimal well control in subsurface reservoirs using reinforcement learning
    Dixit, Atish
    ElSheikh, Ahmed H.
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 114
  • [47] Adaptive optimal control of stencil printing process using reinforcement learning
    Khader, Nourma
    Yoon, Sang Won
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2021, 71
  • [48] Space manipulator optimal impedance control using integral reinforcement learning
    Wu, Han
    Hu, Qinglei
    Shi, Yongxia
    Zheng, Jianying
    Sun, Kaipeng
    Wang, Jiawen
    AEROSPACE SCIENCE AND TECHNOLOGY, 2023, 139
  • [49] Optimal Control with Reinforcement Learning using Reservoir Computing and Gaussian Mixture
    Engedy, Istvan
    Horvath, Gabor
    2012 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC), 2012, : 1062 - 1066
  • [50] Optimal control of blank holder force using deep reinforcement learning
    Zhang X.
    Guo P.
    Yu J.
    Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology, 2020, 52 (07): : 20 - 28