Evaluation of blood glucose level control in type 1 diabetic patients using deep reinforcement learning

被引:4
|
作者
Viroonluecha, Phuwadol [1 ]
Egea-Lopez, Esteban [1 ]
Santa, Jose [2 ]
机构
[1] Univ Politecn Cartagena UPCT, Dept Informat Technol & Commun, Cartagena, Spain
[2] Univ Politecn Cartagena UPCT, Dept Elect Comp Technol & Projects, Cartagena, Spain
来源
PLOS ONE | 2022年 / 17卷 / 09期
关键词
FEEDBACK;
D O I
10.1371/journal.pone.0274608
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Diabetes mellitus is a disease associated with abnormally high levels of blood glucose due to a lack of insulin. Combining an insulin pump and continuous glucose monitor with a control algorithm to deliver insulin is an alternative to patient self-management of insulin doses to control blood glucose levels in diabetes mellitus patients. In this work, we propose a closed-loop control for blood glucose levels based on deep reinforcement learning. We describe the initial evaluation of several alternatives conducted on a realistic simulator of the glucoregulatory system and propose a particular implementation strategy based on reducing the frequency of the observations and rewards passed to the agent, and using a simple reward function. We train agents with that strategy for three groups of patient classes, evaluate and compare it with alternative control baselines. Our results show that our method is able to outperform baselines as well as similar recent proposals, by achieving longer periods of safe glycemic state and low risk.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] Subcutaneous insulin administration by deep reinforcement learning for blood glucose level control of type-2 diabetic patients
    Raheb, Mohammad Ali
    Niazmand, Vahid Reza
    Eqra, Navid
    Vatankhah, Ramin
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 148
  • [2] Evaluation of Offline Reinforcement Learning for Blood Glucose Level Control in Type 1 Diabetes
    Viroonluecha, Phuwadol
    Egea-Lopez, Esteban
    Santa, Jose
    [J]. IEEE ACCESS, 2023, 11 : 104643 - 104655
  • [3] REINFORCEMENT LEARNING ALGORITHM FOR BLOOD GLUCOSE CONTROL IN DIABETIC PATIENTS
    Javad, Mahsa Oroojeni Mohammad
    Agboola, Stephen
    Jethwani, Kamal
    Zeid, Ibrahim
    Kamarthi, Sagar
    [J]. PROCEEDINGS OF THE ASME INTERNATIONAL MECHANICAL ENGINEERING CONGRESS AND EXPOSITION, 2015, VOL. 14, 2016,
  • [4] Blood Glucose Prediction for Type-1 Diabetics using Deep Reinforcement Learning
    Domanski, Peter
    Ray, Aritra
    Firouzi, Farshad
    Lafata, Kyle
    Chakrabarty, Krishnendu
    Pflueger, Dirk
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON DIGITAL HEALTH, ICDH, 2023, : 339 - 347
  • [5] Basal Glucose Control in Type 1 Diabetes Using Deep Reinforcement Learning: An In Silico Validation
    Zhu, Taiyu
    Li, Kezhi
    Herrero, Pau
    Georgiou, Pantelis
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (04) : 1223 - 1232
  • [6] Control of Blood Glucose for Type-1 Diabetes by Using Reinforcement Learning with Feedforward Algorithm
    Ngo, Phuong D.
    Wei, Susan
    Holubova, Anna
    Muzik, Jan
    Godtliebsen, Fred
    [J]. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2018, 2018
  • [7] EPSAC predictive control of blood glucose level in type I diabetic patients
    Ionescu, Clara
    De Keyser, Robin
    [J]. 2005 44TH IEEE CONFERENCE ON DECISION AND CONTROL & EUROPEAN CONTROL CONFERENCE, VOLS 1-8, 2005, : 4845 - 4850
  • [8] An approach to control the blood glucose level in diabetic patients
    Ionescu, C.
    Zlate, S.
    De Keyser, R.
    [J]. 2006 IEEE-TTTC INTERNATIONAL CONFERENCE ON AUTOMATION, QUALITY AND TESTING, ROBOTICS, VOL 1, PROCEEDINGS, 2006, : 48 - +
  • [9] Deep Reinforcement Learning for Closed-Loop Blood Glucose Control
    Fox, Ian
    Lee, Joyce
    Pop-Busui, Rodica
    Wiens, Jenna
    [J]. MACHINE LEARNING FOR HEALTHCARE CONFERENCE, VOL 126, 2020, 126 : 508 - 535
  • [10] Offline reinforcement learning for safer blood glucose control in people with type 1 diabetes
    Emerson, Harry
    Guy, Matthew
    McConville, Ryan
    [J]. JOURNAL OF BIOMEDICAL INFORMATICS, 2023, 142