Enhancing wound healing through deep reinforcement learning for optimal therapeutics

被引:0
|
作者
Lu, Fan [1 ]
Zlobina, Ksenia [1 ]
Rondoni, Nicholas A. [1 ]
Teymoori, Sam [1 ]
Gomez, Marcella [1 ]
机构
[1] Univ Calif Santa Cruz, Baskin Sch Engn, Appl Math, Santa Cruz, CA 95064 USA
来源
ROYAL SOCIETY OPEN SCIENCE | 2024年 / 11卷 / 07期
关键词
deep learning; reinforcement learning; optimal adaptive control; wound healing; optimal treatment regime; CLOSED-LOOP CONTROL; PROPOFOL ANESTHESIA; SYSTEMS; DRUG; APPROXIMATION;
D O I
10.1098/rsos.240228
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Finding the optimal treatment strategy to accelerate wound healing is of utmost importance, but it presents a formidable challenge owing to the intrinsic nonlinear nature of the process. We propose an adaptive closed-loop control framework that incorporates deep learning, optimal control and reinforcement learning to accelerate wound healing. By adaptively learning a linear representation of nonlinear wound healing dynamics using deep learning and interactively training a deep reinforcement learning agent for tracking the optimal signal derived from this representation without the need for intricate mathematical modelling, our approach has not only successfully reduced the wound healing time by 45.56% compared to the one without any treatment, but also demonstrates the advantages of offering a safer and more economical treatment strategy. The proposed methodology showcases a significant potential for expediting wound healing by effectively integrating perception, predictive modelling and optimal adaptive control, eliminating the need for intricate mathematical models.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Syndesome Therapeutics for Enhancing Diabetic Wound Healing
    Das, Subhamoy
    Singh, Gunjan
    Majid, Marjan
    Sherman, Michael B.
    Mukhopadhyay, Somshuvra
    Wright, Catherine S.
    Martin, Patricia E.
    Dunn, Andrew K.
    Baker, Aaron B.
    [J]. ADVANCED HEALTHCARE MATERIALS, 2016, 5 (17) : 2248 - 2260
  • [2] Optimal Operation of Cryogenic Calorimeters Through Deep Reinforcement Learning
    G. Angloher
    S. Banik
    G. Benato
    A. Bento
    A. Bertolini
    R. Breier
    C. Bucci
    J. Burkhart
    L. Canonica
    A. D’Addabbo
    S. Di Lorenzo
    L. Einfalt
    A. Erb
    F. v. Feilitzsch
    S. Fichtinger
    D. Fuchs
    A. Garai
    V. M. Ghete
    P. Gorla
    P. V. Guillaumon
    S. Gupta
    D. Hauff
    M. Ješkovský
    J. Jochum
    M. Kaznacheeva
    A. Kinast
    S. Kuckuk
    H. Kluck
    H. Kraus
    A. Langenkämper
    M. Mancuso
    L. Marini
    B. Mauri
    L. Meyer
    V. Mokina
    K. Niedermayer
    M. Olmi
    T. Ortmann
    C. Pagliarone
    L. Pattavina
    F. Petricca
    W. Potzel
    P. Povinec
    F. Pröbst
    F. Pucci
    F. Reindl
    J. Rothe
    K. Schäffner
    J. Schieck
    S. Schönert
    [J]. Computing and Software for Big Science, 2024, 8 (1)
  • [3] Enhancing Noisy Binary Search Efficiency through Deep Reinforcement Learning
    Ma, Rui
    Tao, Yudong
    Khodeiry, Mohamed M.
    Alawa, Karam A.
    Shyu, Mei-Ling
    Lee, Richard K.
    [J]. 2023 IEEE 24TH INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION FOR DATA SCIENCE, IRI, 2023, : 154 - 159
  • [4] Technological Interventions Enhancing Curcumin Bioavailability in Wound-Healing Therapeutics
    Singh, Hemant
    Dhanka, Mukesh
    Yadav, Indu
    Gautam, Sneh
    Bashir, Showkeen Muzamil
    Mishra, Narayan Chandra
    Arora, Taruna
    Hassan, Shabir
    [J]. TISSUE ENGINEERING PART B-REVIEWS, 2024, 30 (02) : 230 - 253
  • [5] Enhancing HVAC control systems through transfer learning with deep reinforcement learning agents
    Kadamala, Kevlyn
    Chambers, Des
    Barrett, Enda
    [J]. SMART ENERGY, 2024, 13
  • [6] Optimal carbon storage reservoir management through deep reinforcement learning
    Sun, Alexander Y.
    [J]. APPLIED ENERGY, 2020, 278
  • [7] Enhancing Vehicular Cooperative Downloading with Continuous Seeding through Deep Reinforcement Learning
    Niebisch, Michael
    Pfaller, Daniel
    Djanatliev, Anatoli
    [J]. 2023 IEEE LATIN-AMERICAN CONFERENCE ON COMMUNICATIONS, LATINCOM, 2023,
  • [8] Enhancing gas detection-based swarming through deep reinforcement learning
    Lee, Sangmin
    Park, Seongjoon
    Kim, Hwangnam
    [J]. JOURNAL OF SUPERCOMPUTING, 2022, 78 (13): : 14794 - 14812
  • [9] Enhancing gas detection-based swarming through deep reinforcement learning
    Sangmin Lee
    Seongjoon Park
    Hwangnam Kim
    [J]. The Journal of Supercomputing, 2022, 78 : 14794 - 14812
  • [10] Enhancing Deep Reinforcement Learning with Executable Specifications
    Yerushalmi, Raz
    [J]. 2023 IEEE/ACM 45TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: COMPANION PROCEEDINGS, ICSE-COMPANION, 2023, : 213 - 217