Development and validation of a machine learning model integrated with the clinical workflow for early detection of sepsis

被引:2
|
作者
Mahyoub, Mohammed A. [1 ,2 ]
Yadav, Ravi R. [1 ]
Dougherty, Kacie [1 ]
Shukla, Ajit [1 ]
机构
[1] Virtua Hlth, Adv Analyt & Solut, Marlton, NJ 08053 USA
[2] SUNY Binghamton, Dept Syst Sci & Ind Engn, Binghamton, NY USA
关键词
sepsis; early detection; machine learning; XGBoost; model interpretability; machine learning deployment; MORTALITY;
D O I
10.3389/fmed.2023.1284081
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
BackgroundSepsis is a life-threatening condition caused by a dysregulated response to infection, affecting millions of people worldwide. Early diagnosis and treatment are critical for managing sepsis and reducing morbidity and mortality rates.Materials and methodsA systematic design approach was employed to build a model that predicts sepsis, incorporating clinical feedback to identify relevant data elements. XGBoost was utilized for prediction, and interpretability was achieved through the application of Shapley values. The model was successfully deployed within a widely used Electronic Medical Record (EMR) system.ResultsThe developed model demonstrated robust performance pre-operations, with a sensitivity of 92%, specificity of 93%, and a false positive rate of 7%. Following deployment, the model maintained comparable performance, with a sensitivity of 91% and specificity of 94%. Notably, the post-deployment false positive rate of 6% represents a substantial reduction compared to the currently deployed commercial model in the same health system, which exhibits a false positive rate of 30%.DiscussionThese findings underscore the effectiveness and potential value of the developed model in improving timely sepsis detection and reducing unnecessary alerts in clinical practice. Further investigations should focus on its long-term generalizability and impact on patient outcomes.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Development and validation of a machine learning model integrated with the clinical workflow for inpatient discharge date prediction
    Mahyoub, Mohammed A.
    Dougherty, Kacie
    Yadav, Ravi R.
    Berio-Dorta, Raul
    Shukla, Ajit
    [J]. FRONTIERS IN DIGITAL HEALTH, 2024, 6
  • [2] Machine learning for early detection of sepsis: an internal and temporal validation study
    Bedoya, Armando D.
    Futoma, Joseph
    Clement, Meredith E.
    Corey, Kristin
    Brajer, Nathan
    Lin, Anthony
    Simons, Morgan G.
    Gao, Michael
    Nichols, Marshall
    Balu, Suresh
    Heller, Katherine
    Sendak, Mark
    O'Brien, Cara
    [J]. JAMIA OPEN, 2020, 3 (02) : 252 - 260
  • [3] Validation of a Machine Learning Model for Early Shock Detection
    Pinevich, Yuliya
    Amos-Binks, Adam
    Burris, Christie S.
    Rule, Gregory
    Bogojevic, Marija
    Flint, Isaac
    Pickering, Brian W.
    Nemeth, Christopher P.
    Herasevich, Vitaly
    [J]. MILITARY MEDICINE, 2022, 187 (1-2) : 82 - 88
  • [4] Early Detection of Sepsis With Machine Learning Techniques: A Brief Clinical Perspective
    Giacobbe, Daniele Roberto
    Signori, Alessio
    Del Puente, Filippo
    Mora, Sara
    Carmisciano, Luca
    Briano, Federica
    Vena, Antonio
    Ball, Lorenzo
    Robba, Chiara
    Pelosi, Paolo
    Giacomini, Mauro
    Bassetti, Matteo
    [J]. FRONTIERS IN MEDICINE, 2021, 8
  • [5] Early sepsis mortality prediction model based on interpretable machine learning approach: development and validation study
    Wang, Yiping
    Gao, Zhihong
    Zhang, Yang
    Lu, Zhongqiu
    Sun, Fangyuan
    [J]. INTERNAL AND EMERGENCY MEDICINE, 2024,
  • [6] DEVELOPMENT OF A MACHINE LEARNING MODEL FOR EARLY SHOCK DETECTION
    Pinevich, Yuliya
    Amos-Binks, Adam
    Burris, Christie
    Rule, Gregory
    Lowe, Ryan
    Pickering, Brian
    Nemeth, Christopher
    Herasevich, Vitaly
    [J]. CRITICAL CARE MEDICINE, 2020, 48
  • [7] Development and multi-center validation of machine learning model for early detection of fungal keratitis
    Wei, Zhenyu
    Wang, Shigeng
    Wang, Zhiqun
    Zhang, Yang
    Chen, Kexin
    Gong, Lan
    Li, Guigang
    Zheng, Qinxiang
    Zhang, Qin
    He, Yan
    Zhang, Qi
    Chen, Di
    Cao, Kai
    Pang, Jinding
    Zhang, Zijun
    Wang, Leying
    Ou, Zhonghong
    Liang, Qingfeng
    [J]. EBIOMEDICINE, 2023, 88
  • [8] Development and Evaluation of a Machine Learning Model for the Early Identification of Patients at Risk for Sepsis
    Delahanty, Ryan J.
    Alvarez, JoAnn
    Flynn, Lisa M.
    Sherwin, Robert L.
    Jones, Spencer S.
    [J]. ANNALS OF EMERGENCY MEDICINE, 2019, 73 (04) : 334 - 344
  • [9] Machine Learning Model to Identify Sepsis Patients in the Emergency Department: Algorithm Development and Validation
    Lin, Pei-Chen
    Chen, Kuo-Tai
    Chen, Huan-Chieh
    Islam, Md Mohaimenul
    Lin, Ming-Chin
    [J]. JOURNAL OF PERSONALIZED MEDICINE, 2021, 11 (11):
  • [10] Development and validation of a practical machine learning model to predict sepsis after liver transplantation
    Chen, Chaojin
    Chen, Bingcheng
    Yang, Jing
    Li, Xiaoyue
    Peng, Xiaorong
    Feng, Yawei
    Guo, Rongchang
    Zou, Fengyuan
    Zhou, Shaoli
    Hei, Ziqing
    [J]. ANNALS OF MEDICINE, 2023, 55 (01) : 624 - 633