Review of Statistical Methods for Evaluating the Performance of Survival or Other Time-to-Event Prediction Models (from Conventional to Deep Learning Approaches)

被引:36
|
作者
Park, Seo Young [1 ]
Park, Ji Eun [2 ,3 ]
Kim, Hyungjin [4 ]
Park, Seong Ho [2 ,3 ]
机构
[1] Korea Natl Open Univ, Dept Stat & Data Sci, Seoul, South Korea
[2] Univ Ulsan, Asan Med Ctr, Dept Radiol, Coll Med, 88 Olymp Ro 43 Gil, Seoul 05505, South Korea
[3] Univ Ulsan, Asan Med Ctr, Res Inst Radiol, Coll Med, 88 Olymp Ro 43 Gil, Seoul 05505, South Korea
[4] Seoul Natl Univ, Seoul Natl Univ Hosp, Dept Radiol, Coll Med, Seoul, South Korea
关键词
Time-to-event; Survival; Prediction model; Predictive model; Artificial intelligence; Machine learning; Deep learning; Performance; Accuracy; Discrimination; Calibration; RADIOMICS; GUIDE; ACCURACY; CANCER;
D O I
10.3348/kjr.2021.0223
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
The recent introduction of various high-dimensional modeling methods, such as radiomics and deep learning, has created a much greater diversity in modeling approaches for survival prediction (or, more generally, time-to-event prediction). The newness of the recent modeling approaches and unfamiliarity with the model outputs may confuse some researchers and practitioners about the evaluation of the performance of such models. Methodological literacy to critically appraise the performance evaluation of the models and, ideally, the ability to conduct such an evaluation would be needed for those who want to develop models or apply them in practice. This article intends to provide intuitive, conceptual, and practical explanations of the statistical methods for evaluating the performance of survival prediction models with minimal usage of mathematical descriptions. It covers from conventional to deep learning methods, and emphasis has been placed on recent modeling approaches. This review article includes straightforward explanations of C indices (Harrell's C index, etc.), time dependent receiver operating characteristic curve analysis, calibration plot, other methods for evaluating the calibration performance, and Brier score.
引用
收藏
页码:1697 / 1707
页数:11
相关论文
共 50 条
  • [21] Deep learning based time-to-event prediction for a large multicentric cohort of H&N cancer patients
    Lombardo, E.
    Kurz, C.
    Marschner, S.
    Avanzo, M.
    Gagliardi, V.
    Fanetti, G.
    Franchin, G.
    Stancanello, J.
    Corradini, S.
    Niyazi, M.
    Belka, C.
    Parodi, K.
    Riboldi, M.
    Landry, G.
    [J]. RADIOTHERAPY AND ONCOLOGY, 2021, 161 : S412 - S413
  • [22] Evaluating time-to-event survival in cutaneous t-cell lymphoma: A clinical-genetic machine learning analysis
    Schreidah, C. M.
    DeStephano, D.
    Pan, S. S.
    Wang, S.
    Reynolds, G. B.
    Fahmy, L.
    Gordon, E. R.
    Adeuyan, O.
    Choi, J.
    Duvic, M.
    Gallardo, F.
    Girardi, M.
    Guitart, J.
    Kim, Y.
    Khodadoust, M.
    Najidh, S.
    Pujol, R. M.
    Tensen, C. P.
    Vermeer, M. H.
    Whittaker, S.
    Tatonetti, N.
    Chase, H.
    Pe'er, I.
    Litman, T.
    Geskin, L. J.
    [J]. JOURNAL OF INVESTIGATIVE DERMATOLOGY, 2024, 144 (08) : S149 - S149
  • [23] Cardiovascular risk prediction: from classical statistical methods to machine learning approaches
    Sperti, Michela
    Malavolta, Marta
    Polacco, Federica Staunovo
    Dellavalle, Annalisa
    Ruggieri, Rossella
    Bergia, Sara
    Fazio, Alice
    Santoro, Carmine
    Deriu, Marco A.
    [J]. MINERVA CARDIOLOGY AND ANGIOLOGY, 2022, 70 (01) : 102 - 122
  • [24] Estimating a time-to-event distribution from right-truncated data in an epidemic: A review of methods
    Seaman, Shaun R.
    Presanis, Anne
    Jackson, Christopher
    [J]. STATISTICAL METHODS IN MEDICAL RESEARCH, 2022, 31 (09) : 1641 - 1655
  • [25] Commentary on "A systematic review on machine learning and deep learning techniques in cancer survival prediction": Validation of survival methods
    Sidorova, J.
    Lozano, J. J.
    [J]. PROGRESS IN BIOPHYSICS & MOLECULAR BIOLOGY, 2023, 183 : 17 - 18
  • [26] DEEP LEARNING APPROACHES FOR BSM PHYSICS: EVALUATING DNN AND GNN PERFORMANCE IN PARTICLE COLLISION EVENT CLASSIFICATION∗
    Celik, Ali
    [J]. Acta Physica Polonica B, 2024, 55 (10):
  • [27] Neural topic models with survival supervision: Jointly predicting time-to-event outcomes and learning how clinical features relate
    Chen, George H.
    Li, Linhong
    Zuo, Ren
    Coston, Amanda
    Weiss, Jeremy C.
    [J]. ARTIFICIAL INTELLIGENCE IN MEDICINE, 2024, 154
  • [28] Neural Topic Models with Survival Supervision: Jointly Predicting Time-to-Event Outcomes and Learning How Clinical Features Relate
    Li, Linhong
    Zuo, Ren
    Coston, Amanda
    Weiss, Jeremy C.
    Chen, George H.
    [J]. ARTIFICIAL INTELLIGENCE IN MEDICINE (AIME 2020), 2020, : 371 - 381
  • [29] Comprehensive Prediction of Stock Prices Using Time Series, Statistical, Machine Learning, and Deep Learning Models
    Sen, Jaydip
    Kumar, Abhishek
    Thomas, Aji
    Todi, Nishant Kumar
    Olemmyan, Olive
    Tripathi, Swapnil
    Arora, Vaibhav
    [J]. TechRxiv, 2023,
  • [30] Time-to-event learning paradigm as a generalized approach to estimate risk of breast cancer using image- based deep learning models
    Louis, Thomas
    Pacile, Serena
    Fillard, Pierre
    [J]. 17TH INTERNATIONAL WORKSHOP ON BREAST IMAGING, IWBI 2024, 2024, 13174