Review of Statistical Methods for Evaluating the Performance of Survival or Other Time-to-Event Prediction Models (from Conventional to Deep Learning Approaches)

被引:36
|
作者
Park, Seo Young [1 ]
Park, Ji Eun [2 ,3 ]
Kim, Hyungjin [4 ]
Park, Seong Ho [2 ,3 ]
机构
[1] Korea Natl Open Univ, Dept Stat & Data Sci, Seoul, South Korea
[2] Univ Ulsan, Asan Med Ctr, Dept Radiol, Coll Med, 88 Olymp Ro 43 Gil, Seoul 05505, South Korea
[3] Univ Ulsan, Asan Med Ctr, Res Inst Radiol, Coll Med, 88 Olymp Ro 43 Gil, Seoul 05505, South Korea
[4] Seoul Natl Univ, Seoul Natl Univ Hosp, Dept Radiol, Coll Med, Seoul, South Korea
关键词
Time-to-event; Survival; Prediction model; Predictive model; Artificial intelligence; Machine learning; Deep learning; Performance; Accuracy; Discrimination; Calibration; RADIOMICS; GUIDE; ACCURACY; CANCER;
D O I
10.3348/kjr.2021.0223
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
The recent introduction of various high-dimensional modeling methods, such as radiomics and deep learning, has created a much greater diversity in modeling approaches for survival prediction (or, more generally, time-to-event prediction). The newness of the recent modeling approaches and unfamiliarity with the model outputs may confuse some researchers and practitioners about the evaluation of the performance of such models. Methodological literacy to critically appraise the performance evaluation of the models and, ideally, the ability to conduct such an evaluation would be needed for those who want to develop models or apply them in practice. This article intends to provide intuitive, conceptual, and practical explanations of the statistical methods for evaluating the performance of survival prediction models with minimal usage of mathematical descriptions. It covers from conventional to deep learning methods, and emphasis has been placed on recent modeling approaches. This review article includes straightforward explanations of C indices (Harrell's C index, etc.), time dependent receiver operating characteristic curve analysis, calibration plot, other methods for evaluating the calibration performance, and Brier score.
引用
收藏
页码:1697 / 1707
页数:11
相关论文
共 50 条
  • [1] A scoping methodological review of simulation studies comparing statistical and machine learning approaches to risk prediction for time-to-event data
    Smith, Hayley
    Sweeting, Michael
    Morris, Tim
    Crowther, Michael
    [J]. DIAGNOSTIC AND PROGNOSTIC RESEARCH, 2022, 6 (01)
  • [2] Time-related survival prediction in molecular subtypes of breast cancer using time-to-event deep-learning-based models
    Shahraki, Saba Zarean
    Looha, Mehdi Azizmohammad
    Kazaj, Pooya Mohammadi
    Aria, Mehrad
    Akbari, Atieh
    Emami, Hassan
    Asadi, Farkhondeh
    Akbari, Mohammad Esmaeil
    [J]. FRONTIERS IN ONCOLOGY, 2023, 13
  • [3] An Introduction to Deep Survival Analysis Models for Predicting Time-to-Event Outcomes
    Chen, George H.
    [J]. Foundations and Trends in Machine Learning, 2024, 17 (06): : 921 - 1100
  • [4] Predictive performance of machine learning compared to statistical methods in time-to-event analysis of cardiovascular disease: a systematic review protocol
    Suliman, Abubaker
    Masud, Mohammad
    Serhani, Mohamed Adel
    Abdullahi, Aminu S.
    Oulhaj, Abderrahim
    [J]. BMJ OPEN, 2024, 14 (04):
  • [5] Review and Comparison of Computational Approaches for Joint Longitudinal and Time-to-Event Models
    Furgal, Allison K. C.
    Sen, Ananda
    Taylor, Jeremy M. G.
    [J]. INTERNATIONAL STATISTICAL REVIEW, 2019, 87 (02) : 393 - 418
  • [6] Time-to-event prediction using survival analysis methods for Alzheimer's disease progression
    Sharma, Rahul
    Anand, Harsh
    Badr, Youakim
    Qiu, Robin G.
    [J]. ALZHEIMERS & DEMENTIA-TRANSLATIONAL RESEARCH & CLINICAL INTERVENTIONS, 2021, 7 (01)
  • [7] Comparing the performance of statistical, machine learning, and deep learning algorithms to predict time-to-event: A simulation study for conversion to mild cognitive impairment
    Billichova, Martina
    Coan, Lauren Joyce
    Czanner, Silvester
    Kovacova, Monika
    Sharifian, Fariba
    Czanner, Gabriela
    [J]. PLOS ONE, 2024, 19 (01):
  • [8] Tightly integrated multiomics-based deep tensor survival model for time-to-event prediction
    Zhang, Jasper Zhongyuan
    Xu, Wei
    Hu, Pingzhao
    [J]. BIOINFORMATICS, 2022, 38 (12) : 3259 - 3266
  • [9] A Review of Deep Learning Models for Time Series Prediction
    Han, Zhongyang
    Zhao, Jun
    Leung, Henry
    Ma, King Fai
    Wang, Wei
    [J]. IEEE SENSORS JOURNAL, 2021, 21 (06) : 7833 - 7848
  • [10] Reflection on modern methods: Dynamic prediction using joint models of longitudinal and time-to-event data
    Andrinopoulou, Eleni-Rosalina
    Harhay, Michael O.
    Ratcliffe, Sarah J.
    Rizopoulos, Dimitris
    [J]. INTERNATIONAL JOURNAL OF EPIDEMIOLOGY, 2021, 50 (05) : 1731 - 1743