Comparing the performance of statistical, machine learning, and deep learning algorithms to predict time-to-event: A simulation study for conversion to mild cognitive impairment

被引:0
|
作者
Billichova, Martina [1 ]
Coan, Lauren Joyce [2 ]
Czanner, Silvester [1 ,2 ]
Kovacova, Monika [1 ]
Sharifian, Fariba [2 ]
Czanner, Gabriela [1 ,2 ]
机构
[1] Slovak Univ Technol Bratislava, Fac Informat & Informat Technol, Bratislava, Slovakia
[2] Liverpool John Moores Univ, Sch Comp Sci & Math, Liverpool, England
来源
PLOS ONE | 2024年 / 19卷 / 01期
关键词
MODELS;
D O I
10.1371/journal.pone.0297190
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Mild Cognitive Impairment (MCI) is a condition characterized by a decline in cognitive abilities, specifically in memory, language, and attention, that is beyond what is expected due to normal aging. Detection of MCI is crucial for providing appropriate interventions and slowing down the progression of dementia. There are several automated predictive algorithms for prediction using time-to-event data, but it is not clear which is best to predict the time to conversion to MCI. There is also confusion if algorithms with fewer training weights are less accurate. We compared three algorithms, from smaller to large numbers of training weights: a statistical predictive model (Cox proportional hazards model, CoxPH), a machine learning model (Random Survival Forest, RSF), and a deep learning model (DeepSurv). To compare the algorithms under different scenarios, we created a simulated dataset based on the Alzheimer NACC dataset. We found that the CoxPH model was among the best-performing models, in all simulated scenarios. In a larger sample size (n = 6,000), the deep learning algorithm (DeepSurv) exhibited comparable accuracy (73.1%) to the CoxPH model (73%). In the past, ignoring heterogeneity in the CoxPH model led to the conclusion that deep learning methods are superior. We found that when using the CoxPH model with heterogeneity, its accuracy is comparable to that of DeepSurv and RSF. Furthermore, when unobserved heterogeneity is present, such as missing features in the training, all three models showed a similar drop in accuracy. This simulation study suggests that in some applications an algorithm with a smaller number of training weights is not disadvantaged in terms of accuracy. Since algorithms with fewer weights are inherently easier to explain, this study can help artificial intelligence research develop a principled approach to comparing statistical, machine learning, and deep learning algorithms for time-to-event predictions.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Two-stage deep learning model for Alzheimer’s disease detection and prediction of the mild cognitive impairment time
    Shaker El-Sappagh
    Hager Saleh
    Farman Ali
    Eslam Amer
    Tamer Abuhmed
    [J]. Neural Computing and Applications, 2022, 34 : 14487 - 14509
  • [42] Two-stage deep learning model for Alzheimer's disease detection and prediction of the mild cognitive impairment time
    El-Sappagh, Shaker
    Saleh, Hager
    Ali, Farman
    Amer, Eslam
    Abuhmed, Tamer
    [J]. NEURAL COMPUTING & APPLICATIONS, 2022, 34 (17): : 14487 - 14509
  • [43] Early diagnosis of Alzheimer's disease and mild cognitive impairment based on electroencephalography: From the perspective of event related potentials and deep learning
    Wang, Chu
    Xu, Tao
    Yu, Wen
    Li, Ting
    Han, Huan
    Zhang, Min
    Tao, Ming
    [J]. INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2022, 182 : 182 - 189
  • [44] A comparative study of supervised/unsupervised machine learning algorithms with feature selection approaches to predict student performance
    Hamoud, Alaa Khalaf
    Alasady, Ali Salah
    Awadh, Wid Akeel
    Dahr, Jasim Mohammed
    Kamel, Mohammed B. M.
    Humadi, Aqeel Majeed
    Najm, Ihab Ahmed
    [J]. INTERNATIONAL JOURNAL OF DATA MINING MODELLING AND MANAGEMENT, 2023, 15 (04) : 393 - 409
  • [45] Machine Learning Predicts Conversion from Normal Aging to Mild Cognitive Impairment Using Medical History, APOE Genotype, and Neuropsychological Assessment
    Prabhakaran, Divya
    Grant, Caroline
    Pedraza, Otto
    Caselli, Richard
    Athreya, Arjun P.
    Chandler, Melanie
    [J]. JOURNAL OF ALZHEIMERS DISEASE, 2024, 98 (01) : 83 - 94
  • [46] Comparison of Deep Learning and Classical Machine Learning Algorithms to Predict Postoperative Outcomes for Anterior Cervical Discectomy and Fusion Procedures With State-of-the-art Performance
    Rodrigues, Adrian J.
    Schonfeld, Ethan
    Varshneya, Kunal
    Stienen, Martin N.
    Staartjes, Victor E.
    Jin, Michael C.
    Veeravagu, Anand
    [J]. SPINE, 2022, 47 (23) : 1637 - 1644
  • [47] Comparison of performance of different statistical machine learning algorithms to predict Child Survival status in North-Eastern states of India
    Elangbam, Inaobi
    Singh, Salam Shantikumar
    [J]. INTERNATIONAL JOURNAL OF ECOLOGICAL ECONOMICS & STATISTICS, 2022, 43 (03) : 23 - 33
  • [48] Robust Discovery of Mild Cognitive Impairment Subtypes and Their Risk of Alzheimer's Disease Conversion Using Unsupervised Machine Learning and Gaussian Mixture Modeling
    Nezhadmoghadam, Fahimeh
    Martinez-Torteya, Antonio
    Trevino, Victor
    Martinez, Emmanuel
    Santos, Alejandro
    Tamez-Pena, Jose
    [J]. CURRENT ALZHEIMER RESEARCH, 2021, 18 (07) : 595 - 606
  • [49] Integrated study of prediction and optimization performance of PBI-HTPEM fuel cell using deep learning, machine learning and statistical correlation
    Alibeigi, Mahdi
    Jazmi, Ramin
    Maddahian, Reza
    Khaleghi, Hassan
    [J]. RENEWABLE ENERGY, 2024, 235
  • [50] Deep-Learning Radiomics for Discrimination Conversion of Alzheimer's Disease in Patients With Mild Cognitive Impairment: A Study Based on 18F-FDG PET Imaging
    Zhou, Ping
    Zeng, Rong
    Yu, Lun
    Feng, Yabo
    Chen, Chuxin
    Li, Fang
    Liu, Yang
    Huang, Yanhui
    Huang, Zhongxiong
    [J]. FRONTIERS IN AGING NEUROSCIENCE, 2021, 13