Multi-view prediction of Alzheimer's disease progression with end-to-end integrated framework

被引:0
|
作者
Zhao, Yan [1 ]
Ma, Baoqiang [2 ]
Che, Tongtong [1 ]
Li, Qiongling [3 ]
Zeng, Debin [1 ]
Wang, Xuetong [1 ]
Li, Shuyu [1 ,3 ]
机构
[1] Beihang Univ, Beijing Adv Innovat Ctr Biomed Engn, Sch Biol Sci & Med Engn, Beijing, Peoples R China
[2] Univ Groningen, Dept Radiat Oncol, Groningen, Netherlands
[3] Beijing Normal Univ, State Key Lab Cognit Neurosci & Learning, Beijing, Peoples R China
基金
加拿大健康研究院; 中国国家自然科学基金; 美国国家卫生研究院;
关键词
Alzheimer's disease progression prediction; Cognitive score; Structural magnetic resonance image; Multi-task learning; Region-of-interest-attentive generative adversarial network; CLINICAL SCORE PREDICTION; MINI-MENTAL STATE; MRI; SCALE; REGRESSION; DIAGNOSIS; DEMENTIA;
D O I
10.1016/j.jbi.2041.103978
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Alzheimer's disease is a common neurodegenerative brain disease that affects the elderly population worldwide. Its early automatic detection is vital for early intervention and treatment. A common solution is to perform future cognitive score prediction based on the baseline brain structural magnetic resonance image (MRI), which can directly infer the potential severity of disease. Recently, several studies have modelled disease progression by predicting the future brain MRI that can provide visual information of brain changes over time. Nevertheless, no studies explore the intra correlation of these two solutions, and it is unknown whether the predicted MRI can assist the prediction of cognitive score. Here, instead of independent prediction, we aim to predict disease progression in multi-view, i.e., predicting subject-specific changes of cognitive score and MRI volume concurrently. To achieve this, we propose an end-to-end integrated framework, where a regression model and a generative adversarial network are integrated together and then jointly optimized. Three integration strategies are exploited to unify these two models. Moreover, considering that some brain regions, such as hippocampus and middle temporal gyrus, could change significantly during the disease progression, a region-of-interest (ROI) mask and a ROI loss are introduced into the integrated framework to leverage this anatomical prior knowledge. Experimental results on the longitudinal Alzheimer's Disease Neuroimaging Initiative dataset demonstrated that the integrated framework outperformed the independent regression model for cognitive score prediction. And its performance can be further improved with the ROI loss for both cognitive score and MRI prediction.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] CMC: A consensus multi-view clustering model for predicting Alzheimer's disease progression
    Zhang, Xiaobo
    Yang, Yan
    Li, Tianrui
    Zhang, Yiling
    Wang, Hao
    Fujita, Hamido
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2021, 199
  • [22] CMC: A consensus multi-view clustering model for predicting Alzheimer's disease progression
    Zhang, Xiaobo
    Yang, Yan
    Li, Tianrui
    Zhang, Yiling
    Wang, Hao
    Fujita, Hamido
    Computer Methods and Programs in Biomedicine, 2021, 199
  • [23] PLDPNet: End-to-end hybrid deep learning framework for potato leaf disease prediction
    Arshad, Fizzah
    Mateen, Muhammad
    Hayat, Shaukat
    Wardah, Maryam
    Al-Huda, Zaid
    Gu, Yeong Hyeon
    Al-antari, Mugahed A.
    ALEXANDRIA ENGINEERING JOURNAL, 2023, 78 : 406 - 418
  • [24] Error-Resilient Multi-view Video Coding Based on End-to-End Rate-Distortion Optimization
    GAO Pan
    PENG Qiang
    WANG Qionghua
    Chinese Journal of Electronics, 2016, 25 (02) : 277 - 283
  • [25] SurfaceNet plus : An End-to-end 3D Neural Network for Very Sparse Multi-View Stereopsis
    Ji, Mengqi
    Zhang, Jinzhi
    Dai, Qionghai
    Fang, Lu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (11) : 4078 - 4093
  • [26] Error-Resilient Multi-view Video Coding Based on End-to-End Rate-Distortion Optimization
    Gao Pan
    Peng Qiang
    Wang Qionghua
    CHINESE JOURNAL OF ELECTRONICS, 2016, 25 (02) : 277 - 283
  • [27] MVFuseNet: Improving End-to-End Object Detection and Motion Forecasting through Multi-View Fusion of LiDAR Data
    Laddha, Ankit
    Gautam, Shivam
    Palombo, Stefan
    Pandey, Shreyash
    Vallespi-Gonzalez, Carlos
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 2859 - 2868
  • [28] A hybrid framework for sequential data prediction with end-to-end optimization
    Aydin, Mustafa E.
    Kozat, Suleyman S.
    DIGITAL SIGNAL PROCESSING, 2022, 129
  • [29] A hybrid framework for sequential data prediction with end-to-end optimization
    Aydin, Mustafa E.
    Kozat, Suleyman S.
    DIGITAL SIGNAL PROCESSING, 2022, 129
  • [30] A framework for end-to-end video quality prediction of MPEG video
    Koumaras, Harilaos
    Lin, C. -H.
    Shieh, C-K.
    Kourtis, Anastasios
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2010, 21 (02) : 139 - 154