Multi-Modal Fusion and Longitudinal Analysis for Alzheimer's Disease Classification Using Deep Learning

被引:0
|
作者
Muksimova, Shakhnoza [1 ]
Umirzakova, Sabina [1 ]
Baltayev, Jushkin [2 ]
Cho, Young Im [1 ]
机构
[1] Gachon Univ, Dept Comp Engn, Seongnam Si 461701, Gyeonggi Do, South Korea
[2] Tashkent State Univ Econ, Dept Informat Syst & Technol, Tashkent 100066, Uzbekistan
关键词
longitudinal data analysis; multi-modal imaging; lightweight neural networks; deep metric learning; Alzheimer's disease; generative adversarial networks; MRI;
D O I
10.3390/diagnostics15060717
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
Background: Addressing the complex diagnostic challenges of Alzheimer's disease (AD), this study introduces FusionNet, a groundbreaking framework designed to enhance AD classification through the integration of multi-modal and longitudinal imaging data. Methods: FusionNet synthesizes inputs from Magnetic Resonance Imaging (MRI), Positron Emission Tomography (PET), and Computed Tomography (CT) scans, harnessing advanced machine learning strategies such as generative adversarial networks (GANs) for robust data augmentation, lightweight neural architectures for efficient computation, and deep metric learning for precise feature extraction. The model uniquely combines cross-sectional and temporal data, significantly enhancing diagnostic accuracy and enabling the early detection and ongoing monitoring of AD. The FusionNet architecture incorporates specialized feature extraction pathways for each imaging modality, a fusion layer to integrate diverse data sources effectively, and attention mechanisms to focus on salient diagnostic features. Results: Demonstrating superior performance, FusionNet achieves an accuracy of 94%, with precision and recall rates of 92% and 93%, respectively. Conclusions: These results underscore its potential as a highly reliable diagnostic tool for AD, facilitating early intervention and tailored treatment strategies. FusionNet's innovative approach not only improves diagnostic precision but also offers new insights into the progression of Alzheimer's disease, supporting personalized patient care and advancing our understanding of this debilitating condition.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Multi-modal classification of Alzheimer's disease using nonlinear graph fusion
    Tong, Tong
    Gray, Katherine
    Gao, Qinquan
    Chen, Liang
    Rueckert, Daniel
    PATTERN RECOGNITION, 2017, 63 : 171 - 181
  • [2] Predicting Alzheimer’s disease progression using multi-modal deep learning approach
    Garam Lee
    Kwangsik Nho
    Byungkon Kang
    Kyung-Ah Sohn
    Dokyoon Kim
    Scientific Reports, 9
  • [3] Joint Multi-Modal Longitudinal Regression and Classification for Alzheimer's Disease Prediction
    Brand, Lodewijk
    Nichols, Kai
    Wang, Hua
    Shen, Li
    Huang, Heng
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (06) : 1845 - 1855
  • [4] Predicting Alzheimer's disease progression using multi-modal deep learning approach
    Lee, Garam
    Nho, Kwangsik
    Kang, Byungkon
    Sohn, Kyung-Ah
    Kim, Dokyoon
    Weiner, Michael W.
    Aisen, Paul
    Petersen, Ronald
    Jack, Clifford R., Jr.
    Jagust, William
    Trojanowki, John Q.
    Toga, Arthur W.
    Beckett, Laurel
    Green, Robert C.
    Saykin, Andrew J.
    Morris, John
    Shaw, Leslie M.
    Khachaturian, Zaven
    Sorensen, Greg
    Carrillo, Maria
    Kuller, Lew
    Raichle, Marc
    Paul, Steven
    Davies, Peter
    Fillit, Howard
    Hefti, Franz
    Holtzman, Davie
    Mesulam, M. Marcel
    Potter, William
    Snyder, Peter
    Montine, Tom
    Thomas, Ronald G.
    Donohue, Michael
    Walter, Sarah
    Sather, Tamie
    Jiminez, Gus
    Balasubramanian, Archana B.
    Mason, Jennifer
    Sim, Iris
    Harvey, Danielle
    Bernstein, Matthew
    Fox, Nick
    Thompson, Paul
    Schuff, Norbert
    DeCArli, Charles
    Borowski, Bret
    Gunter, Jeff
    Senjem, Matt
    Vemuri, Prashanthi
    Jones, David
    SCIENTIFIC REPORTS, 2019, 9 (1)
  • [5] Multi-modal deep learning for predicting progression of Alzheimer's disease using bi-linear shake fusion
    Goto, Tsubasa
    Wang, Caihua
    Li, Yuanzhong
    Tsuboshita, Yukihiro
    MEDICAL IMAGING 2020: COMPUTER-AIDED DIAGNOSIS, 2020, 11314
  • [6] Quantitative Longitudinal Predictions of Alzheimer's Disease by Multi-Modal Predictive Learning
    Prakash, Mithilesh
    Abdelaziz, Mahmoud
    Zhang, Linda
    Strange, Bryan A.
    Tohka, Jussi
    JOURNAL OF ALZHEIMERS DISEASE, 2021, 79 (04) : 1533 - 1546
  • [7] Multi-Modal Deep Learning Models for Alzheimer's Disease Prediction Using MRI and EHR
    Prabhu, Sathvik S.
    Berkebile, John A.
    Rajagopalan, Neha
    Yao, Renjie
    Shi, Wenqi
    Giuste, Felipe
    Zhong, Yishan
    Sun, Jimin
    Wang, May D.
    2022 IEEE 22ND INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOENGINEERING (BIBE 2022), 2022, : 168 - 173
  • [8] Multi-modal deep learning model for auxiliary diagnosis of Alzheimer's disease
    Zhang, Fan
    Li, Zhenzhen
    Zhang, Boyan
    Dua, Haishun
    Wang, Binjie
    Zhang, Xinhong
    NEUROCOMPUTING, 2019, 361 : 185 - 195
  • [9] Exploring Fusion Strategies in Deep Learning Models for Multi-Modal Classification
    Zhang, Duoyi
    Nayak, Richi
    Bashar, Md Abul
    DATA MINING, AUSDM 2021, 2021, 1504 : 102 - 117
  • [10] Self-paced Learning for Multi-modal Fusion for Alzheimer's Disease Diagnosis
    Yuan, Ning
    Zhu, Qi
    Guan, Donghai
    Yuan, Weiwei
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 70 - 75