Multi-Modal Fusion and Longitudinal Analysis for Alzheimer's Disease Classification Using Deep Learning

被引:0
|
作者
Muksimova, Shakhnoza [1 ]
Umirzakova, Sabina [1 ]
Baltayev, Jushkin [2 ]
Cho, Young Im [1 ]
机构
[1] Gachon Univ, Dept Comp Engn, Seongnam Si 461701, Gyeonggi Do, South Korea
[2] Tashkent State Univ Econ, Dept Informat Syst & Technol, Tashkent 100066, Uzbekistan
关键词
longitudinal data analysis; multi-modal imaging; lightweight neural networks; deep metric learning; Alzheimer's disease; generative adversarial networks; MRI;
D O I
10.3390/diagnostics15060717
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
Background: Addressing the complex diagnostic challenges of Alzheimer's disease (AD), this study introduces FusionNet, a groundbreaking framework designed to enhance AD classification through the integration of multi-modal and longitudinal imaging data. Methods: FusionNet synthesizes inputs from Magnetic Resonance Imaging (MRI), Positron Emission Tomography (PET), and Computed Tomography (CT) scans, harnessing advanced machine learning strategies such as generative adversarial networks (GANs) for robust data augmentation, lightweight neural architectures for efficient computation, and deep metric learning for precise feature extraction. The model uniquely combines cross-sectional and temporal data, significantly enhancing diagnostic accuracy and enabling the early detection and ongoing monitoring of AD. The FusionNet architecture incorporates specialized feature extraction pathways for each imaging modality, a fusion layer to integrate diverse data sources effectively, and attention mechanisms to focus on salient diagnostic features. Results: Demonstrating superior performance, FusionNet achieves an accuracy of 94%, with precision and recall rates of 92% and 93%, respectively. Conclusions: These results underscore its potential as a highly reliable diagnostic tool for AD, facilitating early intervention and tailored treatment strategies. FusionNet's innovative approach not only improves diagnostic precision but also offers new insights into the progression of Alzheimer's disease, supporting personalized patient care and advancing our understanding of this debilitating condition.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] MMTFN: Multi-modal multi-scale transformer fusion network for Alzheimer's disease diagnosis
    Miao, Shang
    Xu, Qun
    Li, Weimin
    Yang, Chao
    Sheng, Bin
    Liu, Fangyu
    Bezabih, Tsigabu T.
    Yu, Xiao
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2024, 34 (01)
  • [42] Multi-modal sequence learning for Alzheimer's disease progression prediction with incomplete variable-length longitudinal data
    Xu, Lei
    Wu, Hui
    He, Chunming
    Wang, Jun
    Zhang, Changqing
    Nie, Feiping
    Chen, Lei
    MEDICAL IMAGE ANALYSIS, 2022, 82
  • [43] Analysis of Deep Fusion Strategies for Multi-modal Gesture Recognition
    Roitberg, Alina
    Pollert, Tim
    Haurilet, Monica
    Martin, Manuel
    Stiefelhagen, Rainer
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 198 - 206
  • [44] Interoperable Multi-Modal Data Analysis Platform for Alzheimer's Disease Management
    Pang, Zhen
    Zhang, Shuhao
    Yang, Yun
    Qi, Jun
    Yang, Po
    2020 IEEE INTL SYMP ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, INTL CONF ON BIG DATA & CLOUD COMPUTING, INTL SYMP SOCIAL COMPUTING & NETWORKING, INTL CONF ON SUSTAINABLE COMPUTING & COMMUNICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2020), 2020, : 1321 - 1327
  • [45] A comparative review on multi-modal sensors fusion based on deep learning
    Tang, Qin
    Liang, Jing
    Zhu, Fangqi
    SIGNAL PROCESSING, 2023, 213
  • [46] An Improved Multi-Modal based Machine Learning Approach for the Prognosis of Alzheimer?s disease
    Khan, Afreen
    Zubair, Swaleha
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (06) : 2688 - 2706
  • [47] Unified Multi-modal Learning for Any Modality Combinations in Alzheimer's Disease Diagnosis
    Feng, Yidan
    Gao, Bingchen
    Deng, Sen
    Qiu, Anqi
    Qin, Jing
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT III, 2024, 15003 : 487 - 497
  • [48] MADP: Multi-modal Sequence Learning for Alzheimer's Disease Prediction with Missing Data
    Wang, Yudie
    Wang, Zirui
    Gong, Huiyun
    Wang, Sanwang
    Li, Mingzhe
    Dong, Jian
    GENERALIZING FROM LIMITED RESOURCES IN THE OPEN WORLD, GLOW-IJCAI 2024, 2024, 2160 : 93 - 103
  • [49] Multi-modal discriminative dictionary learning for Alzheimer's disease and mild cognitive impairment
    Li, Qing
    Wu, Xia
    Xu, Lele
    Chen, Kewei
    Yao, Li
    Li, Rui
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2017, 150 : 1 - 8
  • [50] Multi-Modal Object Tracking and Image Fusion With Unsupervised Deep Learning
    LaHaye, Nicholas
    Ott, Jordan
    Garay, Michael J.
    El-Askary, Hesham Mohamed
    Linstead, Erik
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2019, 12 (08) : 3056 - 3066