Assisted Diagnosis of Alzheimer's Disease Based on Deep Learning and Multimodal Feature Fusion

被引:13
|
作者
Wang, Yu [1 ]
Liu, Xi [1 ]
Yu, Chongchong [1 ]
机构
[1] Beijing Technol & Business Univ, Sch Artificial Intelligence, Beijing Key Lab Big Data Technol Food Safety, Beijing 100048, Peoples R China
基金
北京市自然科学基金;
关键词
CONVOLUTIONAL NEURAL-NETWORK;
D O I
10.1155/2021/6626728
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
With the development of artificial intelligence technologies, it is possible to use computer to read digital medical images. Because Alzheimer's disease (AD) has the characteristics of high incidence and high disability, it has attracted the attention of many scholars, and its diagnosis and treatment have gradually become a hot topic. In this paper, a multimodal diagnosis method for AD based on three-dimensional shufflenet (3DShuffleNet) and principal component analysis network (PCANet) is proposed. First, the data on structural magnetic resonance imaging (sMRI) and functional magnetic resonance imaging (fMRI) are preprocessed to remove the influence resulting from the differences in image size and shape of different individuals, head movement, noise, and so on. Then, the original two-dimensional (2D) ShuffleNet is developed three-dimensional (3D), which is more suitable for 3D sMRI data to extract the features. In addition, the PCANet network is applied to the brain function connection analysis, and the features on fMRI data are obtained. Next, kernel canonical correlation analysis (KCCA) is used to fuse the features coming from sMRI and fMRI, respectively. Finally, a good classification effect is obtained through the support vector machines (SVM) method classifier, which proves the feasibility and effectiveness of the proposed method.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Deep learning and multimodal feature fusion for the aided diagnosis of Alzheimer's disease
    Jia, Hongfei
    Lao, Huan
    [J]. NEURAL COMPUTING & APPLICATIONS, 2022, 34 (22): : 19585 - 19598
  • [2] Deep learning and multimodal feature fusion for the aided diagnosis of Alzheimer's disease
    Hongfei Jia
    Huan Lao
    [J]. Neural Computing and Applications, 2022, 34 : 19585 - 19598
  • [3] Multimodal Fusion-Based Deep Learning Network for Effective Diagnosis of Alzheimer's Disease
    Dwivedi, Shubham
    Goel, Tripti
    Tanveer, M.
    Murugan, R.
    Sharma, Rahul
    [J]. IEEE MULTIMEDIA, 2022, 29 (02) : 45 - 55
  • [4] Alzheimer's disease diagnosis via multimodal feature fusion
    Tu, Yue
    Lin, Shukuan
    Qiao, Jianzhong
    Zhuang, Yilin
    Zhang, Peng
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 148
  • [5] A Multimodal Deep Learning Based Approach for Alzheimer's Disease Diagnosis
    De Simone, Adriano
    Sansone, Carlo
    [J]. IMAGE ANALYSIS AND PROCESSING - ICIAP 2023 WORKSHOPS, PT II, 2024, 14366 : 131 - 139
  • [6] Multimodal Neuroimaging Feature Learning With Multimodal Stacked Deep Polynomial Networks for Diagnosis of Alzheimer's Disease
    Shi, Jun
    Zheng, Xiao
    Li, Yan
    Zhang, Qi
    Ying, Shihui
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2018, 22 (01) : 173 - 183
  • [7] Multimodal attention-based deep learning for Alzheimer's disease diagnosis
    Golovanevsky, Michal
    Eickhoff, Carsten
    Singh, Ritambhara
    [J]. JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2022, 29 (12) : 2014 - 2022
  • [8] Multimodal Neuroimaging Feature Learning for Multiclass Diagnosis of Alzheimer's Disease
    Liu, Siqi
    Liu, Sidong
    Cai, Weidong
    Che, Hangyu
    Pujol, Sonia
    Kikinis, Ron
    Feng, Dagan
    Fulham, Michael J.
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2015, 62 (04) : 1132 - 1140
  • [9] Explainable Deep-Learning-Based Diagnosis of Alzheimer’s Disease Using Multimodal Input Fusion of PET and MRI Images
    Modupe Odusami
    Rytis Maskeliūnas
    Robertas Damaševičius
    Sanjay Misra
    [J]. Journal of Medical and Biological Engineering, 2023, 43 : 291 - 302
  • [10] Explainable Deep-Learning-Based Diagnosis of Alzheimer's Disease Using Multimodal Input Fusion of PET and MRI Images
    Odusami, Modupe
    Maskeliunas, Rytis
    Damasevicius, Robertas
    Misra, Sanjay
    [J]. JOURNAL OF MEDICAL AND BIOLOGICAL ENGINEERING, 2023, 43 (03) : 291 - 302