Incomplete multi-modal representation learning for Alzheimer's disease diagnosis

被引:45
|
作者
Liu, Yanbei [1 ,2 ]
Fan, Lianxi [3 ]
Zhang, Changqing [4 ]
Zhou, Tao [5 ]
Xiao, Zhitao [1 ]
Geng, Lei [1 ]
Shen, Dinggang [6 ,7 ,8 ]
机构
[1] Tiangong Univ, Sch Life Sci, Tianjin 300387, Peoples R China
[2] Tianjin Key Lab Optoelect Detect Technol & Syst, Tianjin, Peoples R China
[3] Tiangong Univ, Sch Elect & Informat Engn, Tianjin 300387, Peoples R China
[4] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
[5] Incept Inst Artificial Intelligence, Abu Dhabi 51133, U Arab Emirates
[6] Shanghai Tech Univ, Sch Biomed Engn, Shanghai, Peoples R China
[7] Shanghai United Imaging Intelligence Co Ltd, Shanghai, Peoples R China
[8] Korea Univ, Dept Artificial Intelligence, Seoul 02841, South Korea
基金
中国国家自然科学基金;
关键词
Alzheimers disease diagnosis; multi-modal representation learning; incomplete multi-modality data; auto-encoder network; kernel completion; ALGORITHM; TUTORIAL;
D O I
10.1016/j.media.2020.101953
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Alzheimers disease (AD) is a complex neurodegenerative disease. Its early diagnosis and treatment have been a major concern of researchers. Currently, the multi-modality data representation learning of this disease is gradually becoming an emerging research field, attracting widespread attention. However, in practice, data from multiple modalities are only partially available, and most of the existing multi-modal learning algorithms can not deal with the incomplete multi-modality data. In this paper, we propose an Auto-Encoder based Multi-View missing data Completion framework (AEMVC) to learn common representations for AD diagnosis. Specifically, we firstly map the original complete view to a latent space using an auto-encoder network framework. Then, the latent representations measuring statistical dependence learned from the complete view are used to complement the kernel matrix of the incomplete view in the kernel space. Meanwhile, the structural information of original data and the inherent association between views are maintained by graph regularization and Hilbert-Schmidt Independence Criterion (HSIC) constraints. Finally, a kernel based multi-view method is applied to the learned kernel matrix for the acquisition of common representations. Experimental results achieved on Alzheimers Disease Neuroimaging Initiative (ADNI) datasets validate the effectiveness of the proposed method. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Relation-Induced Multi-Modal Shared Representation Learning for Alzheimer's Disease Diagnosis
    Ning, Zhenyuan
    Xiao, Qing
    Feng, Qianjin
    Chen, Wufan
    Zhang, Yu
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (06) : 1632 - 1645
  • [2] Multi-modal deep learning model for auxiliary diagnosis of Alzheimer's disease
    Zhang, Fan
    Li, Zhenzhen
    Zhang, Boyan
    Dua, Haishun
    Wang, Binjie
    Zhang, Xinhong
    NEUROCOMPUTING, 2019, 361 : 185 - 195
  • [3] Self-paced Learning for Multi-modal Fusion for Alzheimer's Disease Diagnosis
    Yuan, Ning
    Zhu, Qi
    Guan, Donghai
    Yuan, Weiwei
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 70 - 75
  • [4] Re-transfer learning and multi-modal learning assisted early diagnosis of Alzheimer's disease
    Fang, Meie
    Jin, Zhuxin
    Qin, Feiwei
    Peng, Yong
    Jiang, Chao
    Pan, Zhigeng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (20) : 29159 - 29175
  • [5] Re-transfer learning and multi-modal learning assisted early diagnosis of Alzheimer’s disease
    Meie Fang
    Zhuxin Jin
    Feiwei Qin
    Yong Peng
    Chao Jiang
    Zhigeng Pan
    Multimedia Tools and Applications, 2022, 81 : 29159 - 29175
  • [6] Multi-modal neuroimaging feature fusion for diagnosis of Alzheimer's disease
    Zhang, Tao
    Shi, Mingyang
    JOURNAL OF NEUROSCIENCE METHODS, 2020, 341
  • [7] Pairwise feature-based generative adversarial network for incomplete multi-modal Alzheimer's disease diagnosis
    Ye, Haizhou
    Zhu, Qi
    Yao, Yuan
    Jin, Yichao
    Zhang, Daoqiang
    VISUAL COMPUTER, 2023, 39 (06): : 2235 - 2244
  • [8] Pairwise feature-based generative adversarial network for incomplete multi-modal Alzheimer’s disease diagnosis
    Haizhou Ye
    Qi Zhu
    Yuan Yao
    Yichao Jin
    Daoqiang Zhang
    The Visual Computer, 2023, 39 (6) : 2235 - 2244
  • [9] Cascaded Multi-Modal Mixing Transformers for Alzheimer's Disease Classification with Incomplete Data
    Liu, Linfeng
    Liu, Siyu
    Zhang, Lu
    To, Xuan Vinh
    Nasrallah, Fatima
    Chandra, Shekhar S.
    NEUROIMAGE, 2023, 277
  • [10] A Multi-modal Data Platform for Diagnosis and Prediction of Alzheimer’s Disease Using Machine Learning Methods
    Zhen Pang
    Xiang Wang
    Xulong Wang
    Jun Qi
    Zhong Zhao
    Yuan Gao
    Yun Yang
    Po Yang
    Mobile Networks and Applications, 2021, 26 : 2341 - 2352