Alzheimer's disease diagnosis from multi-modal data via feature inductive learning and dual multilevel graph neural network

被引:1
|
作者
Lei, Baiying [1 ]
Li, Yafeng [1 ]
Fu, Wanyi [2 ]
Yang, Peng [1 ]
Chen, Shaobin [1 ]
Wang, Tianfu [1 ]
Xiao, Xiaohua [3 ]
Niu, Tianye [4 ]
Fu, Yu [5 ]
Wang, Shuqiang [6 ]
Han, Hongbin [7 ,8 ]
Qin, Jing [9 ]
机构
[1] Shenzhen Univ, Guangdong Key Lab Biomed Measurements & Ultrasoun, Sch Biomed Engn,Marshall Lab Biomed Engn, Natl Reg Key Technol Engn Lab Med Ultrasound,Med, Shenzhen 518060, Peoples R China
[2] Tsinghua Univ, Dept Elect Engn, Beijing Key Lab Magnet Resonance Imaging Devices, Beijing, Peoples R China
[3] Shenzhen Univ, Med Sch, Affiliated Hosp 1, Shenzhen Peoples Hosp 2, Shenzhen 530031, Peoples R China
[4] Shenzhen Bay Lab, Shenzhen 518067, Peoples R China
[5] Peking Univ Third Hosp, Dept Neurol, 49 North Garden Rd, Beijing 100191, Peoples R China
[6] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[7] Peking Univ Third Hosp, Peking Univ Hlth Sci Ctr, Inst Med Technol, Dept Radiol,Beijing Key Lab Magnet Resonance Imag, Beijing 100191, Peoples R China
[8] Dalian Med Univ, Hosp 2, Res & Developing Ctr Med Technol, Dalian 116027, Peoples R China
[9] Hong Kong Polytech Univ, Ctr Smart Hlth, Sch Nursing, Hong Kong, Peoples R China
基金
美国国家卫生研究院; 中国国家自然科学基金;
关键词
Alzheimer's disease analysis; Feature inductive learning; Dual multilevel graph neural network; Multi-modal data; CANONICAL CORRELATION-ANALYSIS; CONVOLUTIONAL NETWORK; CLASSIFICATION; ASSOCIATION; PREDICTION; VARIANTS;
D O I
10.1016/j.media.2024.103213
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi -modal data can provide complementary information of Alzheimer's disease (AD) and its development from different perspectives. Such information is closely related to the diagnosis, prevention, and treatment of AD, and hence it is necessary and critical to study AD through multi -modal data. Existing learning methods, however, usually ignore the influence of feature heterogeneity and directly fuse features in the last stages. Furthermore, most of these methods only focus on local fusion features or global fusion features, neglecting the complementariness of features at different levels and thus not sufficiently leveraging information embedded in multi -modal data. To overcome these shortcomings, we propose a novel framework for AD diagnosis that fuses gene, imaging, protein, and clinical data. Our framework learns feature representations under the same feature space for different modalities through a feature induction learning (FIL) module, thereby alleviating the impact of feature heterogeneity. Furthermore, in our framework, local and global salient multi -modal feature interaction information at different levels is extracted through a novel dual multilevel graph neural network (DMGNN). We extensively validate the proposed method on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset and experimental results demonstrate our method consistently outperforms other state-of-the-art multi -modal fusion methods. The code is publicly available on the GitHub website. (https: //github.com/xiankantingqianxue/MIA-code.git)
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Multi-modal graph neural network for early diagnosis of Alzheimer's disease from sMRI and PET scans
    Zhang, Yanteng
    He, Xiaohai
    Chan, Yi Hao
    Teng, Qizhi
    Rajapakse, Jagath C.
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 164
  • [2] Multi-modal Graph Neural Network for Early Diagnosis of Alzheimer's Disease from sMRI and PET Scans
    Zhang, Yanteng
    He, Xiaohai
    Chan, Yi Hao
    Teng, Qizhi
    Rajapakse, Jagath C.
    arXiv, 2023,
  • [3] Multi-Modal Neuroimaging Neural Network-Based Feature Detection for Diagnosis of Alzheimer's Disease
    Meng, Xianglian
    Liu, Junlong
    Fan, Xiang
    Bian, Chenyuan
    Wei, Qingpeng
    Wang, Ziwei
    Liu, Wenjie
    Jiao, Zhuqing
    FRONTIERS IN AGING NEUROSCIENCE, 2022, 14
  • [4] Multi-modal feature selection with anchor graph for Alzheimer's disease
    Li, Jiaye
    Xu, Hang
    Yu, Hao
    Jiang, Zhihao
    Zhu, Lei
    FRONTIERS IN NEUROSCIENCE, 2022, 16
  • [5] Multi-modal Neuroimaging Data Fusion via Latent Space Learning for Alzheimer's Disease Diagnosis
    Zhou, Tao
    Thung, Kim-Han
    Liu, Mingxia
    Shi, Feng
    Zhang, Changqing
    Shen, Dinggang
    PREDICTIVE INTELLIGENCE IN MEDICINE, 2018, 11121 : 76 - 84
  • [6] Multi-modal neuroimaging feature fusion for diagnosis of Alzheimer's disease
    Zhang, Tao
    Shi, Mingyang
    JOURNAL OF NEUROSCIENCE METHODS, 2020, 341
  • [7] Multi-modal cross-attention network for Alzheimer's disease diagnosis with multi data
    Zhang, Jin
    He, Xiaohai
    Liu, Yan
    Cai, Qingyan
    Chen, Honggang
    Qing, Linbo
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 162
  • [8] Incomplete multi-modal representation learning for Alzheimer's disease diagnosis
    Liu, Yanbei
    Fan, Lianxi
    Zhang, Changqing
    Zhou, Tao
    Xiao, Zhitao
    Geng, Lei
    Shen, Dinggang
    MEDICAL IMAGE ANALYSIS, 2021, 69
  • [9] Self-Supervised Feature Learning via Exploiting Multi-Modal Data for Retinal Disease Diagnosis
    Li, Xiaomeng
    Jia, Mengyu
    Islam, Md Tauhidul
    Yu, Lequan
    Xing, Lei
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (12) : 4023 - 4033
  • [10] A Multi-modal Convolutional Neural Network Framework for the Prediction of Alzheimer's Disease
    Spasov, Simeon E.
    Passamonti, Luca
    Duggento, Andrea
    Lio, Pietro
    Toschi, Nicola
    2018 40TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2018, : 1271 - 1274