Alzheimer's disease diagnosis from multi-modal data via feature inductive learning and dual multilevel graph neural network

被引:1
|
作者
Lei, Baiying [1 ]
Li, Yafeng [1 ]
Fu, Wanyi [2 ]
Yang, Peng [1 ]
Chen, Shaobin [1 ]
Wang, Tianfu [1 ]
Xiao, Xiaohua [3 ]
Niu, Tianye [4 ]
Fu, Yu [5 ]
Wang, Shuqiang [6 ]
Han, Hongbin [7 ,8 ]
Qin, Jing [9 ]
机构
[1] Shenzhen Univ, Guangdong Key Lab Biomed Measurements & Ultrasoun, Sch Biomed Engn,Marshall Lab Biomed Engn, Natl Reg Key Technol Engn Lab Med Ultrasound,Med, Shenzhen 518060, Peoples R China
[2] Tsinghua Univ, Dept Elect Engn, Beijing Key Lab Magnet Resonance Imaging Devices, Beijing, Peoples R China
[3] Shenzhen Univ, Med Sch, Affiliated Hosp 1, Shenzhen Peoples Hosp 2, Shenzhen 530031, Peoples R China
[4] Shenzhen Bay Lab, Shenzhen 518067, Peoples R China
[5] Peking Univ Third Hosp, Dept Neurol, 49 North Garden Rd, Beijing 100191, Peoples R China
[6] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[7] Peking Univ Third Hosp, Peking Univ Hlth Sci Ctr, Inst Med Technol, Dept Radiol,Beijing Key Lab Magnet Resonance Imag, Beijing 100191, Peoples R China
[8] Dalian Med Univ, Hosp 2, Res & Developing Ctr Med Technol, Dalian 116027, Peoples R China
[9] Hong Kong Polytech Univ, Ctr Smart Hlth, Sch Nursing, Hong Kong, Peoples R China
基金
美国国家卫生研究院; 中国国家自然科学基金;
关键词
Alzheimer's disease analysis; Feature inductive learning; Dual multilevel graph neural network; Multi-modal data; CANONICAL CORRELATION-ANALYSIS; CONVOLUTIONAL NETWORK; CLASSIFICATION; ASSOCIATION; PREDICTION; VARIANTS;
D O I
10.1016/j.media.2024.103213
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi -modal data can provide complementary information of Alzheimer's disease (AD) and its development from different perspectives. Such information is closely related to the diagnosis, prevention, and treatment of AD, and hence it is necessary and critical to study AD through multi -modal data. Existing learning methods, however, usually ignore the influence of feature heterogeneity and directly fuse features in the last stages. Furthermore, most of these methods only focus on local fusion features or global fusion features, neglecting the complementariness of features at different levels and thus not sufficiently leveraging information embedded in multi -modal data. To overcome these shortcomings, we propose a novel framework for AD diagnosis that fuses gene, imaging, protein, and clinical data. Our framework learns feature representations under the same feature space for different modalities through a feature induction learning (FIL) module, thereby alleviating the impact of feature heterogeneity. Furthermore, in our framework, local and global salient multi -modal feature interaction information at different levels is extracted through a novel dual multilevel graph neural network (DMGNN). We extensively validate the proposed method on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset and experimental results demonstrate our method consistently outperforms other state-of-the-art multi -modal fusion methods. The code is publicly available on the GitHub website. (https: //github.com/xiankantingqianxue/MIA-code.git)
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Re-transfer learning and multi-modal learning assisted early diagnosis of Alzheimer’s disease
    Meie Fang
    Zhuxin Jin
    Feiwei Qin
    Yong Peng
    Chao Jiang
    Zhigeng Pan
    Multimedia Tools and Applications, 2022, 81 : 29159 - 29175
  • [32] Relation-Induced Multi-Modal Shared Representation Learning for Alzheimer's Disease Diagnosis
    Ning, Zhenyuan
    Xiao, Qing
    Feng, Qianjin
    Chen, Wufan
    Zhang, Yu
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (06) : 1632 - 1645
  • [33] Multi-modal classification of Alzheimer's disease using nonlinear graph fusion
    Tong, Tong
    Gray, Katherine
    Gao, Qinquan
    Chen, Liang
    Rueckert, Daniel
    PATTERN RECOGNITION, 2017, 63 : 171 - 181
  • [34] Longitudinal and Multi-modal Data Learning via Joint Embedding and Sparse Regression for Parkinson's Disease Diagnosis
    Lei, Haijun
    Huang, Zhongwei
    Elazab, Ahmed
    Li, Hancong
    Lei, Baiying
    MACHINE LEARNING IN MEDICAL IMAGING: 9TH INTERNATIONAL WORKSHOP, MLMI 2018, 2018, 11046 : 310 - 318
  • [35] Integrating Transfer Learning and Deep Neural Networks for Accurate Medical Disease Diagnosis from Multi-Modal Data
    Kaur, Chamandeep
    Al-Ansari, Abdul Rahman Mohammed
    Gongada, Taviti Naidu
    Saravanan, K. Aanandha
    Rao, Divvela Srinivasa
    Borda, Ricardo Fernando Cosio
    Manikandan, R.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (08) : 518 - 528
  • [36] Interactive Learning of a Dual Convolution Neural Network for Multi-Modal Action Recognition
    Li, Qingxia
    Gao, Dali
    Zhang, Qieshi
    Wei, Wenhong
    Ren, Ziliang
    MATHEMATICS, 2022, 10 (21)
  • [37] Longitudinal and Multi-modal Data Learning for Parkinson's Disease Diagnosis via Stacked Sparse Auto-encoder
    Li, Shiqi
    Lei, Haijun
    Zhou, Feng
    Gardezi, Jamal
    Lei, Baiying
    2019 IEEE 16TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2019), 2019, : 384 - 387
  • [38] Multi-modal neuroimaging feature fusion via 3D Convolutional Neural Network architecture for schizophrenia diagnosis
    Masoudi, Babak
    Daneshvar, Sabalan
    Razavi, Seyed Naser
    INTELLIGENT DATA ANALYSIS, 2021, 25 (03) : 527 - 540
  • [39] MRI-based Alzheimer's disease prediction via distilling the knowledge in multi-modal data
    Guan, Hao
    Wang, Chaoyue
    Tao, Dacheng
    NEUROIMAGE, 2021, 244
  • [40] Machine learning on longitudinal multi-modal data enables the understanding and prognosis of Alzheimer's disease progression
    Zhang, Suixia
    Yuan, Jing
    Sun, Yu
    Wu, Fei
    Liu, Ziyue
    Zhai, Feifei
    Zhang, Yaoyun
    Somekh, Judith
    Peleg, Mor
    Zhu, Yi-Cheng
    Huang, Zhengxing
    ISCIENCE, 2024, 27 (07)