Inter-modality Dependence Induced Data Recovery for MCI Conversion Prediction

被引:7
|
作者
Zhou, Tao [1 ]
Thung, Kim-Han [2 ,3 ]
Zhang, Yu [4 ]
Fu, Huazhu [1 ]
Shen, Jianbing [1 ]
Shen, Dinggang [2 ,3 ]
Shao, Ling [1 ]
机构
[1] Incept Inst Artificial Intelligence, Abu Dhabi, U Arab Emirates
[2] Univ N Carolina, Dept Radiol, Chapel Hill, NC 27515 USA
[3] Univ N Carolina, BRIC, Chapel Hill, NC 27515 USA
[4] Stanford Univ, Dept Psychiat & Behav Sci, Stanford, CA 94305 USA
关键词
D O I
10.1007/978-3-030-32251-9_21
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Learning complementary information from multi-modality data often improves diagnostic performance of brain disorders. However, it is challenging to obtain this complementary information when the data are incomplete. Existing methods, such as low-rank matrix completion (which imputes the missing data) and multi-task learning (which restructures the problem into the joint learning of multiple tasks, with each task associated with a subset of complete data), simply concatenate features from different modalities without considering their underlying correlations. Furthermore, most methods conduct multi-modality fusion and prediction model learning in separated steps, which may render to a sub-optimal solution. To address these issues, we propose a novel diagnostic model that integrates missing data recovery, latent space learning and prediction model learning into a unified framework. Specifically, we first recover the missing modality by maximizing the dependency among different modalities. Then, we further exploit the modality correlation by projecting different modalities into a common latent space. Besides, we employ an l(1)-norm to our loss function to mitigate the influence of sample outliers. Finally, we map the learned latent representation into the label space. All these tasks are learned iteratively in a unified framework, where the label information (from the training samples) can also inherently guide the missing modality recovery. Experimental results on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset show the effectiveness of our method.
引用
收藏
页码:186 / 195
页数:10
相关论文
共 11 条
  • [1] Inter-modality Relationship Constrained Multi-Task Feature Selection for AD/MCI Classification
    Liu, Feng
    Wee, Chong-Yaw
    Chen, Huafu
    Shen, Dinggang
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION (MICCAI 2013), PT I, 2013, 8149 : 308 - 315
  • [2] Joint classification of hyperspectral and LiDAR data based on inter-modality match learning
    Hang R.
    Sun Y.
    Liu Q.
    National Remote Sensing Bulletin, 2024, 28 (01) : 154 - 167
  • [3] Improving compound-protein interaction prediction by focusing on intra-modality and inter-modality dynamics with a multimodal tensor fusion strategy
    Department of Biostatistics, Harbin Medical University, Harbin
    150081, China
    不详
    21983, Korea, Republic of
    Comput. Struct. Biotechnol. J., 2024, (3714-3729): : 3714 - 3729
  • [4] Multi-modal fusion network with intra- and inter-modality attention for prognosis prediction in breast cancer
    Liu, Honglei
    Shi, Yi
    Li, Ao
    Wang, Minghui
    COMPUTERS IN BIOLOGY AND MEDICINE, 2024, 168
  • [5] Multivariate Data Analysis and Machine Learning for Prediction of MCI-to-AD Conversion
    Skolariki, Konstantina
    Terrera, Graciella Muniz
    Danso, Samuel
    GENEDIS 2018: COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2020, 1194 : 81 - 103
  • [6] Predicting Conversion from MCI to AD Combining Multi-Modality Data and Based on Molecular Subtype
    Li, Hai-Tao
    Yuan, Shao-Xun
    Wu, Jian-Sheng
    Gu, Yu
    Sun, Xiao
    BRAIN SCIENCES, 2021, 11 (06)
  • [7] Agent-Based Approach for (Peri-)Urban Inter-Modality Policies: Application to Real Data from the Lille Metropolis
    Diallo, Azise Oumar
    Lozenguez, Guillaume
    Doniec, Arnaud
    Mandiau, Rene
    SENSORS, 2023, 23 (05)
  • [8] Semi-supervised learning in MCI-to-AD conversion prediction - When is unlabeled data useful?
    Moradi, Elaheh
    Tohka, Jussi
    Gaser, Christian
    Disease, Alzheimer's
    2014 INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION IN NEUROIMAGING, 2014,
  • [9] Streamlining inter-operation memory communication via data dependence prediction
    Moshovos, A
    Sohi, GS
    THIRTIETH ANNUAL IEEE/ACM INTERNATIONAL SYMPOSIUM ON MICROARCHITECTURE, PROCEEDINGS, 1997, : 235 - 245
  • [10] Deep Learning Approaches for Early Prediction of Conversion from MCI to AD using MRI and Clinical Data: A Systematic Review
    Gelareh Valizadeh
    Reza Elahi
    Zahra Hasankhani
    Hamidreza Saligheh Rad
    Ahmad Shalbaf
    Archives of Computational Methods in Engineering, 2025, 32 (2) : 1229 - 1298