Combining Neuroimaging and Omics Datasets for Disease Classification Using Graph Neural Networks

被引:16
|
作者
Chan, Yi Hao [1 ]
Wang, Conghao [1 ]
Soh, Wei Kwek [1 ]
Rajapakse, Jagath C. [1 ]
机构
[1] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore, Singapore
关键词
attention; diffusion tensor imaging; disease classification; functional magnetic resonance imaging; Generative Adversarial Networks; graph convolutional networks; multi-omics; Parkinson's disease; PARKINSONS-DISEASE;
D O I
10.3389/fnins.2022.866666
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Both neuroimaging and genomics datasets are often gathered for the detection of neurodegenerative diseases. Huge dimensionalities of neuroimaging data as well as omics data pose tremendous challenge for methods integrating multiple modalities. There are few existing solutions that can combine both multi-modal imaging and multi-omics datasets to derive neurological insights. We propose a deep neural network architecture that combines both structural and functional connectome data with multi-omics data for disease classification. A graph convolution layer is used to model functional magnetic resonance imaging (fMRI) and diffusion tensor imaging (DTI) data simultaneously to learn compact representations of the connectome. A separate set of graph convolution layers are then used to model multi-omics datasets, expressed in the form of population graphs, and combine them with latent representations of the connectome. An attention mechanism is used to fuse these outputs and provide insights on which omics data contributed most to the model's classification decision. We demonstrate our methods for Parkinson's disease (PD) classification by using datasets from the Parkinson's Progression Markers Initiative (PPMI). PD has been shown to be associated with changes in the human connectome and it is also known to be influenced by genetic factors. We combine DTI and fMRI data with multi-omics data from RNA Expression, Single Nucleotide Polymorphism (SNP), DNA Methylation and non-coding RNA experiments. A Matthew Correlation Coefficient of greater than 0.8 over many combinations of multi-modal imaging data and multi-omics data was achieved with our proposed architecture. To address the paucity of paired multi-modal imaging data and the problem of imbalanced data in the PPMI dataset, we compared the use of oversampling against using CycleGAN on structural and functional connectomes to generate missing imaging modalities. Furthermore, we performed ablation studies that offer insights into the importance of each imaging and omics modality for the prediction of PD. Analysis of the generated attention matrices revealed that DNA Methylation and SNP data were the most important omics modalities out of all the omics datasets considered. Our work motivates further research into imaging genetics and the creation of more multi-modal imaging and multi-omics datasets to study PD and other complex neurodegenerative diseases.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Combining neural networks for gait classification
    Sen Koktas, Nigar
    Yalabik, Nese
    Yavuzer, Gunes
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS AND APPLICATIONS, PROCEEDINGS, 2006, 4225 : 381 - 388
  • [22] Comorbidity-based framework for Alzheimer's disease classification using graph neural networks
    Abuhantash, Ferial
    Abu Hantash, Mohd Khalil
    AlShehhi, Aamna
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [23] Classification of Diabetic Retinopathy Disease Levels by Extracting Topological Features Using Graph Neural Networks
    Sundar, Sumod
    Sumathy, S.
    IEEE ACCESS, 2023, 11 : 51435 - 51444
  • [24] Parameterized Hypercomplex Graph Neural Networks for Graph Classification
    Le, Tuan
    Bertolini, Marco
    Noe, Frank
    Clevert, Djork-Arne
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT III, 2021, 12893 : 204 - 216
  • [25] Neuroimaging modality fusion in Alzheimer's classification using convolutional neural networks
    Punjabi, Arjun
    Martersteck, Adam
    Wang, Yanran
    Parrish, Todd B.
    Katsaggelos, Aggelos K.
    PLOS ONE, 2019, 14 (12):
  • [26] USING NEURAL NETWORKS FOR CLASSIFICATION TASKS - SOME EXPERIMENTS ON DATASETS AND PRACTICAL ADVICE
    HART, A
    JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 1992, 43 (03) : 215 - 226
  • [27] Irregular Breathing Classification From Multiple Patient Datasets Using Neural Networks
    Lee, Suk Jin
    Motai, Yuichi
    Weiss, Elisabeth
    Sun, Shumei S.
    IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE, 2012, 16 (06): : 1253 - 1264
  • [28] Predicting Classification Accuracy of Unlabeled Datasets Using Multiple Deep Neural Networks
    You, Shingchern D.
    Liu, Hsiao-Chung
    Liu, Chien-Hung
    IEEE ACCESS, 2022, 10 : 44627 - 44637
  • [29] Rumour detection on benchmark twitter datasets using graph neural networks with data augmentation
    Patel, Shaswat
    Bansal, Prince
    Kaur, Preeti
    SOCIAL NETWORK ANALYSIS AND MINING, 2024, 14 (01)
  • [30] Combining graph neural networks and computer vision methods for cell nuclei classification in lung tissue
    Perez-Cano, Jose
    Valero, Irene Sansano
    Anglada-Rotger, David
    Pina, Oscar
    Salembier, Philippe
    Marques, Ferran
    HELIYON, 2024, 10 (07)