Fusion of brain imaging genetic data for alzheimer's disease diagnosis and causal factors identification using multi-stream attention mechanisms and graph convolutional networks

Correctly diagnosing Alzheimer's disease (AD) and identifying pathogenic brain regions and genes play a vital role in understanding the AD and developing effective prevention and treatment strategies. Recent works combine imaging and genetic data, and leverage the strengths of both modalities to achieve better classification results. In this work, we propose MCA-GCN, a Multi-stream Cross-Attention and Graph Convolutional Network- based classification method for AD patients. It first constructs a brain region-gene association network based on brain region fMRI time series and gene SNP data. Then it integrates the absolute and relative positions of the brain region time series to obtain a new brain region time series containing temporal information. Then long-range and local association features between brain regions and genes are sequentially aggregated by multi-stream cross-attention and graph convolutional networks. Finally, the learned brain region and gene features are input to the fully connected network to predict AD types. Experimental results on the ADNI dataset show that our model outperforms other methods in AD classification tasks. Moreover, MCA-GCN designed a multi-stage feature scoring process to extract high-risk genes and brain regions related to disease classification.