A Multi-Graph Cross-Attention-Based Region-Aware Feature Fusion Network Using Multi-Template for Brain Disorder Diagnosis

被引:4
|
作者
Ma, Yulan [1 ]
Cui, Weigang [2 ]
Liu, Jingyu [3 ]
Guo, Yuzhu [1 ]
Chen, Huiling [4 ]
Li, Yang [5 ,6 ]
机构
[1] Beihang Univ, Dept Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Engn Med, Beijing 100191, Peoples R China
[3] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
[4] Wenzhou Univ, Coll Comp Sci & Artificial Intelligence, Wenzhou 325035, Peoples R China
[5] Beihang Univ, Dept Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[6] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Diseases; Fuses; Brain modeling; Autism; Time series analysis; Organizations; Mild cognitive impairment (MCI); autism spectrum disorder (ASD); deep learning; feature fusion; multi-template; multi-graph cross-attention; CONNECTIVITY; PARCELLATION; ATLAS;
D O I
10.1109/TMI.2023.3327283
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Functional connectivity (FC) networks based on resting-state functional magnetic imaging (rs-fMRI) are reliable and sensitive for brain disorder diagnosis. However, most existing methods are limited by using a single template, which may be insufficient to reveal complex brain connectivities. Furthermore, these methods usually neglect the complementary information between static and dynamic brain networks, and the functional divergence among different brain regions, leading to suboptimal diagnosis performance. To address these limitations, we propose a novel multi-graph cross-attention based region-aware feature fusion network (MGCA-RAFFNet) by using multi-template for brain disorder diagnosis. Specifically, we first employ multi-template to parcellate the brain space into different regions of interest (ROIs). Then, a multi-graph cross-attention network (MGCAN), including static and dynamic graph convolutions, is developed to explore the deep features contained in multi-template data, which can effectively analyze complex interaction patterns of brain networks for each template, and further adopt a dual-view cross-attention (DVCA) to acquire complementary information. Finally, to efficiently fuse multiple static-dynamic features, we design a region-aware feature fusion network (RAFFNet), which is beneficial to improve the feature discrimination by considering the underlying relations among static-dynamic features in different brain regions. Our proposed method is evaluated on both public ADNI-2 and ABIDE-I datasets for diagnosing mild cognitive impairment (MCI) and autism spectrum disorder (ASD). Extensive experiments demonstrate that the proposed method outperforms the state-of-the-art methods.
引用
收藏
页码:1045 / 1059
页数:15
相关论文
共 46 条
  • [41] VioNets: efficient multi-modal fusion method based on bidirectional gate recurrent unit and cross-attention graph convolutional network for video violence detection
    Liang, Wuyan
    Xu, Xiaolong
    Fu, Xiao
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (02)
  • [42] CMAF-Net: a cross-modal attention fusion-based deep neural network for incomplete multi-modal brain tumor segmentation
    Sun, Kangkang
    Ding, Jiangyi
    Li, Qixuan
    Chen, Wei
    Zhang, Heng
    Sun, Jiawei
    Jiao, Zhuqing
    Ni, Xinye
    QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2024, 14 (07) : 4579 - 4604
  • [43] WSAFormer-DFFN: A model for rotating machinery fault diagnosis using 1D window-based multi-head self-attention and deep feature fusion network
    Wei, Qingzhe
    Tian, Xincheng
    Cui, Long
    Zheng, Fuquan
    Liu, Lida
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 124
  • [44] Multi-scale feature fusion network-based industrial process fault diagnosis method using space-time capsule and classifier optimization
    Zhao, Yue
    Bai, Jianjun
    Zou, Hongbo
    Feng, Jing
    CANADIAN JOURNAL OF CHEMICAL ENGINEERING, 2025,
  • [45] Water Body Extraction in Remote Sensing Imagery Using Domain Adaptation-Based Network Embedding Selective Self-Attention and Multi-Scale Feature Fusion
    Liu, Jiahang
    Wang, Yue
    REMOTE SENSING, 2022, 14 (15)
  • [46] Mechanical Fault Diagnosis Method Based on Multi-sensor Signal Feature Fusion Using Deep Convolutional Neural Network; [利用DCNN融合多传感器特征的故障诊断方法]
    Wu Y.
    Zhao R.
    Jin W.
    He T.
    Wu J.
    Zhao, Rongzhen (zhaorongzhen@lut.cn), 1600, Nanjing University of Aeronautics an Astronautics (41): : 362 - 369and416