Modeling Functional Brain Networks with Multi-Head Attention-based Region-Enhancement for ADHD Classification

被引:2
|
作者
Cao, Chunhong [1 ]
Fu, Huawei [1 ]
Li, Gai [1 ]
Wang, Mengyang [1 ]
Gao, Xieping [1 ]
机构
[1] Xiangtan Univ, Xiangtan, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
ADHD diagnosis; functional brain networks; multi-head attention mechanism; region-enhancement; FMRI; IDENTIFICATION; CHILDREN;
D O I
10.1145/3591106.3592240
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Increasing attention has been paid to attention-deficit hyperactivity disorder (ADHD)-assisted diagnosis using functional brain networks (FBNs) since FBNs-based ADHD diagnosis can not only extract the functional connectivities from FBNs as potential biomarkers for brain disease classification, but also identify the focal regions of disease. Therefore, modeling FBNs has become a key topic for ADHD diagnosis via resting state functional magnetic resonance imaging (rfMRI). However, the dominant models either ignore the strong regional correlation between adjacent time series or fail to capture the long-distance dependency (LDD) in imaging series. To address the issues, we propose a multi-head attention-based region-enhancement model (MAREM) for ADHD classification. Firstly, a multi-head attention mechanism with region-enhancement is designed to represent the FBNs, where region-enhancement module are designed to process strong regional correlation between adjacent time series. Secondly, multi-head attention is used to map the region information of each time point into different subspaces for establishing global dependencies in imaging series. Thirdly, the proposed model is applied to the ADHD-200 dataset for classification. The results show the proposed model's out-performance of the state-of-the-art in both classification accuracy and generalization ability. Furthermore, we identify several brain networks that have been considered to be associated with ADHD in clinical studies.
引用
收藏
页码:362 / 369
页数:8
相关论文
共 50 条
  • [41] Multi-stage Attention-based Capsule Networks for Image Classification
    Song, Yan
    Wang, Yong
    Zidonghua Xuebao/Acta Automatica Sinica, 2024, 50 (09): : 1804 - 1817
  • [42] Multi-head Self-attention Recommendation Model based on Feature Interaction Enhancement
    Yin, Yunfei
    Huang, Caihao
    Sun, Jingqin
    Huang, Faliang
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 1740 - 1745
  • [43] Graph convolutional networks with hierarchical multi-head attention for aspect-level sentiment classification
    Li, Xiaowen
    Lu, Ran
    Liu, Peiyu
    Zhu, Zhenfang
    JOURNAL OF SUPERCOMPUTING, 2022, 78 (13): : 14846 - 14865
  • [44] Graph convolutional networks with hierarchical multi-head attention for aspect-level sentiment classification
    Xiaowen Li
    Ran Lu
    Peiyu Liu
    Zhenfang Zhu
    The Journal of Supercomputing, 2022, 78 : 14846 - 14865
  • [45] MedGraph: malicious edge detection in temporal reciprocal graph via multi-head attention-based GNN
    Chen, Kai
    Wang, Ziao
    Liu, Kai
    Zhang, Xiaofeng
    Luo, Linhao
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (12): : 8919 - 8935
  • [46] MedGraph: malicious edge detection in temporal reciprocal graph via multi-head attention-based GNN
    Kai Chen
    Ziao Wang
    Kai Liu
    Xiaofeng Zhang
    Linhao Luo
    Neural Computing and Applications, 2023, 35 : 8919 - 8935
  • [47] Multi-Head Attention-Based Long Short-Term Memory for Depression Detection From Speech
    Zhao, Yan
    Liang, Zhenlin
    Du, Jing
    Zhang, Li
    Liu, Chengyu
    Zhao, Li
    FRONTIERS IN NEUROROBOTICS, 2021, 15
  • [48] A Reverse Positional Encoding Multi-Head Attention-Based Neural Machine Translation Model for Arabic Dialects
    Baniata, Laith H.
    Kang, Sangwoo
    Ampomah, Isaac K. E.
    MATHEMATICS, 2022, 10 (19)
  • [49] Multi-head attention-based intelligent vehicle lane change decision and trajectory prediction model in highways
    Cai, Junyu
    Jiang, Haobin
    Wang, Junyan
    Li, Aoxue
    JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2024,
  • [50] MoMA: Momentum contrastive learning with multi-head attention-based knowledge distillation for histopathology image analysis
    Vuong, Trinh Thi Le
    Kwak, Jin Tae
    MEDICAL IMAGE ANALYSIS, 2025, 101