Modeling Functional Brain Networks with Multi-Head Attention-based Region-Enhancement for ADHD Classification

被引:2
|
作者
Cao, Chunhong [1 ]
Fu, Huawei [1 ]
Li, Gai [1 ]
Wang, Mengyang [1 ]
Gao, Xieping [1 ]
机构
[1] Xiangtan Univ, Xiangtan, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
ADHD diagnosis; functional brain networks; multi-head attention mechanism; region-enhancement; FMRI; IDENTIFICATION; CHILDREN;
D O I
10.1145/3591106.3592240
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Increasing attention has been paid to attention-deficit hyperactivity disorder (ADHD)-assisted diagnosis using functional brain networks (FBNs) since FBNs-based ADHD diagnosis can not only extract the functional connectivities from FBNs as potential biomarkers for brain disease classification, but also identify the focal regions of disease. Therefore, modeling FBNs has become a key topic for ADHD diagnosis via resting state functional magnetic resonance imaging (rfMRI). However, the dominant models either ignore the strong regional correlation between adjacent time series or fail to capture the long-distance dependency (LDD) in imaging series. To address the issues, we propose a multi-head attention-based region-enhancement model (MAREM) for ADHD classification. Firstly, a multi-head attention mechanism with region-enhancement is designed to represent the FBNs, where region-enhancement module are designed to process strong regional correlation between adjacent time series. Secondly, multi-head attention is used to map the region information of each time point into different subspaces for establishing global dependencies in imaging series. Thirdly, the proposed model is applied to the ADHD-200 dataset for classification. The results show the proposed model's out-performance of the state-of-the-art in both classification accuracy and generalization ability. Furthermore, we identify several brain networks that have been considered to be associated with ADHD in clinical studies.
引用
收藏
页码:362 / 369
页数:8
相关论文
共 50 条
  • [1] Multi-head Attention-Based Masked Sequence Model for Mapping Functional Brain Networks
    He, Mengshen
    Hou, Xiangyu
    Wang, Zhenwei
    Kang, Zili
    Zhang, Xin
    Qiang, Ning
    Ge, Bao
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT I, 2022, 13431 : 295 - 304
  • [2] Multi-head attention-based masked sequence model for mapping functional brain networks
    He, Mengshen
    Hou, Xiangyu
    Ge, Enjie
    Wang, Zhenwei
    Kang, Zili
    Qiang, Ning
    Zhang, Xin
    Ge, Bao
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [3] Multi-Head Attention-Based Spectrum Sensing for Radio
    Devarakonda, B. V. Ravisankar
    Nandanavam, Venkateswararao
    INTERNATIONAL JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING SYSTEMS, 2023, 14 (02) : 135 - 143
  • [4] Modeling spatio-temporal patterns of holistic functional brain networks via multi-head guided attention graph neural networks (Multi-Head GAGNNs)
    Yan, Jiadong
    Chen, Yuzhong
    Xiao, Zhenxiang
    Zhang, Shu
    Jiang, Mingxin
    Wang, Tianqi
    Zhang, Tuo
    Lv, Jinglei
    Becker, Benjamin
    Zhang, Rong
    Zhu, Dajiang
    Han, Junwei
    Yao, Dezhong
    Kendrick, Keith M.
    Liu, Tianming
    Jiang, Xi
    MEDICAL IMAGE ANALYSIS, 2022, 80
  • [5] Multi-head GAGNN: A Multi-head Guided Attention Graph Neural Network for Modeling Spatio-temporal Patterns of Holistic Brain Functional Networks
    Yan, Jiadong
    Chen, Yuzhong
    Yang, Shimin
    Zhang, Shu
    Jiang, Mingxin
    Zhao, Zhongbo
    Zhang, Tuo
    Zhao, Yu
    Becker, Benjamin
    Liu, Tianming
    Kendrick, Keith
    Jiang, Xi
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VII, 2021, 12907 : 564 - 573
  • [6] Self Multi-Head Attention-based Convolutional Neural Networks for fake news detection
    Fang, Yong
    Gao, Jian
    Huang, Cheng
    Peng, Hua
    Wu, Runpu
    PLOS ONE, 2019, 14 (09):
  • [7] Combining Multi-Head Attention and Sparse Multi-Head Attention Networks for Session-Based Recommendation
    Zhao, Zhiwei
    Wang, Xiaoye
    Xiao, Yingyuan
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [8] MSKd_Net: Multi-Head Attention-Based Swin Transformer for Kidney Diseases Classification
    Sharen, H.
    Narendra, Modigari
    Anbarasi, L. Jani
    IEEE ACCESS, 2024, 12 : 181975 - 181986
  • [9] Hierarchical Gated Convolutional Networks with Multi-Head Attention for Text Classification
    Du, Haizhou
    Qian, Jingu
    2018 5TH INTERNATIONAL CONFERENCE ON SYSTEMS AND INFORMATICS (ICSAI), 2018, : 1170 - 1175
  • [10] Hierarchical Hybrid Neural Networks With Multi-Head Attention for Document Classification
    Huang, Weihao
    Chen, Jiaojiao
    Cai, Qianhua
    Liu, Xuejie
    Zhang, Yudong
    Hu, Xiaohui
    INTERNATIONAL JOURNAL OF DATA WAREHOUSING AND MINING, 2022, 18 (01)