Modeling Functional Brain Networks with Multi-Head Attention-based Region-Enhancement for ADHD Classification

被引:2
|
作者
Cao, Chunhong [1 ]
Fu, Huawei [1 ]
Li, Gai [1 ]
Wang, Mengyang [1 ]
Gao, Xieping [1 ]
机构
[1] Xiangtan Univ, Xiangtan, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
ADHD diagnosis; functional brain networks; multi-head attention mechanism; region-enhancement; FMRI; IDENTIFICATION; CHILDREN;
D O I
10.1145/3591106.3592240
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Increasing attention has been paid to attention-deficit hyperactivity disorder (ADHD)-assisted diagnosis using functional brain networks (FBNs) since FBNs-based ADHD diagnosis can not only extract the functional connectivities from FBNs as potential biomarkers for brain disease classification, but also identify the focal regions of disease. Therefore, modeling FBNs has become a key topic for ADHD diagnosis via resting state functional magnetic resonance imaging (rfMRI). However, the dominant models either ignore the strong regional correlation between adjacent time series or fail to capture the long-distance dependency (LDD) in imaging series. To address the issues, we propose a multi-head attention-based region-enhancement model (MAREM) for ADHD classification. Firstly, a multi-head attention mechanism with region-enhancement is designed to represent the FBNs, where region-enhancement module are designed to process strong regional correlation between adjacent time series. Secondly, multi-head attention is used to map the region information of each time point into different subspaces for establishing global dependencies in imaging series. Thirdly, the proposed model is applied to the ADHD-200 dataset for classification. The results show the proposed model's out-performance of the state-of-the-art in both classification accuracy and generalization ability. Furthermore, we identify several brain networks that have been considered to be associated with ADHD in clinical studies.
引用
收藏
页码:362 / 369
页数:8
相关论文
共 50 条
  • [21] Internal defects inspection of arc magnets using multi-head attention-based CNN
    Li, Qiang
    Huang, Qinyuan
    Yang, Tian
    Zhou, Ying
    Yang, Kun
    Song, Hong
    MEASUREMENT, 2022, 202
  • [22] Multi-head attention-based model for reconstructing continuous missing time series data
    Wu, Huafeng
    Zhang, Yuxuan
    Liang, Linian
    Mei, Xiaojun
    Han, Dezhi
    Han, Bing
    Weng, Tien-Hsiung
    Li, Kuan-Ching
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (18): : 20684 - 20711
  • [23] Multiscaled Multi-Head Attention-Based Video Transformer Network for Hand Gesture Recognition
    Garg, Mallika
    Ghosh, Debashis
    Pradhan, Pyari Mohan
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 80 - 84
  • [24] Multi-head attention-based model for reconstructing continuous missing time series data
    Huafeng Wu
    Yuxuan Zhang
    Linian Liang
    Xiaojun Mei
    Dezhi Han
    Bing Han
    Tien-Hsiung Weng
    Kuan-Ching Li
    The Journal of Supercomputing, 2023, 79 : 20684 - 20711
  • [25] Accurate Arrhythmia Classification with Multi-Branch, Multi-Head Attention Temporal Convolutional Networks
    Bi, Suzhao
    Lu, Rongjian
    Xu, Qiang
    Zhang, Peiwen
    SENSORS, 2024, 24 (24)
  • [26] Enhancing Recommendation Capabilities Using Multi-Head Attention-Based Federated Knowledge Distillation
    Wu, Aming
    Kwon, Young-Woo
    IEEE ACCESS, 2023, 11 : 45850 - 45861
  • [27] Duplicate Question Detection based on Neural Networks and Multi-head Attention
    Zhang, Heng
    Chen, Liangyu
    PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP), 2019, : 13 - 18
  • [28] Speech enhancement method based on the multi-head self-attention mechanism
    Chang X.
    Zhang Y.
    Yang L.
    Kou J.
    Wang X.
    Xu D.
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2020, 47 (01): : 104 - 110
  • [29] Arrhythmia classification algorithm based on multi-head self-attention mechanism
    Wang, Yue
    Yang, Guanci
    Li, Shaobo
    Li, Yang
    He, Ling
    Liu, Dan
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 79
  • [30] Fault location method for distribution networks based on multi-head graph attention networks
    Liang, Lingyu
    Zhang, Huanming
    Cao, Shang
    Zhao, Xiangyu
    Li, Hanju
    Chen, Zhiwei
    FRONTIERS IN ENERGY RESEARCH, 2024, 12