Knowledge Distillation Guided Interpretable Brain Subgraph Neural Networks for Brain Disorder Exploration

被引:5
|
作者
Luo, Xuexiong [1 ]
Wu, Jia [1 ]
Yang, Jian [1 ]
Chen, Hongyang [2 ]
Li, Zhao [2 ]
Peng, Hao [3 ]
Zhou, Chuan [4 ]
机构
[1] Macquarie Univ, Sch Comp, Sydney, NSW 2109, Australia
[2] Zhejiang Lab, Res Ctr Graph Comp, Hangzhou 311121, Peoples R China
[3] Beihang Univ, Sch Cyber Sci & Technol, Beijing 100083, Peoples R China
[4] Chinese Acad Sci, Acad Math & Syst Sci, Beijing 100093, Peoples R China
基金
澳大利亚研究理事会;
关键词
Brain modeling; Neuroimaging; Functional magnetic resonance imaging; Data models; Analytical models; Biological neural networks; Graph neural networks; Brain disorder analysis; brain graph mining; functional magnetic resonance imaging (fMRI) data; graph neural networks (GNNs); FUNCTIONAL CONNECTIVITY; FMRI;
D O I
10.1109/TNNLS.2023.3341802
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The human brain is a highly complex neurological system that has been the subject of continuous exploration by scientists. With the help of modern neuroimaging techniques, there has been significant progress made in brain disorder analysis. There is an increasing interest about utilizing artificial intelligence techniques to improve the efficiency of disorder diagnosis in recent years. However, these methods rely only on neuroimaging data for disorder diagnosis and do not explore the pathogenic mechanism behind the disorder or provide an interpretable result toward the diagnosis decision. Furthermore, the scarcity of medical data limits the performance of existing methods. As the hot application of graph neural networks (GNNs) in molecular graphs and drug discovery due to its strong graph-structured data learning ability, whether GNNs can also play a huge role in the field of brain disorder analysis. Thus, in this work, we innovatively model brain neuroimaging data into graph-structured data and propose knowledge distillation (KD) guided brain subgraph neural networks to extract discriminative subgraphs between patient and healthy brain graphs to explain which brain regions and abnormal functional connectivities cause the disorder. Specifically, we introduce the KD technique to transfer the knowledge of pretrained teacher model to guide brain subgraph neural networks training and alleviate the problem of insufficient training data. And these discriminative subgraphs are conducive to learn better brain graph-level representations for disorder prediction. We conduct abundant experiments on two functional magnetic resonance imaging datasets, i.e., Parkinson's disease (PD) and attention-deficit/hyperactivity disorder (ADHD), and experimental results well demonstrate the superiority of our method over other brain graph analysis methods for disorder prediction accuracy. The interpretable experimental results given by our method are consistent with corresponding medical research, which is encouraging to provide a potential for deeper brain disorder study.
引用
收藏
页码:3559 / 3572
页数:14
相关论文
共 50 条
  • [21] Online adversarial knowledge distillation for graph neural networks
    Wang, Can
    Wang, Zhe
    Chen, Defang
    Zhou, Sheng
    Feng, Yan
    Chen, Chun
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 237
  • [22] Improving the Interpretability of Deep Neural Networks with Knowledge Distillation
    Liu, Xuan
    Wang, Xiaoguang
    Matwin, Stan
    2018 18TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW), 2018, : 905 - 912
  • [23] PDD: Pruning Neural Networks During Knowledge Distillation
    Dan, Xi
    Yang, Wenjie
    Zhang, Fuyan
    Zhou, Yihang
    Yu, Zhuojun
    Qiu, Zhen
    Zhao, Boyuan
    Dong, Zeyu
    Huang, Libo
    Yang, Chuanguang
    COGNITIVE COMPUTATION, 2024, 16 (06) : 3457 - 3467
  • [24] Distilling Spikes: Knowledge Distillation in Spiking Neural Networks
    Kushawaha, Ravi Kumar
    Kumar, Saurabh
    Banerjee, Biplab
    Velmurugan, Rajbabu
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 4536 - 4543
  • [25] Learnable Subdivision Graph Neural Network for Functional Brain Network Analysis and Interpretable Cognitive Disorder Diagnosis
    Chen, Dongdong
    Liu, Mengjun
    Shen, Zhenrong
    Zhao, Xiangyu
    Wang, Qian
    Zhang, Lichi
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT VIII, 2023, 14227 : 56 - 66
  • [26] Deep reinforcement learning guided graph neural networks for brain network analysis
    Zhao, Xusheng
    Wu, Jia
    Peng, Hao
    Beheshti, Amin
    Monaghan, Jessica J. M.
    McAlpine, David
    Hernandez-Perez, Heivet
    Dras, Mark
    Dai, Qiong
    Li, Yangyang
    Yu, Philip S.
    He, Lifang
    NEURAL NETWORKS, 2022, 154 : 56 - 67
  • [27] Brain, neural networks, and computation
    Hopfield, JJ
    REVIEWS OF MODERN PHYSICS, 1999, 71 (02) : S431 - S437
  • [28] Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillation
    Xu, Qi
    Li, Yaxin
    Shen, Jiangrong
    Liu, Jian K.
    Tang, Huajin
    Pan, Gang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 7886 - 7895
  • [29] Neural networks: Reorganizing the brain
    Aulakh M.
    Nature Reviews Neuroscience, 2009, 10 (4) : 248+249 - 249
  • [30] Neural networks in the study of the brain
    Reichgelt, H
    MOLECULAR AND CHEMICAL NEUROPATHOLOGY, 1996, 28 (1-3) : 231 - 235