EATSA-GNN: Edge-Aware and Two-Stage attention for enhancing graph neural networks based on teacher-student mechanisms for graph node classification

被引:1
|
作者
Fofanah, Abdul Joseph [1 ]
Leigh, Alpha Omar [2 ]
机构
[1] Griffith Univ, Sch Informat & Commun Technol, 170 Kessels Rd, Brisbane, Qld 4111, Australia
[2] Limkokwing Univ, Fac Informat Commun & Technol, Dept Software Engn Multimedia, Freetown, Sierra Leone
关键词
Edge-aware; Graph neural network; Two-stage attention; Node classification; Feature learning; teacher-student attention;
D O I
10.1016/j.neucom.2024.128686
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have fundamentally transformed the way in which we handle and examine data originating from non-Euclidean domains. Traditional approaches to imbalanced node classification problems, such as resampling, are ineffective because they do not take into account the underlying network structure of the edges. The limited methods available to capture the intricate connections encoded in the edges of a graph pose a significant challenge for GNNs in accurately classifying nodes. We propose EATSA-GNN model to enhance GNN node classification using Edge-Aware and Two-Stage Attention Mechanisms (EATSAGNN). EATSA-GNN focuses its initial attention on edge traits, enabling the model to differentiate the variable significance of different connections between nodes, referred to as Teacher-Attention (TA). In the second step, attention is directed towards the nodes, incorporating the knowledge obtained from the edge-level analysis referred to as Student-Attention (SA). Employing this dual strategy ensures a more sophisticated comprehension of the graph's framework, resulting in improved classification precision. The EATSA-GNN model's contribution to the field of GNNs lies in its ability to utilise both node and edge information in a cohesive manner, resulting in more accurate node classifications. This highlights the essence of the model and its potential. Comparing the EATSA-GNN model to state-of-the-arts methods with two different variants shows how strong it is and how well it can handle complex problems for node classification. This solidifies its position as one of leading solution in the field of GNN architectures and their use in complex networked systems. The exceptional performance of EATSA-GNN not only showcases its effectiveness but also underscores its potential to greatly influence the future advancement of the GNN framework. Implementation of the proposed EATSA-GNN can be accessed here https://github.com/afofanah/EATSA-GNN.
引用
收藏
页数:16
相关论文
共 11 条
  • [1] Two-Stage Training of Graph Neural Networks for Graph Classification
    Do, Manh Tuan
    Park, Noseong
    Shin, Kijung
    NEURAL PROCESSING LETTERS, 2023, 55 (03) : 2799 - 2823
  • [2] Two-Stage Training of Graph Neural Networks for Graph Classification
    Manh Tuan Do
    Noseong Park
    Kijung Shin
    Neural Processing Letters, 2023, 55 : 2799 - 2823
  • [3] Global Attention-Based Graph Neural Networks for Node Classification
    Chen, Jiusheng
    Fang, Chengyuan
    Zhang, Xiaoyu
    NEURAL PROCESSING LETTERS, 2023, 55 (04) : 4127 - 4150
  • [4] Global Attention-Based Graph Neural Networks for Node Classification
    Jiusheng Chen
    Chengyuan Fang
    Xiaoyu Zhang
    Neural Processing Letters, 2023, 55 : 4127 - 4150
  • [5] T2-GNN: Graph Neural Networks for Graphs with Incomplete Features and Structure via Teacher-Student Distillation
    Huo, Cuiying
    Jin, Di
    Li, Yawen
    He, Dongxiao
    Yang, Yu-Bin
    Wu, Lingfei
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 4, 2023, : 4339 - 4346
  • [6] Two-Stage Point Cloud Registration Framework Based on Graph Neural Network and Attention
    Zhang, Xiaoqian
    Li, Junlin
    Zhang, Wei
    Xu, Yansong
    Li, Feng
    ELECTRONICS, 2024, 13 (03)
  • [7] A two-stage spatial prediction modeling approach based on graph neural networks and neural processes
    Bao, Li-Li
    Zhang, Chun-Xia
    Zhang, Jiang-She
    Guo, Rui
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 258
  • [8] Two-stage graph attention networks and Q-learning based maintenance tasks scheduling
    Gao, Xiaoyong
    Peng, Diao
    Yang, Yixu
    Huang, Fuyu
    Yuan, Yu
    Tan, Chaodong
    Li, Feifei
    APPLIED INTELLIGENCE, 2025, 55 (05)
  • [9] HAM-GNN: A hierarchical attention-based multi-dimensional edge graph neural network for dialogue act classification
    Fu, Changzeng
    Su, Yikai
    Su, Kaifeng
    Liu, Yinghao
    Shi, Jiaqi
    Wu, Bowen
    Liu, Chaoran
    Ishi, Carlos Toshinori
    Ishiguro, Hiroshi
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 261
  • [10] A two-stage attention aware method for train bearing shed oil inspection based on convolutional neural networks
    Fu, Xiao
    Li, Kenli
    Liu, Jing
    Li, Keqin
    Zeng, Zeng
    Chen, Cen
    NEUROCOMPUTING, 2020, 380 : 212 - 224