Global-local graph attention: unifying global and local attention for node classification

被引:0
|
作者
Lin, Keao [1 ]
Xie, Xiaozhu [1 ]
Weng, Wei [1 ,2 ]
Du, Xiaofeng [1 ]
机构
[1] Xiamen Univ Technol, Coll Comp & Informat Engn, Xiamen 361024, Peoples R China
[2] Fujian Key Lab Pattern Recognit & Image Understand, Xiamen 361024, Peoples R China
来源
关键词
CONVOLUTIONAL NETWORK; NEURAL-NETWORK;
D O I
10.1093/comjnl/bxae060
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Graph Neural Networks (GNNs) are deep learning models specifically designed for analyzing graph-structured data, capturing complex relationships and structures to improve analysis and prediction. A common task in GNNs is node classification, where each node in the graph is assigned a predefined category. The Graph Attention Network (GAT) is a popular variant of GNNs known for its ability to capture complex dependencies by assigning importance weights to nodes during information aggregation. However, the GAT's reliance on local attention mechanisms limits its effectiveness in capturing global information and long-range dependencies. To address this limitation, we propose a new attention mechanism called Global-Local Graph Attention (GLGA). Our mechanism enables the GAT to capture long-range dependencies and global graph structures while maintaining its ability to focus on local interactions. We evaluate our algorithm on three citation datasets (Cora, Citeseer, and Pubmed) using multiple metrics, demonstrating its superiority over other baseline models. The proposed GLGA mechanism has been proven to be an effective solution for improving node classification tasks.
引用
收藏
页码:2959 / 2969
页数:11
相关论文
共 50 条
  • [41] GLOBAL-LOCAL ATTENTION NETWORK FOR WEAKLY SUPERVISED CERVICAL CYTOLOGY ROI ANALYSIS
    Shi, Jun
    Wu, Kun
    Zheng, Yushan
    He, Yuxin
    Li, Jun
    Jiang, Zhiguo
    Yu, Lanlan
    2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [42] Global-local feature attention network with reranking strategy for image caption generation
    Wu J.
    Xie S.-Y.
    Shi X.-B.
    Chen Y.-W.
    Chen, Yao-wen (ywchen@stu.edu.cn), 1600, Springer Verlag (13): : 448 - 451
  • [43] A Global-Local Spectral Weight Network Based on Attention for Hyperspectral Band Selection
    Zhang, Hongqi
    Sun, Xudong
    Zhu, Yuan
    Xu, Fengqiang
    Fu, Xianping
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [44] Video representation learning for temporal action detection using global-local attention
    Tang, Yiping
    Zheng, Yang
    Wei, Chen
    Guo, Kaitai
    Hu, Haihong
    Liang, Jimin
    PATTERN RECOGNITION, 2022, 134
  • [45] RadFormer: Transformers with global-local attention for interpretable and accurate Gallbladder Cancer detection
    Basu, Soumen
    Gupta, Mayank
    Rana, Pratyaksha
    Gupta, Pankaj
    Arora, Chetan
    MEDICAL IMAGE ANALYSIS, 2023, 83
  • [46] Effects of trait positive emotions on visual attention at global-local cognitive tasks
    Araki, Yukiko
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2016, 51 : 539 - 539
  • [47] Global-Local Feature Attention Network with Reranking Strategy for Image Caption Generation
    Wu, Jie
    Xie, Siya
    Shi, Xinbao
    Chen, Yaowen
    COMPUTER VISION, PT I, 2017, 771 : 157 - 167
  • [48] Global-local feature attention network with reranking strategy for image caption generation
    吴捷
    谢斯雅
    史新宝
    陈耀文
    Optoelectronics Letters, 2017, 13 (06) : 448 - 451
  • [49] Graph Attention Spatial-Temporal Network With Collaborative Global-Local Learning for Citywide Mobile Traffic Prediction
    He, Kaiwen
    Chen, Xu
    Wu, Qiong
    Yu, Shuai
    Zhou, Zhi
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (04) : 1244 - 1256
  • [50] Attention and size in a global/local task
    Modigliani, V
    Bernstein, D
    Govorkov, S
    ACTA PSYCHOLOGICA, 2001, 108 (01) : 35 - 51