Global-local graph attention: unifying global and local attention for node classification

被引:0
|
作者
Lin, Keao [1 ]
Xie, Xiaozhu [1 ]
Weng, Wei [1 ,2 ]
Du, Xiaofeng [1 ]
机构
[1] Xiamen Univ Technol, Coll Comp & Informat Engn, Xiamen 361024, Peoples R China
[2] Fujian Key Lab Pattern Recognit & Image Understand, Xiamen 361024, Peoples R China
来源
关键词
CONVOLUTIONAL NETWORK; NEURAL-NETWORK;
D O I
10.1093/comjnl/bxae060
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Graph Neural Networks (GNNs) are deep learning models specifically designed for analyzing graph-structured data, capturing complex relationships and structures to improve analysis and prediction. A common task in GNNs is node classification, where each node in the graph is assigned a predefined category. The Graph Attention Network (GAT) is a popular variant of GNNs known for its ability to capture complex dependencies by assigning importance weights to nodes during information aggregation. However, the GAT's reliance on local attention mechanisms limits its effectiveness in capturing global information and long-range dependencies. To address this limitation, we propose a new attention mechanism called Global-Local Graph Attention (GLGA). Our mechanism enables the GAT to capture long-range dependencies and global graph structures while maintaining its ability to focus on local interactions. We evaluate our algorithm on three citation datasets (Cora, Citeseer, and Pubmed) using multiple metrics, demonstrating its superiority over other baseline models. The proposed GLGA mechanism has been proven to be an effective solution for improving node classification tasks.
引用
收藏
页码:2959 / 2969
页数:11
相关论文
共 50 条
  • [21] A Global-Local Graph Attention Network for Deformable Linear Objects Dynamic Interaction with Environment
    Chu, Jian
    Zhang, Wenkang
    Ouyang, Bo
    Tian, Kunmiao
    Zhang, Shuai
    Zhai, Kai
    IEEE Robotics and Automation Letters, 2024, 9 (12) : 11106 - 11113
  • [22] A Scene Classification Model Based on Global-Local Features and Attention in Lie Group Space
    Xu, Chengjun
    Shu, Jingqian
    Wang, Zhenghan
    Wang, Jialin
    REMOTE SENSING, 2024, 16 (13)
  • [23] Global-Local Attention Mechanism Based Small Object Detection
    Liu, Bao
    Huang, Jinlei
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 1439 - 1443
  • [24] Auditory global-local processing: Effects of attention and musical experience
    Ouimet, Tia
    Foster, Nicholas E. V.
    Hyde, Krista L.
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2012, 132 (04): : 2536 - 2544
  • [25] Global-Local Attention Network for Semantic Segmentation in Aerial Images
    Li, Minglong
    Shan, Lianlei
    Li, Xiaobin
    Bai, Yang
    Zhou, Dengji
    Wang, Weiqiang
    Lv, Ke
    Luo, Bin
    Chen, Si-Bao
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 5704 - 5711
  • [26] A Dual Global-Local Attention Network for Hyperspectral Band Selection
    He, Ke
    Sun, Weiwei
    Yang, Gang
    Meng, Xiangchao
    Ren, Kai
    Peng, Jiangtao
    Du, Qian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [27] A GLOBAL-LOCAL ATTENTION FRAMEWORK FOR WEAKLY LABELLED AUDIO TAGGING
    Wang, Helin
    Zou, Yuexian
    Wang, Wenwu
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 351 - 355
  • [28] ROTATION-EQUIVARIANT GRAPH CONVOLUTIONAL NETWORKS FOR SPHERICAL DATA VIA GLOBAL-LOCAL ATTENTION
    Xu, Jiayi
    Yang, Qin
    Li, Chenglin
    Zou, Junni
    Xiong, Hongkai
    Pan, Xinlong
    Wang, Haipeng
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 2501 - 2505
  • [29] Improving Sentence Representations with Local and Global Attention for Classification
    Liu, Zesheng
    Bai, Xu
    Cai, Tian
    Chen, Chanjuan
    Zhang, Wang
    Jiang, Lei
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [30] Image captioning based on global-local feature and adaptive-attention
    Zhao X.-H.
    Yin L.-F.
    Zhao C.-L.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2020, 54 (01): : 126 - 134