Global-local graph attention: unifying global and local attention for node classification

被引:0
|
作者
Lin, Keao [1 ]
Xie, Xiaozhu [1 ]
Weng, Wei [1 ,2 ]
Du, Xiaofeng [1 ]
机构
[1] Xiamen Univ Technol, Coll Comp & Informat Engn, Xiamen 361024, Peoples R China
[2] Fujian Key Lab Pattern Recognit & Image Understand, Xiamen 361024, Peoples R China
来源
关键词
CONVOLUTIONAL NETWORK; NEURAL-NETWORK;
D O I
10.1093/comjnl/bxae060
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Graph Neural Networks (GNNs) are deep learning models specifically designed for analyzing graph-structured data, capturing complex relationships and structures to improve analysis and prediction. A common task in GNNs is node classification, where each node in the graph is assigned a predefined category. The Graph Attention Network (GAT) is a popular variant of GNNs known for its ability to capture complex dependencies by assigning importance weights to nodes during information aggregation. However, the GAT's reliance on local attention mechanisms limits its effectiveness in capturing global information and long-range dependencies. To address this limitation, we propose a new attention mechanism called Global-Local Graph Attention (GLGA). Our mechanism enables the GAT to capture long-range dependencies and global graph structures while maintaining its ability to focus on local interactions. We evaluate our algorithm on three citation datasets (Cora, Citeseer, and Pubmed) using multiple metrics, demonstrating its superiority over other baseline models. The proposed GLGA mechanism has been proven to be an effective solution for improving node classification tasks.
引用
下载
收藏
页码:2959 / 2969
页数:11
相关论文
共 50 条
  • [1] Global-Local Channel Attention for Hyperspectral Image Classification
    Yan, Peilin
    Qin, Haolin
    Wang, Jihui
    Xu, Tingfa
    Song, Liqiang
    Li, Hui
    Li, Jianan
    INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND ENERGY TECHNOLOGIES (ICECET 2021), 2021, : 1633 - 1638
  • [2] Global-Local Mutual Attention Model for Text Classification
    Ma, Qianli
    Yu, Liuhong
    Tian, Shuai
    Chen, Enhuan
    Ng, Wing W. Y.
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2019, 27 (12) : 2127 - 2139
  • [3] Global-Local Attention Network for Aerial Scene Classification
    Guo, Yiyou
    Ji, Jinsheng
    Lu, Xiankai
    Huo, Hong
    Fang, Tao
    Li, Deren
    IEEE ACCESS, 2019, 7 : 67200 - 67212
  • [4] Global-local attention for emotion recognition
    Le, Nhat
    Nguyen, Khanh
    Nguyen, Anh
    Le, Bac
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (24): : 21625 - 21639
  • [5] Image Caption with Global-Local Attention
    Li, Linghui
    Tang, Sheng
    Deng, Lixi
    Zhang, Yongdong
    Tian, Qi
    THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 4133 - 4139
  • [6] Global-local attention for emotion recognition
    Nhat Le
    Khanh Nguyen
    Anh Nguyen
    Bac Le
    Neural Computing and Applications, 2022, 34 : 21625 - 21639
  • [7] Global-local graph neural networks for node-classification
    Eliasof, Moshe
    Treister, Eran
    Pattern Recognition Letters, 184 : 103 - 110
  • [8] Global-local graph neural networks for node-classification
    Eliasof, Moshe
    Treister, Eran
    PATTERN RECOGNITION LETTERS, 2024, 184 : 103 - 110
  • [9] Global-Local Graph Neural Networks for Node-Classification
    Eliasof, Moshe
    Treister, Eran
    arXiv,
  • [10] Airborne LiDAR point cloud classification with global-local graph attention convolution neural network
    Wen, Congcong
    Li, Xiang
    Yao, Xiaojing
    Peng, Ling
    Chi, Tianhe
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 173 : 181 - 194