A unified structure learning framework for graph attention networks

被引:8
|
作者
Yuan, Jinliang [1 ,2 ]
Cao, Meng [1 ,2 ]
Cheng, Hao [1 ,2 ]
Yu, Hualei [1 ,2 ]
Xie, Junyuan [1 ,2 ]
Wang, Chongjun [1 ,2 ]
机构
[1] Nanjing Univ, Natl Key Lab Novel Software Technol, Nanjing, Peoples R China
[2] Nanjing Univ, Dept Comp Sci & Technol, Nanjing 210046, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph attention networks; Graph structure learning; Semi-supervised classification;
D O I
10.1016/j.neucom.2022.01.064
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have achieved state-of-the-art performance in many fields and attracted a lot of attention in the communit. Most Graph Neural Networks can be merely used when graph-structured data is available. However, many graph structures have noise, or data itself has no graph structures, so learning the dynamic and adaptive graph structures is necessary. In this paper, we propose a unified structure learning framework for Graph Attention Networks. Specifically, we first design a strategy to learn the graph structures. Then we develop a novel attention mechanism based on structure context information of graph and node representations. Further, we devise Structure Learning Graph Attention Networks (SLGAT) and Structure Learning Attention-based Graph Neural Networks (SLAGNN) by using the new attention mechanism on the new graph. Finally, we demonstrate that our approaches outperform competing methods on six standard datasets for the semi-supervised node classification task. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:194 / 204
页数:11
相关论文
共 50 条
  • [31] Dependency Structure -Enhanced Graph Attention Networks for Event Detection
    Wan, Qizhi
    Wan, Changxuan
    Xiao, Keli
    Lu, Kun
    Li, Chenliang
    Liu, Xiping
    Liu, Dexi
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 17, 2024, : 19098 - 19106
  • [32] Precise Learning of Source Code Contextual Semantics via Hierarchical Dependence Structure and Graph Attention Networks
    Zhao, Zhehao
    Yang, Bo
    Li, Ge
    Liu, Huai
    Jin, Zhi
    [J]. JOURNAL OF SYSTEMS AND SOFTWARE, 2022, 184
  • [33] Precise Learning of Source Code Contextual Semantics via Hierarchical Dependence Structure and Graph Attention Networks
    Zhao, Zhehao
    Yang, Bo
    Li, Ge
    Liu, Huai
    Jin, Zhi
    [J]. JOURNAL OF SYSTEMS AND SOFTWARE, 2022, 184
  • [34] A dual Laplacian framework with effective graph learning for unified fair spectral clustering
    Zhang, Xiang
    Wang, Qiao
    [J]. NEUROCOMPUTING, 2024, 601
  • [35] Unified structure-aware feature learning for Graph Convolutional Network
    Huang, Sujia
    Xiao, Shunxin
    Chen, Yuhong
    Yang, Jinbin
    Shi, Zhibin
    Tan, Yanchao
    Wang, Shiping
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 254
  • [36] T-GAN: A deep learning framework for prediction of temporal complex networks with adaptive graph convolution and attention mechanism
    Huang, Ru
    Ma, Lei
    He, Jianhua
    Chu, Xiaoli
    [J]. DISPLAYS, 2021, 68
  • [37] Graph Networks as a Universal Machine Learning Framework for Molecules and Crystals
    Chen, Chi
    Ye, Weike
    Zuo, Yunxing
    Zheng, Chen
    Ong, Shyue Ping
    [J]. CHEMISTRY OF MATERIALS, 2019, 31 (09) : 3564 - 3572
  • [38] Contrastive Learning with Heterogeneous Graph Attention Networks on Short Text Classification
    Sun, Zhongtian
    Harit, Anoushka
    Cristea, Alexandra, I
    Yu, Jialin
    Shi, Lei
    Al Moubayed, Noura
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [39] Graph Neural Networks With Triple Attention for Few-Shot Learning
    Cheng, Hao
    Zhou, Joey Tianyi
    Tay, Wee Peng
    Wen, Bihan
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8225 - 8239
  • [40] VGN: Value Decomposition With Graph Attention Networks for Multiagent Reinforcement Learning
    Wei, Qinglai
    Li, Yugu
    Zhang, Jie
    Wang, Fei-Yue
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (01) : 182 - 195