Adaptive Propagation Graph Convolutional Networks Based on Attention Mechanism

被引:3
|
作者
Zhang, Chenfang [1 ]
Gan, Yong [2 ]
Yang, Ruisen [1 ]
机构
[1] Zhengzhou Univ Light Ind, Sch Comp Commun & Engn, Zhengzhou 450002, Peoples R China
[2] Zhengzhou Inst Engn & Technol, Sch Comp Commun & Engn, Zhengzhou 450002, Peoples R China
关键词
graph neural networks; convolutional network; attention mechanism; adaptive propagation;
D O I
10.3390/info13100471
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The main steps in a graph neural network are message propagation and aggregation between nodes. Message propagation allows messages from distant nodes in the graph to be transmitted to the central node, while feature aggregation allows the central node to obtain messages regarding its neighbors and update itself, so that it can express deep-layer features. Because the graph structure data have no local translation invariance, the number of neighbors of each central node is different, and there is no order, there are two difficulties: (1) how to design a reliable message propagation method to better express all network topologies; (2) how to design a feature aggregation function so that it can weigh local features and global features. In this paper, a new adaptive propagation graph convolutional network model based on the attention mechanism (APAT-GCN) is proposed, which enables GNNs to adaptively complete the process of message propagation and feature aggregation, according to the neighbors of the central node, and set the influence degree of local and global messages on the aggregation of the central node. Compared with other classical models, this method is superior to the baseline model and can improve the accuracy of node- and graph-level classification tasks in downstream tasks.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Adaptive Graph Convolutional Networks with Attention Mechanism for Relation Extraction
    Li, Zhixin
    Sun, Yaru
    Tang, Suqin
    Zhang, Canlong
    Ma, Huifang
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [2] Powerful Graph Convolutional Networks with Adaptive Propagation Mechanism for Homophily and Heterophily
    Wang, Tao
    Jin, Di
    Wang, Rui
    He, Dongxiao
    Huang, Yuxiao
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 4210 - 4218
  • [3] Graph convolutional networks with the self-attention mechanism for adaptive influence maximization in social networks
    Tang, Jianxin
    Song, Shihui
    Du, Qian
    Yao, Yabing
    Qu, Jitao
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2024,
  • [4] Multi-view graph convolutional networks with attention mechanism
    Yao, Kaixuan
    Liang, Jiye
    Liang, Jianqing
    Li, Ming
    Cao, Feilong
    [J]. ARTIFICIAL INTELLIGENCE, 2022, 307
  • [5] Adaptive Attention Memory Graph Convolutional Networks for Skeleton-Based Action Recognition
    Liu, Di
    Xu, Hui
    Wang, Jianzhong
    Lu, Yinghua
    Kong, Jun
    Qi, Miao
    [J]. SENSORS, 2021, 21 (20)
  • [6] On the Global Self-attention Mechanism for Graph Convolutional Networks
    Wang, Chen
    Deng, Chengyuan
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 8531 - 8538
  • [7] Prediction of lncRNA and disease associations based on residual graph convolutional networks with attention mechanism
    Wang, Shengchang
    Qiao, Jiaqing
    Feng, Shou
    [J]. SCIENTIFIC REPORTS, 2024, 14 (01)
  • [8] Graph Convolutional Networks Based on Relational Attention Mechanism for Autism Spectrum Disorders Diagnosis
    Mao, Junbin
    Sheng, Yu
    Lan, Wei
    Tian, Xu
    Liu, Jin
    Pan, Yi
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2022), PT I, 2022, 13455 : 341 - 348
  • [9] Information Propagation Prediction Based on Spatial-Temporal Attention and Heterogeneous Graph Convolutional Networks
    Liu, Xiaoyang
    Miao, Chenxiang
    Fiumara, Giacomo
    De Meo, Pasquale
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (01) : 945 - 958
  • [10] Graph Convolutional Networks with Motif-based Attention
    Lee, John Boaz
    Rossi, Ryan A.
    Kong, Xiangnan
    Kim, Sungchul
    Koh, Eunyee
    Rao, Anup
    [J]. PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19), 2019, : 499 - 508