Topological enhanced graph neural networks for semi-supervised node classification

被引:2
|
作者
Song, Rui [1 ]
Giunchiglia, Fausto [1 ,2 ]
Zhao, Ke [3 ]
Xu, Hao [4 ]
机构
[1] Jilin Univ, Sch Articial Intelligence, Changchun 130012, Peoples R China
[2] Univ Trento, Dept Informat Engn & Comp Sci, Trento, Italy
[3] Jilin Univ, Coll Software, Changchun 130012, Peoples R China
[4] Jilin Univ, Coll Comp Sci & Technol, Key Lab Symbol Comp & Knowledge Engn, Minist Educ, Changchun 130012, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural network; Graph augmentation; Topology features; Regularization; Over-smoothing;
D O I
10.1007/s10489-023-04739-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The complexity and non-Euclidean structure of graph data hinders the development of data augmentation methods similar to those in computer vision. In this paper, we propose a feature augmentation method for graph nodes based on topological regularization, in which topological structure information is introduced into an end-to-end model to promote better learning of node representation. Specifically, we first obtain topology embedding of nodes through Node2vec, an unsupervised graph feature learning method based on random walk. Then, the topological embedding as additional features and the original node features are input into a Symmetric Graph Neural Network framework for propagation, and two different high-order neighborhood representations of the nodes are obtained. On this basis, we propose a regularization technique to bridge the differences between the two different node representations, eliminate the adverse effects caused by the topological features of graphs directly used, and greatly improve the performance. Our framework can be effectively combined with other graph neural network models, and can effectively prevent over-smoothing of deep graph network. Experimental results on five datasets confirm the effectiveness of our method.
引用
收藏
页码:23538 / 23552
页数:15
相关论文
共 50 条
  • [11] Enhancing Graph Neural Networks via auxiliary training for semi-supervised node classification
    Wu, Yao
    Song, Yu
    Huang, Hong
    Ye, Fanghua
    Xie, Xing
    Jin, Hai
    KNOWLEDGE-BASED SYSTEMS, 2021, 220
  • [12] Label-Consistency based Graph Neural Networks for Semi-supervised Node Classification
    Xu, Bingbing
    Huang, Junjie
    Hou, Liang
    Shen, Huawei
    Gao, Jinhua
    Cheng, Xueqi
    PROCEEDINGS OF THE 43RD INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '20), 2020, : 1897 - 1900
  • [13] Bayesian Graph Convolutional Neural Networks for Semi-Supervised Classification
    Zhang, Yingxue
    Pal, Soumyasundar
    Coates, Mark
    Ustebay, Deniz
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 5829 - 5836
  • [14] Semi-supervised node classification via adaptive graph smoothing networks
    Zheng, Ruigang
    Chen, Weifu
    Feng, Guocan
    PATTERN RECOGNITION, 2022, 124
  • [15] Semi-supervised node classification via graph learning convolutional neural network
    Kangjie Li
    Wenjing Ye
    Applied Intelligence, 2022, 52 : 12724 - 12736
  • [16] A Deep Graph Wavelet Convolutional Neural Network for Semi-supervised Node Classification
    Wang, Jingyi
    Deng, Zhidong
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [17] Semi-supervised node classification via graph learning convolutional neural network
    Li, Kangjie
    Ye, Wenjing
    APPLIED INTELLIGENCE, 2022, 52 (11) : 12724 - 12736
  • [18] GRNN: Graph-Retraining Neural Network for Semi-Supervised Node Classification
    Li, Jianhe
    Fan, Suohai
    ALGORITHMS, 2023, 16 (03)
  • [19] Semi-Supervised Node Classification on Graphs: Markov Random Fields vs. Graph Neural Networks
    Wang, Binghui
    Jia, Jinyuan
    Gong, Neil Zhenqiang
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10093 - 10101
  • [20] Self-Paced Co-Training of Graph Neural Networks for Semi-Supervised Node Classification
    Gong, Maoguo
    Zhou, Hui
    Qin, A. K.
    Liu, Wenfeng
    Zhao, Zhongying
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (11) : 9234 - 9247