Robust Hypergraph-Augmented Graph Contrastive Learning for Graph Self-Supervised Learning

被引:0
|
作者
Wang, Zeming [1 ]
Li, Xiaoyang [2 ]
Wang, Rui [3 ]
Zheng, Changwen [4 ]
机构
[1] Chinese Acad Sci, Univ Chinese Acad Sci, Inst Software, Beijing, Peoples R China
[2] Nankai Univ, Tianjin, Peoples R China
[3] Chinese Acad Sci, Inst Software, Sci & Technol Integrated Informat Syst Lab, Beijing, Peoples R China
[4] Chinese Acad Sci, Inst Software, Beijing, Peoples R China
关键词
graph contrastive learning; self-supervised; hypergraph; multi-view;
D O I
10.1145/3590003.3590053
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph contrastive learning has emerged as a promising method for self-supervised graph representation learning. The traditional framework conventionally imposes two graph views generated by leveraging graph data augmentations. Such an approach focuses on leading the model to learn discriminative information from graph local structures, which brings up an intrinsic issue that the model partially fails to obtain sufficient discriminative information contained by the graph global information. To this end, we propose a hypergraph-augmented view to empower the self-supervised graph representation learning model to better capture the global information from nodes and corresponding edges. In the further exploration of the graph contrastive learning, we discover a principal challenge undermining conventional contrastive methods: the false negative sample problem, i.e., specific negative samples actually belong to the same category of the anchor sample. To address this issue, we take the neighbors of nodes into consideration and propose the robust graph contrastive learning. In practice, we empirically observe that the proposed hypergraph-augmented view can further enhance the robustness of graph contrastive learning by adopting our framework. Based on these improvements, we propose a novel method called Robust Hypergraph-Augmented Graph Contrastive Learning (RH-GCL). We conduct various experiments in the settings of both transductive and inductive node classification. The results demonstrate that our method achieves the state-of-the-art (SOTA) performance on different datasets. Specifically, the accuracy of node classification on Cora dataset is 84.4%, which is 1.1% higher than that of GRACE. We also perform the ablation study to verify the effectiveness of each part of our proposed method.
引用
收藏
页码:287 / 293
页数:7
相关论文
共 50 条
  • [31] Self-supervised contrastive learning for heterogeneous graph based on multi-pretext tasks
    Ma, Shuai
    Liu, Jian-wei
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (14): : 10275 - 10296
  • [32] Wiener Graph Deconvolutional Network Improves Graph Self-Supervised Learning
    Cheng, Jiashun
    Li, Man
    Li, Jia
    Tsung, Fugee
    [J]. THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 6, 2023, : 7131 - 7139
  • [33] Contrastive Learning for Supervised Graph Matching
    Ratnayaka, Gathika
    Wang, Qing
    Li, Yang
    [J]. UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2023, 216 : 1718 - 1729
  • [34] Self-supervised Consensus Representation Learning for Attributed Graph
    Liu, Changshu
    Wen, Liangjian
    Kang, Zhao
    Luo, Guangchun
    Tian, Ling
    [J]. PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2654 - 2662
  • [35] Self-supervised graph representations with generative adversarial learning
    Sun, Xuecheng
    Wang, Zonghui
    Lu, Zheming
    Lu, Ziqian
    [J]. NEUROCOMPUTING, 2024, 592
  • [36] Graph Multihead Attention Pooling with Self-Supervised Learning
    Wang, Yu
    Hu, Liang
    Wu, Yang
    Gao, Wanfu
    [J]. ENTROPY, 2022, 24 (12)
  • [37] Self-supervised Learning and Graph Classification under Heterophily
    Ding, Yilin
    Liu, Zhen
    Hao, Hao
    [J]. PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 3849 - 3853
  • [38] Graph Diffusive Self-Supervised Learning for Social Recommendation
    Li, Jiuqiang
    Wang, Hongjun
    [J]. PROCEEDINGS OF THE 47TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2024, 2024, : 2442 - 2446
  • [39] Simple Self-supervised Multiplex Graph Representation Learning
    Mo, Yujie
    Chen, Yuhuan
    Peng, Liang
    Shi, Xiaoshuang
    Zhu, Xiaofeng
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3301 - 3309
  • [40] Self-supervised role learning for graph neural networks
    Aravind Sankar
    Junting Wang
    Adit Krishnan
    Hari Sundaram
    [J]. Knowledge and Information Systems, 2022, 64 : 2091 - 2121