Robust Hypergraph-Augmented Graph Contrastive Learning for Graph Self-Supervised Learning

被引:0
|
作者
Wang, Zeming [1 ]
Li, Xiaoyang [2 ]
Wang, Rui [3 ]
Zheng, Changwen [4 ]
机构
[1] Chinese Acad Sci, Univ Chinese Acad Sci, Inst Software, Beijing, Peoples R China
[2] Nankai Univ, Tianjin, Peoples R China
[3] Chinese Acad Sci, Inst Software, Sci & Technol Integrated Informat Syst Lab, Beijing, Peoples R China
[4] Chinese Acad Sci, Inst Software, Beijing, Peoples R China
关键词
graph contrastive learning; self-supervised; hypergraph; multi-view;
D O I
10.1145/3590003.3590053
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph contrastive learning has emerged as a promising method for self-supervised graph representation learning. The traditional framework conventionally imposes two graph views generated by leveraging graph data augmentations. Such an approach focuses on leading the model to learn discriminative information from graph local structures, which brings up an intrinsic issue that the model partially fails to obtain sufficient discriminative information contained by the graph global information. To this end, we propose a hypergraph-augmented view to empower the self-supervised graph representation learning model to better capture the global information from nodes and corresponding edges. In the further exploration of the graph contrastive learning, we discover a principal challenge undermining conventional contrastive methods: the false negative sample problem, i.e., specific negative samples actually belong to the same category of the anchor sample. To address this issue, we take the neighbors of nodes into consideration and propose the robust graph contrastive learning. In practice, we empirically observe that the proposed hypergraph-augmented view can further enhance the robustness of graph contrastive learning by adopting our framework. Based on these improvements, we propose a novel method called Robust Hypergraph-Augmented Graph Contrastive Learning (RH-GCL). We conduct various experiments in the settings of both transductive and inductive node classification. The results demonstrate that our method achieves the state-of-the-art (SOTA) performance on different datasets. Specifically, the accuracy of node classification on Cora dataset is 84.4%, which is 1.1% higher than that of GRACE. We also perform the ablation study to verify the effectiveness of each part of our proposed method.
引用
收藏
页码:287 / 293
页数:7
相关论文
共 50 条
  • [41] Self-supervised role learning for graph neural networks
    Sankar, Aravind
    Wang, Junting
    Krishnan, Adit
    Sundaram, Hari
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2022, 64 (08) : 2091 - 2121
  • [42] Self-supervised graph learning for occasional group recommendation
    Hao, Bowen
    Yin, Hongzhi
    Li, Cuiping
    Chen, Hong
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (12) : 10880 - 10902
  • [43] Self-supervised Graph Representation Learning with Variational Inference
    Liao, Zihan
    Liang, Wenxin
    Liu, Han
    Mu, Jie
    Zhang, Xianchao
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2021, PT III, 2021, 12714 : 116 - 127
  • [44] Evaluating Self-Supervised Learning for Molecular Graph Embeddings
    Wang, Hanchen
    Kaddour, Jean
    Liu, Shengchao
    Tang, Jian
    Lasenby, Joan
    Liu, Qi
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [45] Self-supervised graph representation learning via bootstrapping
    Che, Feihu
    Yang, Guohua
    Zhang, Dawei
    Tao, Jianhua
    Liu, Tong
    [J]. NEUROCOMPUTING, 2021, 456 (456) : 88 - 96
  • [46] Enhancing robust VQA via contrastive and self-supervised learning
    Cao, Runlin
    Li, Zhixin
    Tang, Zhenjun
    Zhang, Canlong
    Ma, Huifang
    [J]. Pattern Recognition, 2025, 159
  • [47] CausalCD: A Causal Graph Contrastive Learning Framework for Self-Supervised SAR Image Change Detection
    Li, Haolin
    Zou, Bin
    Zhang, Lamei
    Qin, Jiang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [48] Sub-graph Contrast for Scalable Self-Supervised Graph Representation Learning
    Jiao, Yizhu
    Xiong, Yun
    Zhang, Jiawei
    Zhang, Yao
    Zhang, Tianqi
    Zhu, Yangyong
    [J]. 20TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2020), 2020, : 222 - 231
  • [49] ROBUST GRAPH EMBEDDING VIA SELF-SUPERVISED GRAPH DENOISING
    Han, Wang
    [J]. 2022 19TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2022,
  • [50] Self-Supervised Learning: Generative or Contrastive
    Liu, Xiao
    Zhang, Fanjin
    Hou, Zhenyu
    Mian, Li
    Wang, Zhaoyu
    Zhang, Jing
    Tang, Jie
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (01) : 857 - 876