Robust Hypergraph-Augmented Graph Contrastive Learning for Graph Self-Supervised Learning

被引:0
|
作者
Wang, Zeming [1 ]
Li, Xiaoyang [2 ]
Wang, Rui [3 ]
Zheng, Changwen [4 ]
机构
[1] Chinese Acad Sci, Univ Chinese Acad Sci, Inst Software, Beijing, Peoples R China
[2] Nankai Univ, Tianjin, Peoples R China
[3] Chinese Acad Sci, Inst Software, Sci & Technol Integrated Informat Syst Lab, Beijing, Peoples R China
[4] Chinese Acad Sci, Inst Software, Beijing, Peoples R China
关键词
graph contrastive learning; self-supervised; hypergraph; multi-view;
D O I
10.1145/3590003.3590053
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph contrastive learning has emerged as a promising method for self-supervised graph representation learning. The traditional framework conventionally imposes two graph views generated by leveraging graph data augmentations. Such an approach focuses on leading the model to learn discriminative information from graph local structures, which brings up an intrinsic issue that the model partially fails to obtain sufficient discriminative information contained by the graph global information. To this end, we propose a hypergraph-augmented view to empower the self-supervised graph representation learning model to better capture the global information from nodes and corresponding edges. In the further exploration of the graph contrastive learning, we discover a principal challenge undermining conventional contrastive methods: the false negative sample problem, i.e., specific negative samples actually belong to the same category of the anchor sample. To address this issue, we take the neighbors of nodes into consideration and propose the robust graph contrastive learning. In practice, we empirically observe that the proposed hypergraph-augmented view can further enhance the robustness of graph contrastive learning by adopting our framework. Based on these improvements, we propose a novel method called Robust Hypergraph-Augmented Graph Contrastive Learning (RH-GCL). We conduct various experiments in the settings of both transductive and inductive node classification. The results demonstrate that our method achieves the state-of-the-art (SOTA) performance on different datasets. Specifically, the accuracy of node classification on Cora dataset is 84.4%, which is 1.1% higher than that of GRACE. We also perform the ablation study to verify the effectiveness of each part of our proposed method.
引用
收藏
页码:287 / 293
页数:7
相关论文
共 50 条
  • [1] Contrastive Self-supervised Learning for Graph Classification
    Zeng, Jiaqi
    Xie, Pengtao
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10824 - 10832
  • [2] JGCL: Joint Self-Supervised and Supervised Graph Contrastive Learning
    Akkas, Selahattin
    Azad, Ariful
    [J]. COMPANION PROCEEDINGS OF THE WEB CONFERENCE 2022, WWW 2022 COMPANION, 2022, : 1099 - 1105
  • [3] Generative and Contrastive Self-Supervised Learning for Graph Anomaly Detection
    Zheng, Yu
    Jin, Ming
    Liu, Yixin
    Chi, Lianhua
    Phan, Khoa T.
    Chen, Yi-Ping Phoebe
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (12) : 12220 - 12233
  • [4] Self-supervised Graph Contrastive Learning for Video Question Answering
    Yao, Xuan
    Gao, Jun-Yu
    Xu, Chang-Sheng
    [J]. Ruan Jian Xue Bao/Journal of Software, 2023, 34 (05): : 2083 - 2100
  • [5] Toward Graph Self-Supervised Learning With Contrastive Adjusted Zooming
    Zheng, Yizhen
    Li, Ming
    Pan, Shirui
    Li, Yuan-Fang
    Peng, Hao
    Li, Ming
    Li, Zhao
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) : 8882 - 8896
  • [6] Self-supervised Graph-level Representation Learning with Adversarial Contrastive Learning
    Luo, Xiao
    Ju, Wei
    Gu, Yiyang
    Mao, Zhengyang
    Liu, Luchen
    Yuan, Yuhui
    Zhang, Ming
    [J]. ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (02)
  • [7] Dual-channel graph contrastive learning for self-supervised graph-level representation learning
    Luo, Zhenfei
    Dong, Yixiang
    Zheng, Qinghua
    Liu, Huan
    Luo, Minnan
    [J]. PATTERN RECOGNITION, 2023, 139
  • [8] Hypergraph-Enhanced Self-supervised Heterogeneous Graph Representation Learning
    Zhang, Yuanhao
    He, Chengxin
    Li, Longhai
    Zhang, Bingzhe
    Duan, Lei
    Zuo, Jie
    [J]. WEB AND BIG DATA, PT III, APWEB-WAIM 2023, 2024, 14333 : 280 - 295
  • [9] TCGL: Temporal Contrastive Graph for Self-Supervised Video Representation Learning
    Liu, Yang
    Wang, Keze
    Liu, Lingbo
    Lan, Haoyuan
    Lin, Liang
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1978 - 1993
  • [10] Federated Graph Anomaly Detection via Contrastive Self-Supervised Learning
    Kong, Xiangjie
    Zhang, Wenyi
    Wang, Hui
    Hou, Mingliang
    Chen, Xin
    Yan, Xiaoran
    Das, Sajal K.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,