Invariant Risk Minimization Augmentation for Graph Contrastive Learning

被引:0
|
作者
Qin, Peng [1 ,2 ]
Chen, Weifu [3 ]
机构
[1] Sun Yat Sen Univ, Sch Math, Guangzhou, Peoples R China
[2] Sun Yat Sen Univ, Guangdong Prov Key Lab Computat Sci, Guangzhou, Peoples R China
[3] Guangzhou Maritime Univ, Dept Comp Sci, Guangzhou, Peoples R China
关键词
Graph Data Augmentation; Graph Contrastive Learning; Invariant Risk Minimization; Invariant Features;
D O I
10.1007/978-981-97-8505-6_10
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Despite significant advancements in Graph Contrastive Learning (GCL) in recent years, effective and interpretable graph data augmentation methods remain a challenge in the field. Traditional graph augmentation methods typically involve randomly modifying node attributes, edge properties, or extracting subgraphs, with their fundamental principles and operations derived from random processing of image data. However, graph data lacks the Euclidean structure and attribute intuitiveness of image data, making it difficult to ensure that augmentation data retains key features. In this paper, we propose a novel method called Invariant Risk Minimization Augmentation for Graph Contrastive Learning (IRMGCL). IRMGCL incorporates invariant risk minimization loss during the training process to ensure that data augmentation methods preserve invariant features. Specifically, we use different augmentation channels as environmental variables and train these channels to maintain invariant features through different environments. Experiments conducted on citation network datasets Cora and Citeseer demonstrate the effectiveness of our method. We compared our method with state-of-the-art graph contrastive learning methods, showing superior performance. Simultaneously, we conducted ablation experiments to verify the role of each component loss function in IRMGCL. Furthermore, our framework can incorporate labeled data for semi-supervised contrastive learning. Our experiments show that model performance can be further enhanced.
引用
收藏
页码:135 / 147
页数:13
相关论文
共 50 条
  • [1] Adaptive Graph Augmentation for Graph Contrastive Learning
    Wang, Zeming
    Li, Xiaoyang
    Wang, Rui
    Zheng, Changwen
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, ICIC 2023, PT IV, 2023, 14089 : 354 - 366
  • [2] Augmentation-Free Graph Contrastive Learning of Invariant-Discriminative Representations
    Li, Haifeng
    Cao, Jun
    Zhu, Jiawei
    Luo, Qinyao
    He, Silu
    Wang, Xuyin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (08) : 11157 - 11167
  • [3] Graph Contrastive Learning with Adaptive Augmentation
    Zhu, Yanqiao
    Xu, Yichen
    Yu, Feng
    Liu, Qiang
    Wu, Shu
    Wang, Liang
    PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, : 2069 - 2080
  • [4] Graph Contrastive Learning With Personalized Augmentation
    Zhang, Xin
    Tan, Qiaoyu
    Huang, Xiao
    Li, Bo
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (11) : 6305 - 6316
  • [5] Graph Contrastive Learning with Reinforcement Augmentation
    Liu, Ziyang
    Wang, Chaokun
    Wu, Cheng
    PROCEEDINGS OF THE THIRTY-THIRD INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2024, 2024, : 2225 - 2233
  • [6] Graph Contrastive Learning with Constrained Graph Data Augmentation
    Xu, Shaowu
    Wang, Luo
    Jia, Xibin
    NEURAL PROCESSING LETTERS, 2023, 55 (08) : 10705 - 10726
  • [7] Graph Contrastive Learning with Constrained Graph Data Augmentation
    Shaowu Xu
    Luo Wang
    Xibin Jia
    Neural Processing Letters, 2023, 55 : 10705 - 10726
  • [8] Adversarial Graph Augmentation to Improve Graph Contrastive Learning
    Suresh, Susheel
    Li, Pan
    Hao, Cong
    Neville, Jennifer
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [9] Neighbor Contrastive Learning on Learnable Graph Augmentation
    Shen, Xiao
    Sun, Dewang
    Pan, Shirui
    Zhou, Xi
    Yang, Laurence T.
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 8, 2023, : 9782 - 9791
  • [10] Video Representation Learning with Graph Contrastive Augmentation
    Zhang, Jingran
    Xu, Xing
    Shen, Fumin
    Yao, Yazhou
    Shao, Jie
    Zhu, Xiaofeng
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3043 - 3051