Invariant Risk Minimization Augmentation for Graph Contrastive Learning

被引:0
|
作者
Qin, Peng [1 ,2 ]
Chen, Weifu [3 ]
机构
[1] Sun Yat Sen Univ, Sch Math, Guangzhou, Peoples R China
[2] Sun Yat Sen Univ, Guangdong Prov Key Lab Computat Sci, Guangzhou, Peoples R China
[3] Guangzhou Maritime Univ, Dept Comp Sci, Guangzhou, Peoples R China
关键词
Graph Data Augmentation; Graph Contrastive Learning; Invariant Risk Minimization; Invariant Features;
D O I
10.1007/978-981-97-8505-6_10
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Despite significant advancements in Graph Contrastive Learning (GCL) in recent years, effective and interpretable graph data augmentation methods remain a challenge in the field. Traditional graph augmentation methods typically involve randomly modifying node attributes, edge properties, or extracting subgraphs, with their fundamental principles and operations derived from random processing of image data. However, graph data lacks the Euclidean structure and attribute intuitiveness of image data, making it difficult to ensure that augmentation data retains key features. In this paper, we propose a novel method called Invariant Risk Minimization Augmentation for Graph Contrastive Learning (IRMGCL). IRMGCL incorporates invariant risk minimization loss during the training process to ensure that data augmentation methods preserve invariant features. Specifically, we use different augmentation channels as environmental variables and train these channels to maintain invariant features through different environments. Experiments conducted on citation network datasets Cora and Citeseer demonstrate the effectiveness of our method. We compared our method with state-of-the-art graph contrastive learning methods, showing superior performance. Simultaneously, we conducted ablation experiments to verify the role of each component loss function in IRMGCL. Furthermore, our framework can incorporate labeled data for semi-supervised contrastive learning. Our experiments show that model performance can be further enhanced.
引用
收藏
页码:135 / 147
页数:13
相关论文
共 50 条
  • [41] Heterogeneous data augmentation in graph contrastive learning for effective negative samples
    Ali, Adnan
    Li, Jinlong
    Chen, Huanhuan
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 118
  • [42] SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentation
    Xia, Jun
    Wu, Lirong
    Chen, Jintao
    Hu, Bozhen
    Li, Stan Z.
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 1070 - 1079
  • [43] Heterogeneous Graph Contrastive Learning with Dual Aggregation Scheme and Adaptive Augmentation
    Xie, Yingjie
    Yan, Qi
    Zhou, Cangqi
    Zhang, Jing
    Hu, Dianming
    WEB AND BIG DATA, PT IV, APWEB-WAIM 2023, 2024, 14334 : 124 - 138
  • [44] Graph Similarity Learning Based on Learnable Augmentation and Multi-Level Contrastive Learning
    Feng, Jian
    Guo, Yifan
    Du, Cailing
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (03): : 5135 - 5151
  • [45] Graph-based Text Classification by Contrastive Learning with Text-level Graph Augmentation
    Li, Ximing
    Wang, Bing
    Wang, Yang
    Wang, Meng
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (04)
  • [46] LMACL: Improving Graph Collaborative Filtering with Learnable Model Augmentation Contrastive Learning
    Liu, Xinru
    Hao, Yongjing
    Zhao, Lei
    Liu, Guanfeng
    Sheng, Victor S.
    Zhao, Pengpeng
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (07)
  • [47] Distribution-aware hybrid noise augmentation in graph contrastive learning for recommendation
    Zhu, Kuiyu
    Qin, Tao
    Wang, Xin
    Liu, Zhaoli
    Wang, Chenxu
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 124
  • [48] AFANS: Augmentation-Free Graph Contrastive Learning with Adversarial Negative Sampling
    Wang, Shihao
    Wang, Chenxu
    Meng, Panpan
    Wang, Zhanggong
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT XII, ICIC 2024, 2024, 14873 : 376 - 387
  • [49] Does Invariant Graph Learning via Environment Augmentation Learn Invariance?
    Chen, Yongqiang
    Bian, Yatao
    Zhou, Kaiwen
    Xie, Binghui
    Han, Bo
    Cheng, James
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [50] CONVERT: Contrastive Graph Clustering with Reliable Augmentation
    Yang, Xihong
    Tan, Cheng
    Liu, Yue
    Liang, Ke
    Wang, Siwei
    Zhou, Sihang
    Xia, Jun
    Li, Stan Z.
    Liu, Xinwang
    Zhu, En
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 319 - 327