Invariant Risk Minimization Augmentation for Graph Contrastive Learning

被引:0
|
作者
Qin, Peng [1 ,2 ]
Chen, Weifu [3 ]
机构
[1] Sun Yat Sen Univ, Sch Math, Guangzhou, Peoples R China
[2] Sun Yat Sen Univ, Guangdong Prov Key Lab Computat Sci, Guangzhou, Peoples R China
[3] Guangzhou Maritime Univ, Dept Comp Sci, Guangzhou, Peoples R China
关键词
Graph Data Augmentation; Graph Contrastive Learning; Invariant Risk Minimization; Invariant Features;
D O I
10.1007/978-981-97-8505-6_10
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Despite significant advancements in Graph Contrastive Learning (GCL) in recent years, effective and interpretable graph data augmentation methods remain a challenge in the field. Traditional graph augmentation methods typically involve randomly modifying node attributes, edge properties, or extracting subgraphs, with their fundamental principles and operations derived from random processing of image data. However, graph data lacks the Euclidean structure and attribute intuitiveness of image data, making it difficult to ensure that augmentation data retains key features. In this paper, we propose a novel method called Invariant Risk Minimization Augmentation for Graph Contrastive Learning (IRMGCL). IRMGCL incorporates invariant risk minimization loss during the training process to ensure that data augmentation methods preserve invariant features. Specifically, we use different augmentation channels as environmental variables and train these channels to maintain invariant features through different environments. Experiments conducted on citation network datasets Cora and Citeseer demonstrate the effectiveness of our method. We compared our method with state-of-the-art graph contrastive learning methods, showing superior performance. Simultaneously, we conducted ablation experiments to verify the role of each component loss function in IRMGCL. Furthermore, our framework can incorporate labeled data for semi-supervised contrastive learning. Our experiments show that model performance can be further enhanced.
引用
收藏
页码:135 / 147
页数:13
相关论文
共 50 条
  • [31] Semi-Supervised Graph Contrastive Learning With Virtual Adversarial Augmentation
    Dong, Yixiang
    Luo, Minnan
    Li, Jundong
    Liu, Ziqi
    Zheng, Qinghua
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (08) : 4232 - 4244
  • [32] COSTA: Covariance-Preserving Feature Augmentation for Graph Contrastive Learning
    Zhang, Yifei
    Zhu, Hao
    Song, Zixing
    Koniusz, Piotr
    King, Irwin
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 2524 - 2534
  • [33] Influence-Guided Data Augmentation in Graph Contrastive Learning for Recommendation
    Zhang, Qi
    Xi, Heran
    Zhu, Jinghua
    SERVICE-ORIENTED COMPUTING, ICSOC 2023, PT II, 2023, 14420 : 91 - 99
  • [34] MA-GCL: Model Augmentation Tricks for Graph Contrastive Learning
    Gong, Xumeng
    Yang, Cheng
    Shi, Chuan
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 4, 2023, : 4284 - 4292
  • [35] Heterogeneous data augmentation in graph contrastive learning for effective negative samples
    Ali, Adnan
    Li, Jinlong
    Chen, Huanhuan
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 118
  • [36] Co-augmentation of structure and feature for boosting graph contrastive learning
    Bao, Peng
    Yan, Rong
    Pan, Shirui
    INFORMATION SCIENCES, 2024, 676
  • [37] GMNI: Achieve good data augmentation in unsupervised graph contrastive learning
    Xiong, Xin
    Wang, Xiangyu
    Yang, Suorong
    Shen, Furao
    Zhao, Jian
    NEURAL NETWORKS, 2025, 181
  • [38] Contrastive Learning with Cluster-Preserving Augmentation for Attributed Graph Clustering
    Zheng, Yimei
    Jia, Caiyan
    Yu, Jian
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT I, 2023, 14169 : 644 - 661
  • [39] FAGCL: frequency-based augmentation graph contrastive learning for recommendation
    Xu, Jingyu
    Yang, Bo
    Li, Zimu
    Liu, Wei
    Qiao, Hao
    APPLIED INTELLIGENCE, 2025, 55 (01)
  • [40] A Graph Contrastive Learning Framework with Adaptive Augmentation and Encoding for Unaligned Views
    Guo, Yifu
    Liu, Yong
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2023, PT II, 2023, 13936 : 92 - 104