Invariant Risk Minimization Augmentation for Graph Contrastive Learning

被引:0
|
作者
Qin, Peng [1 ,2 ]
Chen, Weifu [3 ]
机构
[1] Sun Yat Sen Univ, Sch Math, Guangzhou, Peoples R China
[2] Sun Yat Sen Univ, Guangdong Prov Key Lab Computat Sci, Guangzhou, Peoples R China
[3] Guangzhou Maritime Univ, Dept Comp Sci, Guangzhou, Peoples R China
关键词
Graph Data Augmentation; Graph Contrastive Learning; Invariant Risk Minimization; Invariant Features;
D O I
10.1007/978-981-97-8505-6_10
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Despite significant advancements in Graph Contrastive Learning (GCL) in recent years, effective and interpretable graph data augmentation methods remain a challenge in the field. Traditional graph augmentation methods typically involve randomly modifying node attributes, edge properties, or extracting subgraphs, with their fundamental principles and operations derived from random processing of image data. However, graph data lacks the Euclidean structure and attribute intuitiveness of image data, making it difficult to ensure that augmentation data retains key features. In this paper, we propose a novel method called Invariant Risk Minimization Augmentation for Graph Contrastive Learning (IRMGCL). IRMGCL incorporates invariant risk minimization loss during the training process to ensure that data augmentation methods preserve invariant features. Specifically, we use different augmentation channels as environmental variables and train these channels to maintain invariant features through different environments. Experiments conducted on citation network datasets Cora and Citeseer demonstrate the effectiveness of our method. We compared our method with state-of-the-art graph contrastive learning methods, showing superior performance. Simultaneously, we conducted ablation experiments to verify the role of each component loss function in IRMGCL. Furthermore, our framework can incorporate labeled data for semi-supervised contrastive learning. Our experiments show that model performance can be further enhanced.
引用
收藏
页码:135 / 147
页数:13
相关论文
共 50 条
  • [11] Improving Augmentation Consistency for Graph Contrastive Learning
    Bu, Weixin
    Cao, Xiaofeng
    Zheng, Yizhen
    Pan, Shirui
    PATTERN RECOGNITION, 2024, 148
  • [12] Graph Contrastive Learning with Adaptive Augmentation for Recommendation
    Jing, Mengyuan
    Zhu, Yanmin
    Zang, Tianzi
    Yu, Jiadi
    Tang, Feilong
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT I, 2023, 13713 : 590 - 605
  • [13] Graph Contrastive Learning With Feature Augmentation for Rumor Detection
    Li, Shaohua
    Li, Weimin
    Luvembe, Alex Munyole
    Tong, Weiqin
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (04): : 5158 - 5167
  • [14] Mixed Augmentation Contrastive Learning for Graph Recommendation System
    Dong, Zhuolun
    Yang, Yan
    Zhong, Yingli
    WEB AND BIG DATA, APWEB-WAIM 2024, PT II, 2024, 14962 : 130 - 143
  • [15] Spectral Feature Augmentation for Graph Contrastive Learning and Beyond
    Zhang, Yifei
    Zhu, Hao
    Song, Zixing
    Koniusz, Piotr
    King, Irwin
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 11289 - 11297
  • [16] Features based adaptive augmentation for graph contrastive learning
    Ali, Adnan
    Li, Jinlong
    DIGITAL SIGNAL PROCESSING, 2024, 145
  • [17] AAGCN: An adaptive data augmentation for graph contrastive learning
    Qin, Peng
    Lu, Yaochun
    Chen, Weifu
    Li, Defang
    Feng, Guocan
    PATTERN RECOGNITION, 2025, 163
  • [18] Temporal Graph Representation Learning with Adaptive Augmentation Contrastive
    Chen, Hongjiang
    Jiao, Pengfei
    Tang, Huijun
    Wu, Huaming
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT II, 2023, 14170 : 683 - 699
  • [19] Graph contrastive learning for recommendation with generative data augmentation
    Li, Xiaoge
    Wang, Yin
    Wang, Yihan
    An, Xiaochun
    MULTIMEDIA SYSTEMS, 2024, 30 (04)
  • [20] Contrastive learning for fair graph representations via counterfactual graph augmentation
    Li, Chengyu
    Cheng, Debo
    Zhang, Guixian
    Zhang, Shichao
    KNOWLEDGE-BASED SYSTEMS, 2024, 305