Invariant Risk Minimization Augmentation for Graph Contrastive Learning

被引:0
|
作者
Qin, Peng [1 ,2 ]
Chen, Weifu [3 ]
机构
[1] Sun Yat Sen Univ, Sch Math, Guangzhou, Peoples R China
[2] Sun Yat Sen Univ, Guangdong Prov Key Lab Computat Sci, Guangzhou, Peoples R China
[3] Guangzhou Maritime Univ, Dept Comp Sci, Guangzhou, Peoples R China
关键词
Graph Data Augmentation; Graph Contrastive Learning; Invariant Risk Minimization; Invariant Features;
D O I
10.1007/978-981-97-8505-6_10
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Despite significant advancements in Graph Contrastive Learning (GCL) in recent years, effective and interpretable graph data augmentation methods remain a challenge in the field. Traditional graph augmentation methods typically involve randomly modifying node attributes, edge properties, or extracting subgraphs, with their fundamental principles and operations derived from random processing of image data. However, graph data lacks the Euclidean structure and attribute intuitiveness of image data, making it difficult to ensure that augmentation data retains key features. In this paper, we propose a novel method called Invariant Risk Minimization Augmentation for Graph Contrastive Learning (IRMGCL). IRMGCL incorporates invariant risk minimization loss during the training process to ensure that data augmentation methods preserve invariant features. Specifically, we use different augmentation channels as environmental variables and train these channels to maintain invariant features through different environments. Experiments conducted on citation network datasets Cora and Citeseer demonstrate the effectiveness of our method. We compared our method with state-of-the-art graph contrastive learning methods, showing superior performance. Simultaneously, we conducted ablation experiments to verify the role of each component loss function in IRMGCL. Furthermore, our framework can incorporate labeled data for semi-supervised contrastive learning. Our experiments show that model performance can be further enhanced.
引用
收藏
页码:135 / 147
页数:13
相关论文
共 50 条
  • [21] Graph Contrastive Learning With Adaptive Proximity-Based Graph Augmentation
    Zhuo, Wei
    Tan, Guang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 14301 - 14314
  • [22] Multi-relational graph contrastive learning with learnable graph augmentation
    Mo, Xian
    Pang, Jun
    Wan, Binyuan
    Tang, Rui
    Liu, Hao
    Jiang, Shuyu
    NEURAL NETWORKS, 2025, 181
  • [23] Graph Contrastive Invariant Learning from the Causal Perspective
    Mo, Yanhu
    Wang, Xiao
    Fan, Shaohua
    Shi, Chuan
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 8, 2024, : 8904 - 8912
  • [24] Adaptive graph contrastive learning with joint optimization of data augmentation and graph encoder
    Zhenpeng Wu
    Jiamin Chen
    Raeed Al-Sabri
    Babatounde Moctard Oloulade
    Jianliang Gao
    Knowledge and Information Systems, 2024, 66 : 1657 - 1681
  • [25] Encoder augmentation for multi-task graph contrastive learning
    Wang, Xiaoyu
    Zhang, Qiqi
    Liu, Gen
    Zhao, Zhongying
    Cui, Hongzhi
    NEUROCOMPUTING, 2025, 630
  • [26] Graph contrastive learning networks with augmentation for legal judgment prediction
    Dong, Yao
    Li, Xinran
    Shi, Jin
    Dong, Yongfeng
    Chen, Chen
    ARTIFICIAL INTELLIGENCE AND LAW, 2024,
  • [27] Adaptive graph contrastive learning with joint optimization of data augmentation and graph encoder
    Wu, Zhenpeng
    Chen, Jiamin
    Al-Sabri, Raeed
    Oloulade, Babatounde Moctard
    Gao, Jianliang
    KNOWLEDGE AND INFORMATION SYSTEMS, 2024, 66 (03) : 1657 - 1681
  • [28] Unsupervised Graph Transformer With Augmentation-Free Contrastive Learning
    Zhao, Han
    Yang, Xu
    Wei, Kun
    Deng, Cheng
    Tao, Dacheng
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (11) : 7296 - 7307
  • [29] Let Invariant Rationale Discovery Inspire Graph Contrastive Learning
    Li, Sihang
    Wang, Xiang
    Zhang, An
    Wu, Ying-Xin
    He, Xiangnan
    Chua, Tat-Seng
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [30] A Unique Framework of Heterogeneous Augmentation Graph Contrastive Learning for Both Node and Graph Classification
    Shao, Qi
    Chen, Duxin
    Yu, Wenwu
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (06): : 5818 - 5828