AGCL: Adaptive Graph Contrastive Learning for graph representation learning

被引:0
|
作者
Yu, Jiajun [1 ]
Jia, Adele Lu [1 ]
机构
[1] China Agr Univ, Coll Informat & Elect Engn, Beijing 100083, Peoples R China
关键词
Contrastive learning; Graph filter; Graph unsupervised learning;
D O I
10.1016/j.neucom.2023.127019
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised graph representation learning has attracted great attention as it can learn low -dimensional and compact node embeddings from high -dimensional and sparse graph data without labels. However, two major drawbacks exist in most previous methods, i.e., limited applications of the global graph structure and the problem of the false -negative samples. To address the above problems, we propose a novel Adaptive Graph Contrastive Learning (AGCL) method that utilizes multiple graph filters to capture both the local and the global view information and propose a novel adaptive graph contrastive learning framework to alleviate the false -negative sample problem. AGCL first utilizes a Graph Convolution Network (GCN) filter and our designed Diffusion -based filters to smooth the initial node features. Then, AGCL measures the node pair similarity and then iteratively selects the similar and the dissimilar node pairs as the positive and the negative samples to do the graph contrastive learning. Finally, AGCL leverages various aggregators to obtain node embeddings from multiple views. In addition, we further propose AGCL-Light which can reduce the complexity of updating the training samples, which pre -selects a similar node subset for each node for the subsequent updates. Extensive experiments on nine benchmark datasets demonstrate that our models outperform previous state-of-the-art methods.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Temporal Graph Representation Learning with Adaptive Augmentation Contrastive
    Chen, Hongjiang
    Jiao, Pengfei
    Tang, Huijun
    Wu, Huaming
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT II, 2023, 14170 : 683 - 699
  • [2] Towards Adaptable Graph Representation Learning: An Adaptive Multi-Graph Contrastive Transformer
    Li, Yan
    Zhang, Liang
    Lan, Xiangyuan
    Jiang, Dongmei
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 6063 - 6071
  • [3] Graph Contrastive Learning with Adaptive Augmentation
    Zhu, Yanqiao
    Xu, Yichen
    Yu, Feng
    Liu, Qiang
    Wu, Shu
    Wang, Liang
    [J]. PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, : 2069 - 2080
  • [4] Adaptive Graph Contrastive Learning for Recommendation
    Jiang, Yangqin
    Huang, Chao
    Xia, Lianghao
    [J]. PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 4252 - 4261
  • [5] Graph Contrastive Learning with Positional Representation for Recommendation
    Yi, Zixuan
    Ounis, Iadh
    Macdonald, Craig
    [J]. ADVANCES IN INFORMATION RETRIEVAL, ECIR 2023, PT II, 2023, 13981 : 288 - 303
  • [6] Supervised contrastive learning for graph representation enhancement
    Ghayekhloo, Mohadeseh
    Nickabadi, Ahmad
    [J]. NEUROCOMPUTING, 2024, 588
  • [7] CuCo: Graph Representation with Curriculum Contrastive Learning
    Chu, Guanyi
    Wang, Xiao
    Shi, Chuan
    Jiang, Xunqiang
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 2300 - 2306
  • [8] Video Representation Learning with Graph Contrastive Augmentation
    Zhang, Jingran
    Xu, Xing
    Shen, Fumin
    Yao, Yazhou
    Shao, Jie
    Zhu, Xiaofeng
    [J]. PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3043 - 3051
  • [9] Learning Robust Representation Through Graph Adversarial Contrastive Learning
    School of Artificial Intelligence, Peking University, Beijing, China
    不详
    不详
    [J]. Lect. Notes Comput. Sci., 1600, (682-697):
  • [10] Learning Robust Representation Through Graph Adversarial Contrastive Learning
    Guo, Jiayan
    Li, Shangyang
    Zhao, Yue
    Zhang, Yan
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2022, PT I, 2022, : 682 - 697