Adversarial Cluster-Level and Global-Level Graph Contrastive Learning for node representation

被引:1
|
作者
Tang, Qian [1 ,2 ]
Zhao, Yiji [1 ,2 ]
Wu, Hao [1 ,2 ]
Zhang, Lei [3 ]
机构
[1] Yunnan Univ, Sch Informat Sci & Engn, Kunming 650091, Peoples R China
[2] Yunnan Univ, Key Lab Intelligent Syst & Comp Yunnan Prov, Kunming, Peoples R China
[3] Nanjing Normal Univ, Sch Elect & Automat Engn, Nanjing 210024, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph representation learning; Graph contrastive learning; Information bottleneck; Node classification; Node clustering;
D O I
10.1016/j.knosys.2023.110935
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph contrastive learning aims to learn informative and discriminative node representations for downstream tasks by maximizing the mutual information between representations of different augmentation views of the same node. However, according to the multi-view information bottleneck principle, redundant information in learned representations can negatively impact the performance of downstream tasks. To avoid this issue, we propose Adversarial Cluster-Level and Global-Level Graph Contrastive Learning (ACG-GCL) for learning minimal sufficient node representations. ACG-GCL is optimized alternately under an adversarial learning framework with a min-max objective. At the min step, ACG-GCL eliminates redundant information in both the graph structure and feature content of nodes while producing a new graph that provides multi-view information. At the max step, ACG-GCL seeks to preserve shared task-relevant information in the learned representation by maximizing the mutual information of node-cluster level and node-global level representations. We demonstrate the effectiveness of the proposed method on the tasks of node classification and node clustering tasks. Code is available at https://github.com/tangq123/ACG-GCL.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Cluster-Level Contrastive Learning for Emotion Recognition in Conversations
    Yang, Kailai
    Zhang, Tianlin
    Alhuzali, Hassan
    Ananiadou, Sophia
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (04) : 3269 - 3280
  • [2] Universal representation learning for multivariate time series using the instance-level and cluster-level supervised contrastive learning
    Moradinasab, Nazanin
    Sharma, Suchetha
    Bar-Yoseph, Ronen
    Radom-Aizik, Shlomit
    Bilchick, Kenneth C.
    Cooper, Dan M.
    Weltman, Arthur
    Brown, Donald E.
    [J]. DATA MINING AND KNOWLEDGE DISCOVERY, 2024, 38 (03) : 1493 - 1519
  • [3] Universal representation learning for multivariate time series using the instance-level and cluster-level supervised contrastive learning
    Nazanin Moradinasab
    Suchetha Sharma
    Ronen Bar-Yoseph
    Shlomit Radom-Aizik
    Kenneth C. Bilchick
    Dan M. Cooper
    Arthur Weltman
    Donald E. Brown
    [J]. Data Mining and Knowledge Discovery, 2024, 38 : 1493 - 1519
  • [4] Self-supervised Graph-level Representation Learning with Adversarial Contrastive Learning
    Luo, Xiao
    Ju, Wei
    Gu, Yiyang
    Mao, Zhengyang
    Liu, Luchen
    Yuan, Yuhui
    Zhang, Ming
    [J]. ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (02)
  • [5] Learning Robust Representation Through Graph Adversarial Contrastive Learning
    Guo, Jiayan
    Li, Shangyang
    Zhao, Yue
    Zhang, Yan
    [J]. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2022, 13245 LNCS : 682 - 697
  • [6] Learning Robust Representation Through Graph Adversarial Contrastive Learning
    Guo, Jiayan
    Li, Shangyang
    Zhao, Yue
    Zhang, Yan
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2022, PT I, 2022, : 682 - 697
  • [7] Two -Level Graph Representation Learning with Community -as -a -Node Graphs
    Park, Jeong-Ha
    Lee, Kisung
    Kwon, Hyuk-Yoon
    [J]. 23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023, 2023, : 1259 - 1264
  • [8] Multi-level graph contrastive learning
    Shao, Pengpeng
    Tao, Jianhua
    [J]. NEUROCOMPUTING, 2024, 570
  • [9] Dual-channel graph contrastive learning for self-supervised graph-level representation learning
    Luo, Zhenfei
    Dong, Yixiang
    Zheng, Qinghua
    Liu, Huan
    Luo, Minnan
    [J]. PATTERN RECOGNITION, 2023, 139
  • [10] Deep graph level anomaly detection with contrastive learning
    Luo, Xuexiong
    Wu, Jia
    Yang, Jian
    Xue, Shan
    Peng, Hao
    Zhou, Chuan
    Chen, Hongyang
    Li, Zhao
    Sheng, Quan Z.
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)