GPS: graph contrastive learning via multi-scale augmented views from adversarial pooling

被引:0
|
作者
Wei JU [1 ]
Yiyang GU [1 ]
Zhengyang MAO [1 ]
Ziyue QIAO [2 ]
Yifang QIN [1 ]
Xiao LUO [3 ]
Hui XIONG [2 ]
Ming ZHANG [1 ]
机构
[1] School of Computer Science, National Key Laboratory for Multimedia Information Processing,Peking University
[2] Artificial Intelligence Thrust, The Hong Kong University of Science and Technology
[3] Department of Computer Science, University of
关键词
D O I
暂无
中图分类号
P228.4 [全球定位系统(GPS)];
学科分类号
081105 ; 0818 ; 081802 ;
摘要
Self-supervised graph representation learning has recently shown considerable promise in a range of fields, including bioinformatics and social networks. A large number of graph contrastive learning approaches have shown promising performance for representation learning on graphs, which train models by maximizing agreement between original graphs and their augmented views(i.e., positive views). Unfortunately, these methods usually involve pre-defined augmentation strategies based on the knowledge of human experts. Moreover, these strategies may fail to generate challenging positive views to provide sufficient supervision signals. In this paper, we present a novel approach named graph pooling contrast(GPS) to address these issues.Motivated by the fact that graph pooling can adaptively coarsen the graph with the removal of redundancy, we rethink graph pooling and leverage it to automatically generate multi-scale positive views with varying emphasis on providing challenging positives and preserving semantics, i.e., strongly-augmented view and weakly-augmented view. Then, we incorporate both views into a joint contrastive learning framework with similarity learning and consistency learning, where our pooling module is adversarially trained with respect to the encoder for adversarial robustness. Experiments on twelve datasets on both graph classification and transfer learning tasks verify the superiority of the proposed method over its counterparts.
引用
收藏
页码:145 / 158
页数:14
相关论文
共 50 条
  • [1] GPS: graph contrastive learning via multi-scale augmented views from adversarial pooling
    Ju, Wei
    Gu, Yiyang
    Mao, Zhengyang
    Qiao, Ziyue
    Qin, Yifang
    Luo, Xiao
    Xiong, Hui
    Zhang, Ming
    SCIENCE CHINA-INFORMATION SCIENCES, 2025, 68 (01)
  • [2] Graph Anomaly Detection via Multi-Scale Contrastive Learning Networks with Augmented View
    Duan, Jingcan
    Wang, Siwei
    Zhang, Pei
    Zhu, En
    Hu, Jingtao
    Jin, Hu
    Liu, Yue
    Dong, Zhibin
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 6, 2023, : 7459 - 7467
  • [3] Normality Learning-based Graph Anomaly Detection via Multi-Scale Contrastive Learning
    Duan, Jingcan
    Zhang, Pei
    Wang, Siwei
    Hu, Jingtao
    Jin, Hu
    Zhang, Jiaxin
    Zhou, Haifang
    Liu, Xinwang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 7502 - 7511
  • [4] DMSPool: Dual Multi-Scale Pooling for Graph Representation Learning
    Yu, Hualei
    Luo, Chong
    Du, Yuntao
    Cheng, Hao
    Cao, Meng
    Wang, Chongjun
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT I, 2021, 12681 : 375 - 384
  • [5] ANEMONE: Graph Anomaly Detection with Multi-Scale Contrastive Learning
    Jin, Ming
    Liu, Yixin
    Zheng, Yu
    Chi, Lianhua
    Li, Yuan-Fang
    Pan, Shirui
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 3122 - 3126
  • [6] Multi-Scale Subgraph Contrastive Learning
    Liu, Yanbei
    Zhao, Yu
    Wang, Xiao
    Geng, Lei
    Xiao, Zhitao
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 2215 - 2223
  • [7] Multi-Granularity Contrastive Learning for Graph with Hierarchical Pooling
    Liu, Peishuo
    Zhou, Cangqi
    Liu, Xiao
    Zhang, Jing
    Li, Qianmu
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT IV, 2023, 14257 : 499 - 511
  • [8] Deep image clustering with contrastive learning and multi-scale graph convolutional networks
    Xu, Yuankun
    Huang, Dong
    Wang, Chang-Dong
    Lai, Jian-Huang
    PATTERN RECOGNITION, 2024, 146
  • [9] Automated Multi-scale Contrastive Learning with Sample-Awareness for Graph Classification
    Li, Yafang
    Kang, Jie
    Li, Xuyang
    Jia, Caiyan
    Zu, Baokai
    WEB AND BIG DATA, APWEB-WAIM 2024, PT III, 2024, 14963 : 145 - 160
  • [10] Multi-scale contrastive learning via aggregated subgraph for link prediction
    Yao, Yabing
    Guo, Pingxia
    Mao, Zhiheng
    Ti, Ziyu
    He, Yangyang
    Nian, Fuzhong
    Zhang, Ruisheng
    Ma, Ning
    APPLIED INTELLIGENCE, 2025, 55 (06)