Coarse-to-Fine Contrastive Learning on Graphs

被引:3
|
作者
Zhao, Peiyao [1 ]
Pan, Yuangang [2 ]
Li, Xin [1 ]
Chen, Xu [4 ]
Tsang, Ivor W. [2 ,3 ]
Liao, Lejian [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing 100081, Peoples R China
[2] ASTAR Ctr Frontier AI Res, Singapore 138632, Singapore
[3] Univ Technol Sydney, Australian Artificial Intelligence Inst, Ultimo, NSW 2007, Australia
[4] Alibaba Grp, Hangzhou 311121, Peoples R China
基金
澳大利亚研究理事会;
关键词
Perturbation methods; Representation learning; Task analysis; Mutual information; Feature extraction; Encoding; Sparse matrices; Contrastive learning (CL); graph representation learning; learning to rank (L2R); node representation; self-supervised learning (SSL);
D O I
10.1109/TNNLS.2022.3228556
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Inspired by the impressive success of contrastive learning (CL), a variety of graph augmentation strategies have been employed to learn node representations in a self-supervised manner. Existing methods construct the contrastive samples by adding perturbations to the graph structure or node attributes. Although impressive results are achieved, it is rather blind to the wealth of prior information assumed: with the increase of the perturbation degree applied on the original graph: 1) the similarity between the original graph and the generated augmented graph gradually decreases and 2) the discrimination between all nodes within each augmented view gradually increases. In this article, we argue that both such prior information can be incorporated (differently) into the CL paradigm following our general ranking framework. In particular, we first interpret CL as a special case of learning to rank (L2R), which inspires us to leverage the ranking order among positive augmented views. Meanwhile, we introduce a self-ranking paradigm to ensure that the discriminative information among different nodes can be maintained and also be less altered to the perturbations of different degrees. Experiment results on various benchmark datasets verify the effectiveness of our algorithm compared with the supervised and unsupervised models.
引用
收藏
页码:4622 / 4634
页数:13
相关论文
共 50 条
  • [1] Coarse-to-fine manifold learning
    Castro, R
    Willett, R
    Nowak, R
    [J]. 2004 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL III, PROCEEDINGS: IMAGE AND MULTIDIMENSIONAL SIGNAL PROCESSING SPECIAL SESSIONS, 2004, : 992 - 995
  • [2] C2-CRS: Coarse-to-Fine Contrastive Learning for Conversational Recommender System
    Zhou, Yuanhang
    Zhou, Kun
    Zhao, Wayne Xin
    Wang, Cheng
    Jiang, Peng
    Hu, He
    [J]. WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, : 1488 - 1496
  • [3] Coarse-to-fine object recognition using shock graphs
    Bataille, A
    Dickinson, S
    [J]. GRAPH-BASED REPRESENTATIONS IN PATTERN RECOGNITION, PROCEEDINGS, 2005, 3434 : 203 - 212
  • [4] Hierarchical graphs for coarse-to-fine error tolerant matching
    Riba, Pau
    Llados, Josep
    Fornes, Alicia
    [J]. PATTERN RECOGNITION LETTERS, 2020, 134 : 116 - 124
  • [5] Contrastive Diffusion Model with Auxiliary Guidance for Coarse-to-Fine PET Reconstruction
    Han, Zeyu
    Wang, Yuhan
    Zhou, Luping
    Wang, Peng
    Yan, Binyu
    Zhou, Jiliu
    Wang, Yan
    Shen, Dinggang
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT X, 2023, 14229 : 239 - 249
  • [6] Coarse-To-Fine Learning for Neural Machine Translation
    Zhang, Zhirui
    Liu, Shujie
    Li, Mu
    Zhou, Ming
    Chen, Enhong
    [J]. NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, PT I, 2018, 11108 : 316 - 328
  • [7] Learning based coarse-to-fine image registration
    Jiang, Jiayan
    Zheng, Songfeng
    Toga, Arthur W.
    Tu, Zhuowen
    [J]. 2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, : 429 - +
  • [8] Federated Unsupervised Cluster-Contrastive learning for person Re-identification: A coarse-to-fine approach
    Weng, Jianfeng
    Hu, Kun
    Yao, Tingting
    Wang, Jingya
    Wang, Zhiyong
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 237
  • [9] Recombinator Networks: Learning Coarse-to-Fine Feature Aggregation
    Honari, Sina
    Yosinski, Jason
    Vincent, Pascal
    Pal, Christopher
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 5743 - 5752
  • [10] WWN: Integration with Coarse-to-fine, Supervised and Reinforcement Learning
    Zheng, Zejia
    Weng, Juyang
    Zhang, Zhengyou
    [J]. PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 1517 - 1524