Temporality- and Frequency-aware Graph Contrastive Learning for Temporal Networks

被引:1
|
作者
Tan, Shiyin [1 ]
You, Jingyi [2 ]
Li, Dongyuan [2 ]
机构
[1] Kuaishou Technol, Beijing, Peoples R China
[2] Tokyo Inst Technol, Tokyo, Japan
关键词
Graph contrastive learning; Graph representation learning; Temporal network embedding; POWER-LAW DISTRIBUTIONS;
D O I
10.1145/3511808.3557469
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Graph contrastive learning (GCL) methods aim to learn more distinguishable representations by contrasting positive and negative samples. They have received increasing attention in recent years due to their wide application in recommender systems and knowledge graphs. However, almost all GCL methods are applied to static networks and can not be extended to temporal networks directly. Furthermore, recent GCL models treat low- and high-frequency nodes equally in overall training objectives, which hinders the prediction precision. To solve the aforementioned problems, in this paper, we propose a Temporality- and Frequency-aware Graph Contrastive Learning for temporal networks (TF-GCL). Specifically, to learn more diverse representations for infrequent nodes and fully explore temporal information, we first generate two augmented views from the input graph based on topological and temporal perspectives. We then design a temporality- and frequency-aware objective function to maximize the agreement between node representations of the two views. Experimental results demonstrate that TF-GCL remarkably achieves more robust node representations and significantly outperforms the state-of-the-art methods on six temporal link prediction benchmark datasets. Considering the reproducibility, we release our code on Github.
引用
收藏
页码:1878 / 1888
页数:11
相关论文
共 50 条
  • [1] Frequency-Aware Contrastive Learning for Neural Machine Translation
    Zhang, Tong
    Ye, Wei
    Yang, Baosong
    Zhang, Long
    Ren, Xingzhang
    Liu, Dayiheng
    Sun, Jinan
    Zhang, Shikun
    Zhang, Haibo
    Zhao, Wen
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 11712 - 11720
  • [2] FACL-Attack: Frequency-Aware Contrastive Learning for Transferable Adversarial Attacks
    Yang, Hunmin
    Jeong, Jongoh
    Yoon, Kuk-Jin
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 6, 2024, : 6494 - 6502
  • [3] Graph Contrastive Learning for Tracking Dynamic Communities in Temporal Networks
    Ai, Yun
    Xie, Xianghua
    Ma, Xiaoke
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (05): : 1 - 14
  • [4] Temporal Density-aware Sequential Recommendation Networks with Contrastive Learning
    Wang, Jihu
    Shi, Yuliang
    Yu, Han
    Zhang, Kun
    Wang, Xinjun
    Yan, Zhongmin
    Li, Hui
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 211
  • [5] Frequency-Aware Truncated Methods for Sparse Online Learning
    Oiwa, Hidekazu
    Matsushima, Shin
    Nakagawa, Hiroshi
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT II, 2011, 6912 : 533 - 548
  • [6] Contrastive Graph Learning with Graph Convolutional Networks
    Nagendar, G.
    Sitaram, Ramachandrula
    DOCUMENT ANALYSIS SYSTEMS, DAS 2022, 2022, 13237 : 96 - 110
  • [7] Relation-aware Graph Contrastive Learning
    Li, Bingshi
    Li, Jin
    Fu, Yang-Geng
    PARALLEL PROCESSING LETTERS, 2023, 33 (01N02)
  • [8] Weight-Aware Graph Contrastive Learning
    Gao, Hang
    Li, Jiangmeng
    Qiao, Peng
    Zheng, Changwen
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT II, 2022, 13530 : 719 - 730
  • [9] Frequency-Aware Attention based LSTM Networks for Cardiovascular Disease
    Park, Hwin Dol
    Han, Youngwoong
    Choi, Jae Hun
    2018 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC), 2018, : 1503 - 1505
  • [10] Globally Enhanced Heterogeneous Temporal Graph Neural Networks Based on Contrastive Learning
    Jiao P.
    Liu H.
    Lü L.
    Gao M.
    Zhang J.
    Liu D.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2023, 60 (08): : 1808 - 1821