Self-Supervised Temporal Graph Learning With Temporal and Structural Intensity Alignment

被引:31
|
作者
Liu, Meng [1 ]
Liang, Ke [1 ]
Zhao, Yawei [2 ]
Tu, Wenxuan [1 ]
Gan, Xinbiao [1 ]
Zhou, Sihang [3 ]
Liu, Xinwang [1 ]
He, Kunlun [2 ]
机构
[1] Natl Univ Def Technol, Sch Comp, Changsha 410073, Peoples R China
[2] Chinese Peoples Liberat Army Gen Hosp, Med Big Data Res Ctr, Beijing 100853, Peoples R China
[3] Natl Univ Def Technol, Coll Intelligence Sci & Technol, Changsha 410073, Peoples R China
关键词
Task analysis; Learning systems; Data mining; Vectors; Feature extraction; Medical diagnostic imaging; Industries; Conditional intensity alignment; self-supervised learning; temporal graph learning; NETWORK;
D O I
10.1109/TNNLS.2024.3386168
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Temporal graph learning aims to generate high-quality representations for graph-based tasks with dynamic information, which has recently garnered increasing attention. In contrast to static graphs, temporal graphs are typically organized as node interaction sequences over continuous time rather than an adjacency matrix. Most temporal graph learning methods model current interactions by incorporating historical neighborhood. However, such methods only consider first-order temporal information while disregarding crucial high-order structural information, resulting in suboptimal performance. To address this issue, we propose a self-supervised method called S2T for temporal graph learning, which extracts both temporal and structural information to learn more informative node representations. Notably, the initial node representations combine first-order temporal and high-order structural information differently to calculate two conditional intensities. An alignment loss is then introduced to optimize the node representations, narrowing the gap between the two intensities and making them more informative. Concretely, in addition to modeling temporal information using historical neighbor sequences, we further consider structural knowledge at both local and global levels. At the local level, we generate structural intensity by aggregating features from high-order neighbor sequences. At the global level, a global representation is generated based on all nodes to adjust the structural intensity according to the active statuses on different nodes. Extensive experiments demonstrate that the proposed model S2T achieves at most 10.13% performance improvement compared with the state-of-the-art competitors on several datasets.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [1] Self-Supervised Temporal Graph Learning With Temporal and Structural Intensity Alignment
    Liu, Meng
    Liang, Ke
    Zhao, Yawei
    Tu, Wenxuan
    Zhou, Sihang
    Gan, Xinbiao
    Liu, Xinwang
    He, Kunlun
    IEEE Transactions on Neural Networks and Learning Systems, 2024, : 1 - 13
  • [2] TCGL: Temporal Contrastive Graph for Self-Supervised Video Representation Learning
    Liu, Yang
    Wang, Keze
    Liu, Lingbo
    Lan, Haoyuan
    Lin, Liang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1978 - 1993
  • [3] Temporal Feature Alignment in Contrastive Self-Supervised Learning for Human Activity Recognition
    Khaertdinov, Bulat
    Asteriadis, Stylianos
    2022 IEEE INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS (IJCB), 2022,
  • [4] Self-Supervised Graph Learning With Hyperbolic Embedding for Temporal Health Event Prediction
    Lu, Chang
    Reddy, Chandan K.
    Ning, Yue
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (04) : 2124 - 2136
  • [5] Self-Supervised Dynamic Graph Representation Learning via Temporal Subgraph Contrast
    Chen, Ke-Jia
    Liu, Linsong
    Jiang, Linpu
    Chen, Jingqiang
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (01)
  • [6] A Self-supervised Riemannian GNN with Time Varying Curvature for Temporal Graph Learning
    Sun, Li
    Ye, Junda
    Peng, Hao
    Yu, Philip S.
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 1827 - 1836
  • [7] Self-supervised temporal adaptive learning for weakly-supervised temporal action localization
    Sheng, Jinrong
    Yu, Jiaruo
    Li, Ziqiang
    Li, Ao
    Ge, Yongxin
    INFORMATION SCIENCES, 2025, 705
  • [8] Temporal knowledge completion enhanced self-supervised entity alignment
    Fu, Teng
    Zhou, Gang
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2024, : 43 - 62
  • [9] Self-Supervised Spatio-Temporal Graph Learning for Point-of-Interest Recommendation
    Liu, Jiawei
    Gao, Haihan
    Shi, Chuan
    Cheng, Hongtao
    Xie, Qianlong
    APPLIED SCIENCES-BASEL, 2023, 13 (15):
  • [10] Self-Supervised Learning for Semi-Supervised Temporal Language Grounding
    Luo, Fan
    Chen, Shaoxiang
    Chen, Jingjing
    Wu, Zuxuan
    Jiang, Yu-Gang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 7747 - 7757