A dynamic graph representation learning based on temporal graph transformer

被引:4
|
作者
Zhong, Ying [1 ]
Huang, Chenze [1 ]
机构
[1] Northwestern Polytech Univ, Res & Dev Inst, Shenzhen, Guangdong, Peoples R China
关键词
Graph neural network; Continuous-time dynamic graph; Deep learning; Complex networks;
D O I
10.1016/j.aej.2022.08.010
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The graph neural network has received significant attention in recent years because of its unique role in mining graph-structure data and its ubiquitous application in various fields, such as social networking and recommendation systems. Although most work focuses on learning lowdimensional node representation in static graphs, the dynamic nature of real-world networks makes temporal graphs more practical and significant. In this paper, we propose a dynamic graph representation learning method based on a temporal graph transformer (TGT), which can efficiently preserve high-order information and temporally evolve structural properties by incorporating an update module, an aggregation module, and a propagation module in a single model. The experimental results on three real-world networks demonstrate that the TGT outperforms state-of-the-art baselines for dynamic link prediction and edge classification tasks in terms of both accuracy and efficiency.(c) 2022 THE AUTHORS. Published by Elsevier BV on behalf of Faculty of Engineering, Alexandria University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/ licenses/by-nc-nd/4.0/).
引用
收藏
页码:359 / 369
页数:11
相关论文
共 50 条
  • [1] A dynamic graph representation learning based on temporal graph transformer
    Zhong, Ying
    Huang, Chenze
    [J]. ALEXANDRIA ENGINEERING JOURNAL, 2023, 63 : 359 - 369
  • [2] Learning continuous dynamic network representation with transformer-based temporal graph neural network
    Li, Yingji
    Wu, Yue
    Sun, Mingchen
    Yang, Bo
    Wang, Ying
    [J]. INFORMATION SCIENCES, 2023, 649
  • [3] Graph Propagation Transformer for Graph Representation Learning
    Chen, Zhe
    Tan, Hao
    Wang, Tao
    Shen, Tianrun
    Lu, Tong
    Peng, Qiuying
    Cheng, Cheng
    Qi, Yue
    [J]. PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 3559 - 3567
  • [5] Temporal Graph Transformer for Dynamic Network
    Wang, Zehong
    Li, Qi
    Yu, Donghua
    Han, Xiaolong
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT II, 2022, 13530 : 694 - 705
  • [6] GraKerformer: A Transformer with Graph Kernel for Unsupervised Graph Representation Learning
    Xu, Lixiang
    Liu, Haifeng
    Yuan, Xin
    Chen, Enhong
    Tang, Yuanyan
    [J]. IEEE Transactions on Cybernetics, 2024, 54 (12) : 7320 - 7332
  • [7] Temporal resonant graph network for representation learning on dynamic graphs
    Zidu Yin
    Kun Yue
    [J]. Applied Intelligence, 2023, 53 : 7466 - 7483
  • [8] Temporal resonant graph network for representation learning on dynamic graphs
    Yin, Zidu
    Yue, Kun
    [J]. APPLIED INTELLIGENCE, 2023, 53 (07) : 7466 - 7483
  • [9] UGTransformer: Unsupervised Graph Transformer Representation Learning
    Xu, Lixiang
    Liu, Haifeng
    Cui, Qingzhe
    Luo, Bin
    Li, Ning
    Chen, Yan
    Tang, Yuanyan
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [10] Network Representation Learning Method Based on Spatial-Temporal Graph in Dynamic Network
    Cheng, Xiaotao
    Ji, Lixin
    Yin, Ying
    Huang, Ruiyang
    [J]. PROCEEDINGS OF 2019 IEEE 9TH INTERNATIONAL CONFERENCE ON ELECTRONICS INFORMATION AND EMERGENCY COMMUNICATION (ICEIEC 2019), 2019, : 196 - 200