LightDiC: A Simple yet Effective Approach for Large-scale Digraph Representation Learning

被引:0
|
作者
Li, Xunkai [1 ]
Liao, Meihao [1 ]
Wu, Zhengyu [1 ]
Su, Daohan [1 ]
Zhang, Wentao [2 ]
Li, Rong-Hua [1 ]
Wang, Guoren [1 ]
机构
[1] Beijing Inst Technol, Beijing, Peoples R China
[2] Peking Univ, Natl Engn Lab Big Data Analyt & Applicat, Beijing, Peoples R China
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2024年 / 17卷 / 07期
关键词
D O I
10.14778/3654621.3654623
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Most existing graph neural networks (GNNs) are limited to undirected graphs, whose restricted scope of the captured relational information hinders their expressive capabilities and deployment. Compared with undirected graphs, directed graphs (digraphs) fit the demand for modeling more complex topological systems by capturing more intricate relationships between nodes. While some directed GNNs have been introduced, their inspiration mainly comes from deep learning architectures, which lead to redundant complexity and computation, making them inapplicable to large-scale databases. To address these issues, we propose LightDiC, a scalable variant of the digraph convolution based on the magnetic Laplacian. Since topology-related computations are conducted solely during offline pre-processing, LightDiC achieves exceptional scalability, enabling downstream predictions to be trained separately without incurring recursive computational costs. Theoretical analysis shows that LightDiC achieves message passing based on the complex field, which corresponds to the proximal gradient descent process of the Dirichlet energy optimization function from the perspective of digraph signal denoising, ensuring its expressiveness. Experimental results demonstrate that LightDiC performs comparably well or even outperforms other SOTA methods in various downstream tasks, with fewer learnable parameters and higher efficiency.
引用
收藏
页码:1542 / 1551
页数:10
相关论文
共 50 条
  • [1] Large-scale Graph Representation Learning
    Leskovec, Jure
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 4 - 4
  • [2] Effective ensemble learning approach for large-scale medical data analytics
    Namamula, Lakshmana Rao
    Chaytor, Daniel
    [J]. INTERNATIONAL JOURNAL OF SYSTEM ASSURANCE ENGINEERING AND MANAGEMENT, 2024, 15 (01) : 13 - 20
  • [3] Representation Learning for Large-Scale Dynamic Networks
    Yu, Yanwei
    Yao, Huaxiu
    Wang, Hongjian
    Tang, Xianfeng
    Li, Zhenhui
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2018), PT II, 2018, 10828 : 526 - 541
  • [4] Learning Deep Representation with Large-scale Attributes
    Ouyang, Wanli
    Li, Hongyang
    Zeng, Xingyu
    Wang, Xiaogang
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1895 - 1903
  • [5] Large-scale modeling of wordform learning and representation
    Sibley, Daragh E.
    Kello, Christopher T.
    Plaut, David C.
    Elman, Jeffrey L.
    [J]. COGNITIVE SCIENCE, 2008, 32 (04) : 741 - 754
  • [6] Large-scale knowledge graph representation learning
    Badrouni, Marwa
    Katar, Chaker
    Inoubli, Wissem
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2024, 66 (09) : 5479 - 5499
  • [7] Effective ensemble learning approach for large-scale medical data analytics
    Lakshmana Rao Namamula
    Daniel Chaytor
    [J]. International Journal of System Assurance Engineering and Management, 2024, 15 : 13 - 20
  • [8] Dynamic Representation Learning for Large-Scale Attributed Networks
    Liu, Zhijun
    Huang, Chao
    Yu, Yanwei
    Song, Peng
    Fan, Baode
    Dong, Junyu
    [J]. CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 1005 - 1014
  • [9] Prototype Memory for Large-Scale Face Representation Learning
    Smirnov, Evgeny
    Garaev, Nikita
    Galyuk, Vasiliy
    Lukyanets, Evgeny
    [J]. IEEE ACCESS, 2022, 10 : 12031 - 12046
  • [10] A Large-Scale Study on Unsupervised Spatiotemporal Representation Learning
    Feichtenhofer, Christoph
    Fan, Haoqi
    Xiong, Bo
    Girshick, Ross
    He, Kaiming
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 3298 - 3308