Diffusion induced graph representation learning

被引:4
|
作者
Li, Fuzhen [1 ,2 ]
Zhu, Zhenfeng [1 ,2 ]
Zhang, Xingxing [1 ,2 ]
Cheng, Jian [3 ]
Zhao, Yao [1 ,2 ]
机构
[1] Beijing Jiaotong Univ, Inst Informat Sci, Beijing 100044, Peoples R China
[2] Beijing Key Lab Adv Informat Sci & Network Techno, Beijing 100044, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph representation learning; Graph embedding; Diffusion model; Auto-encoder; Deep learning; DIMENSIONALITY; DISTRIBUTIONS;
D O I
10.1016/j.neucom.2019.06.012
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nowadays, graph representation learning has aroused a lot of research interest, which aims to learn the latent low-dimensional representations of graph nodes, while preserving the graph structure. Based on the local smooth assumption, some existing methods have achieved significant success. However, although the structure information of data has been taken into consideration, these models fail to capture enough connectivity pattern such as high-order connections. To alleviate this issue, we propose a Graph Diffusion Network (GDN) that can dynamically preserve local and global consistency of graph. More specifically, Graph Diffusion Auto-encoder is utilized as the main framework in GDN to nonlinearly maintain global information volume. Different from simple auto-encoders, the forward propagation in our model is conducted through Graph Diffusion System which can guide the random walk of information flow to sense the high-order local relationships on graph. Furthermore, to discover a customized graph structure that reveals the similarities between nodes, the connection relationship between nodes are refined by learned metrics with the preservation of scale-free property. By the dynamically self-refining on the graph structure, it can be promoted towards learning the intrinsic node representations in a progressive way. Experimental results on node classification tasks demonstrate the effectiveness of the proposed GDN model. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:220 / 229
页数:10
相关论文
共 50 条
  • [1] Directional diffusion models for graph representation learning
    Yang, Run
    Yang, Yuling
    Zhou, Fan
    Sun, Qiang
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [2] Data Representation and Learning with Graph Diffusion-Embedding Networks
    Jiang, Bo
    Lin, Doudou
    Tang, Jin
    Luo, Bin
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10406 - 10415
  • [3] Joint Node Representation Learning and Clustering for Attributed Graph via Graph Diffusion Convolution
    Guo, Yiwei
    Kang, Le
    Wu, Mengqi
    Zhou, Lijuan
    Zhang, Zhihong
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [4] Graph Representation Learning-Guided Diffusion Model for Hyperspectral Change Detection
    Ding, Xinyu
    Qu, Jiahui
    Dong, Wenqian
    Zhang, Tongzhen
    Li, Nan
    Yang, Yufei
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [5] Graph Reconfigurable Pooling for Graph Representation Learning
    Li, Xiaolin
    Xu, Qikui
    Xu, Zhenyu
    Zhang, Hongyan
    Xu, Li
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2024, 12 (01) : 139 - 149
  • [6] Graph Propagation Transformer for Graph Representation Learning
    Chen, Zhe
    Tan, Hao
    Wang, Tao
    Shen, Tianrun
    Lu, Tong
    Peng, Qiuying
    Cheng, Cheng
    Qi, Yue
    [J]. PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 3559 - 3567
  • [7] Topological Graph Representation Learning on Property Graph
    Zhang, Yishuo
    Gao, Daniel
    Cherukuri, Aswani Kumar
    Wang, Lei
    Pan, Shaowei
    Li, Shu
    [J]. KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT (KSEM 2020), PT I, 2020, 12274 : 53 - 64
  • [8] AGCL: Adaptive Graph Contrastive Learning for graph representation learning
    Yu, Jiajun
    Jia, Adele Lu
    [J]. NEUROCOMPUTING, 2024, 566
  • [9] Fuzzy Representation Learning on Graph
    Zhang, Chun-Yang
    Lin, Yue-Na
    Chen, C. L. Philip
    Yao, Hong-Yu
    Cai, Hai-Chun
    Fang, Wu-Peng
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2023, 31 (10) : 3358 - 3370
  • [10] Graph representation learning: a survey
    Chen, Fenxiao
    Wang, Yun-Cheng
    Wang, Bin
    Kuo, C. -C. Jay
    [J]. APSIPA TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING, 2020, 9