Graph embedding clustering: Graph attention auto-encoder with cluster-specificity distribution

被引:19
|
作者
Xu, Huiling [1 ]
Xia, Wei [1 ]
Gao, Quanxue [1 ]
Han, Jungong [3 ]
Gao, Xinbo [2 ,4 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Shaanxi, Peoples R China
[2] Xidian Univ, Sch Elect Engn, Xian 710071, Shaanxi, Peoples R China
[3] Aberystwyth Univ, Comp Sci Dept, Aberystwyth SY23 3FL, Dyfed, Wales
[4] Chongqing Univ Posts & Telecommun, Chongqing Key Lab Image Cognit, Chongqing 400065, Peoples R China
基金
中国国家自然科学基金;
关键词
Nodes clustering; Graph neural networks; Cluster-specificity distribution; NETWORK;
D O I
10.1016/j.neunet.2021.05.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Towards exploring the topological structure of data, numerous graph embedding clustering methods have been developed in recent years, none of them takes into account the cluster-specificity distribution of the nodes representations, resulting in suboptimal clustering performance. Moreover, most existing graph embedding clustering methods execute the nodes representations learning and clustering in two separated steps, which increases the instability of its original performance. Additionally, rare of them simultaneously takes node attributes reconstruction and graph structure reconstruction into account, resulting in degrading the capability of graph learning. In this work, we integrate the nodes representations learning and clustering into a unified framework, and propose a new deep graph attention auto-encoder for nodes clustering that attempts to learn more favorable nodes representations by leveraging self-attention mechanism and node attributes reconstruction. Meanwhile, a cluster-specificity distribution constraint, which is measured by l(1, 2)-norm, is employed to make the nodes representations within the same cluster end up with a common distribution in the dimension space while representations with different clusters have different distributions in the intrinsic dimensions. Extensive experiment results reveal that our proposed method is superior to several state-of-the-art methods in terms of performance. (C) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页码:221 / 230
页数:10
相关论文
共 50 条
  • [1] Embedding Graph Auto-Encoder for Graph Clustering
    Zhang, Hongyuan
    Li, Pei
    Zhang, Rui
    Li, Xuelong
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (11) : 9352 - 9362
  • [2] Self-supervised graph clustering via attention auto-encoder with distribution specificity
    Li, Zishi
    Zhu, Changming
    [J]. MULTIMEDIA SYSTEMS, 2024, 30 (03)
  • [3] Compressing Knowledge Graph Embedding with Relational Graph Auto-encoder
    Zhang, Shiyu
    Zhang, Zhao
    Zhuang, Fuzhen
    Shi, Zhiping
    Han, Xu
    [J]. PROCEEDINGS OF 2020 IEEE 10TH INTERNATIONAL CONFERENCE ON ELECTRONICS INFORMATION AND EMERGENCY COMMUNICATION (ICEIEC 2020), 2020, : 366 - 370
  • [4] Rethinking Graph Auto-Encoder Models for Attributed Graph Clustering
    Mrabah, Nairouz
    Bouguessa, Mohamed
    Touati, Mohamed Fawzi
    Ksantini, Riadh
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (09) : 9037 - 9053
  • [5] Discriminative Auto-Encoder With Local and Global Graph Embedding
    Li, Rui
    Wang, Xiaodan
    Lai, Jie
    Song, Yafei
    Lei, Lei
    [J]. IEEE ACCESS, 2020, 8 : 28614 - 28623
  • [6] GAEAT: Graph Auto-Encoder Attention Networks for Knowledge Graph Completion
    Han, Yanfei
    Fang, Quan
    Hu, Jun
    Qian, Shengsheng
    Xu, Changsheng
    [J]. CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 2053 - 2056
  • [7] Adaptive Graph Auto-Encoder for General Data Clustering
    Li, Xuelong
    Zhang, Hongyuan
    Zhang, Rui
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) : 9725 - 9732
  • [8] A contrastive variational graph auto-encoder for node clustering
    Mrabah, Nairouz
    Bouguessa, Mohamed
    Ksantini, Riadh
    [J]. PATTERN RECOGNITION, 2024, 149
  • [9] GRAPH AUTO-ENCODER FOR GRAPH SIGNAL DENOISING
    Tien Huu Do
    Duc Minh Nguyen
    Deligiannis, Nikos
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 3322 - 3326
  • [10] Towards Faster Deep Graph Clustering via Efficient Graph Auto-Encoder
    Ding, Shifei
    Wu, Benyu
    Ding, Ling
    Xu, Xiao
    Guo, Lili
    Liao, Hongmei
    Wu, Xindong
    [J]. ACM Transactions on Knowledge Discovery from Data, 2024, 18 (08)