Structure enhanced deep clustering network via a weighted neighbourhood auto-encoder

被引:0
|
作者
Bai, Ruina [1 ]
Huang, Ruizhang [1 ]
Zheng, Luyi [1 ]
Chen, Yanping [1 ]
Qin, Yongbin [1 ]
机构
[1] State Key Laboratory of Public Big Data, College of Computer Science and Technology, Guizhou University, Guizhou, Guiyang,550025, China
基金
中国国家自然科学基金;
关键词
Convolutional neural networks - Learning systems - Network coding - Semantic Web - Semantics;
D O I
暂无
中图分类号
学科分类号
摘要
Structural deep clustering involves the use of neural networks for fusing semantic and structural representations for clustering tasks, and it has been receiving increasing attention. In some pioneering works, auto-encoder (AE)-specific representations were integrated with a graph convolutional network (GCN)-specific representation by delivering semantic information to the GCN module layer-by-layer. Although promising performance has been achieved in various applications, we observed that a vital aspect was overlooked in these works: the structural information may vanish in the learning process because of the over-smoothing problem of the GCN module, leading to non-representative features and, thus, deteriorating clustering performance. In this study, we address this issue by proposing a structure enhanced deep clustering network. The GCN-specific structural data representation is enhanced and supervised by its structural information. Specifically, the GCN-specific structural data representation is strengthened during the learning process by combining it with a structure enhanced semantic (SES) representation. A novel structure enhanced AE, named the weighted neighbourhood AE (wNAE), is employed to learn the SES representation for each data sample. Finally, we design a joint supervision strategy to uniformly guide the simultaneous learning of the wNAE and GCN modules and the clustering assignment. Experimental results for different datasets empirically validate the importance of semantic and neighbour-wise structure learning. © 2022 Elsevier Ltd
引用
收藏
页码:144 / 154
相关论文
共 50 条
  • [1] Structure enhanced deep clustering network via a weighted neighbourhood auto-encoder
    Bai, Ruina
    Huang, Ruizhang
    Zheng, Luyi
    Chen, Yanping
    Qin, Yongbin
    [J]. NEURAL NETWORKS, 2022, 155 : 144 - 154
  • [2] Deep auto-encoder based clustering
    Song, Chunfeng
    Huang, Yongzhen
    Liu, Feng
    Wang, Zhenyu
    Wang, Liang
    [J]. INTELLIGENT DATA ANALYSIS, 2014, 18 : S65 - S76
  • [3] A DEEP CONVOLUTIONAL AUTO-ENCODER WITH EMBEDDED CLUSTERING
    Alqahtani, A.
    Xie, X.
    Deng, J.
    Jones, M. W.
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 4058 - 4062
  • [4] Stacked sparse auto-encoder for deep clustering
    Cai, Jinyu
    Wang, Shiping
    Guo, Wenzhong
    [J]. 2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 1532 - 1538
  • [5] Deep clustering based on embedded auto-encoder
    Xuan Huang
    Zhenlong Hu
    Lin Lin
    [J]. Soft Computing, 2023, 27 : 1075 - 1090
  • [6] Deep clustering based on embedded auto-encoder
    Huang, Xuan
    Hu, Zhenlong
    Lin, Lin
    [J]. SOFT COMPUTING, 2023, 27 (02) : 1075 - 1090
  • [7] Towards Faster Deep Graph Clustering via Efficient Graph Auto-Encoder
    Ding, Shifei
    Wu, Benyu
    Ding, Ling
    Xu, Xiao
    Guo, Lili
    Liao, Hongmei
    Wu, Xindong
    [J]. ACM Transactions on Knowledge Discovery from Data, 2024, 18 (08)
  • [8] DEEP AUTO-ENCODER NETWORK FOR HYPERSPECTRAL IMAGE UNMIXING
    Su, Yuanchao
    Li, Jun
    Plaza, Antonio
    Marinoni, Andrea
    Gamba, Paolo
    Huang, Yuancheng
    [J]. IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 6400 - 6403
  • [9] Deep clustering by maximizing mutual information in variational auto-encoder
    Xu, Chaoyang
    Dai, Yuanfei
    Lin, Renjie
    Wang, Shiping
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 205
  • [10] Deep Belief Network and Auto-Encoder for Face Classification
    Bouchra, Nassih
    Aouatif, Amine
    Mohammed, Ngadi
    Nabil, Hmina
    [J]. INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE, 2019, 5 (05): : 22 - 29