Structure enhanced deep clustering network via a weighted neighbourhood auto-encoder

被引:0
|
作者
Bai, Ruina [1 ]
Huang, Ruizhang [1 ]
Zheng, Luyi [1 ]
Chen, Yanping [1 ]
Qin, Yongbin [1 ]
机构
[1] State Key Laboratory of Public Big Data, College of Computer Science and Technology, Guizhou University, Guizhou, Guiyang,550025, China
基金
中国国家自然科学基金;
关键词
Convolutional neural networks - Learning systems - Network coding - Semantic Web - Semantics;
D O I
暂无
中图分类号
学科分类号
摘要
Structural deep clustering involves the use of neural networks for fusing semantic and structural representations for clustering tasks, and it has been receiving increasing attention. In some pioneering works, auto-encoder (AE)-specific representations were integrated with a graph convolutional network (GCN)-specific representation by delivering semantic information to the GCN module layer-by-layer. Although promising performance has been achieved in various applications, we observed that a vital aspect was overlooked in these works: the structural information may vanish in the learning process because of the over-smoothing problem of the GCN module, leading to non-representative features and, thus, deteriorating clustering performance. In this study, we address this issue by proposing a structure enhanced deep clustering network. The GCN-specific structural data representation is enhanced and supervised by its structural information. Specifically, the GCN-specific structural data representation is strengthened during the learning process by combining it with a structure enhanced semantic (SES) representation. A novel structure enhanced AE, named the weighted neighbourhood AE (wNAE), is employed to learn the SES representation for each data sample. Finally, we design a joint supervision strategy to uniformly guide the simultaneous learning of the wNAE and GCN modules and the clustering assignment. Experimental results for different datasets empirically validate the importance of semantic and neighbour-wise structure learning. © 2022 Elsevier Ltd
引用
收藏
页码:144 / 154
相关论文
共 50 条
  • [31] Bearing condition monitoring via an unsupervised and enhanced stacked auto-encoder
    Xu, Fan
    Hao, Zhenyu
    Zhou, Chao
    Deng, Yaling
    [J]. JOURNAL OF THE BRAZILIAN SOCIETY OF MECHANICAL SCIENCES AND ENGINEERING, 2024, 46 (06)
  • [32] Automated feature learning using deep convolutional auto-encoder neural network for clustering electroencephalograms into sleep stages
    Prabhudesai, Kedar S.
    Collins, Leslie M.
    Mainsah, Boyla O.
    [J]. 2019 9TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING (NER), 2019, : 937 - 940
  • [33] Deep variational auto-encoder for text classification
    Xie, Lin
    Liu, Genggeng
    Lian, Hongfei
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL CYBER PHYSICAL SYSTEMS (ICPS 2019), 2019, : 737 - 742
  • [34] Online deep learning based on auto-encoder
    Zhang, Si-si
    Liu, Jian-wei
    Zuo, Xin
    Lu, Run-kun
    Lian, Si-ming
    [J]. APPLIED INTELLIGENCE, 2021, 51 (08) : 5420 - 5439
  • [35] Adaptive Graph Auto-Encoder for General Data Clustering
    Li, Xuelong
    Zhang, Hongyuan
    Zhang, Rui
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) : 9725 - 9732
  • [36] Creation of a Deep Convolutional Auto-Encoder in Caffe
    Turchenko, Volodymyr
    Luczak, Artur
    [J]. PROCEEDINGS OF THE 2017 9TH IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT DATA ACQUISITION AND ADVANCED COMPUTING SYSTEMS: TECHNOLOGY AND APPLICATIONS (IDAACS), VOL 2, 2017, : 651 - 659
  • [37] Online deep learning based on auto-encoder
    Si-si Zhang
    Jian-wei Liu
    Xin Zuo
    Run-kun Lu
    Si-ming Lian
    [J]. Applied Intelligence, 2021, 51 : 5420 - 5439
  • [38] Developing a Clustering Structure with Consideration of Cross-Domain Text Classification based on Deep Sparse Auto-encoder
    Guo, Yufan
    Fei, Rong
    Zhang, Kuan
    Tang, Yu
    Hu, Bo
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 2477 - 2483
  • [39] A contrastive variational graph auto-encoder for node clustering
    Mrabah, Nairouz
    Bouguessa, Mohamed
    Ksantini, Riadh
    [J]. PATTERN RECOGNITION, 2024, 149
  • [40] Intelligent Fault Diagnosis of Bearing Using Enhanced Deep Transfer Auto-encoder
    Shao, Haidong
    Zhang, Xiaoyang
    Cheng, Junsheng
    Yang, Yu
    [J]. Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2020, 56 (09): : 84 - 90