Deep clustering based on embedded auto-encoder

被引:12
|
作者
Huang, Xuan [1 ,2 ]
Hu, Zhenlong [3 ,4 ]
Lin, Lin [5 ]
机构
[1] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 610031, Peoples R China
[2] Chengdu Coll Univ Elect Sci & Technol China, Chengdu 611731, Peoples R China
[3] Zhejiang A&F Univ, Jiyang Coll, Zhuji 311800, Zhejiang, Peoples R China
[4] Zhejiang Yuexiu Univ, Shaoxing 312000, Zhejiang, Peoples R China
[5] Chengdu Aeronaut Polytech, Coll Informat Engn, Chengdu 610100, Peoples R China
关键词
Deep clustering; The embedded auto-encoder; Feature representation;
D O I
10.1007/s00500-021-05934-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep clustering is a new research direction that combines deep learning and clustering. It performs feature representation and cluster assignments simultaneously, and its clustering performance is significantly superior to traditional clustering algorithms. The auto-encoder is a neural network model, which can learn the hidden features of the input object to achieve nonlinear dimensionality reduction. This paper proposes the embedded auto-encoder network model; specifically, the auto-encoder is embedded into the encoder unit and the decoder unit of the prototype auto-encoder, respectively. To ensure effectively cluster high-dimensional objects, the encoder of model first encodes the raw features of the input objects, and obtains a cluster-friendly feature representation. Then, in the model training stage, by adding smoothness constraints to the objective function of the encoder, the representation capabilities of the hidden layer coding are significantly improved. Finally, the adaptive self-paced learning threshold is determined according to the median distance between the object and its corresponding the centroid, and the fine-tuning sample of the model is automatically selected. Experimental results on multiple image datasets have shown that our model has fewer parameters, higher efficiency and the comprehensive clustering performance is significantly superior to the state-of-the-art clustering methods.
引用
收藏
页码:1075 / 1090
页数:16
相关论文
共 50 条
  • [1] Deep clustering based on embedded auto-encoder
    Xuan Huang
    Zhenlong Hu
    Lin Lin
    [J]. Soft Computing, 2023, 27 : 1075 - 1090
  • [2] A DEEP CONVOLUTIONAL AUTO-ENCODER WITH EMBEDDED CLUSTERING
    Alqahtani, A.
    Xie, X.
    Deng, J.
    Jones, M. W.
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 4058 - 4062
  • [3] Deep auto-encoder based clustering
    Song, Chunfeng
    Huang, Yongzhen
    Liu, Feng
    Wang, Zhenyu
    Wang, Liang
    [J]. INTELLIGENT DATA ANALYSIS, 2014, 18 : S65 - S76
  • [4] Stacked sparse auto-encoder for deep clustering
    Cai, Jinyu
    Wang, Shiping
    Guo, Wenzhong
    [J]. 2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 1532 - 1538
  • [5] Unsupervised embedded feature learning for deep clustering with stacked sparse auto-encoder
    Cai, Jinyu
    Wang, Shiping
    Guo, Wenzhong
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 186
  • [6] Deep clustering by maximizing mutual information in variational auto-encoder
    Xu, Chaoyang
    Dai, Yuanfei
    Lin, Renjie
    Wang, Shiping
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 205
  • [7] Online deep learning based on auto-encoder
    Zhang, Si-si
    Liu, Jian-wei
    Zuo, Xin
    Lu, Run-kun
    Lian, Si-ming
    [J]. APPLIED INTELLIGENCE, 2021, 51 (08) : 5420 - 5439
  • [8] Online deep learning based on auto-encoder
    Si-si Zhang
    Jian-wei Liu
    Xin Zuo
    Run-kun Lu
    Si-ming Lian
    [J]. Applied Intelligence, 2021, 51 : 5420 - 5439
  • [9] Data Reconstruction Based on Supervised Deep Auto-Encoder
    Rui, Ting
    Zhang, Sai
    Ren, Tongwei
    Tang, Jian
    Zou, Junhua
    [J]. ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2017, PT II, 2018, 10736 : 869 - 879
  • [10] Image retrieval based on auto-encoder and clustering with centroid update
    Bel, K. Nalini Sujantha
    Sam, I. Shatheesh
    [J]. COMPUTER JOURNAL, 2024,