Self-attention Adversarial Based Deep Subspace Clustering

被引:0
|
作者
Yin M. [1 ]
Wu H.-Y. [1 ]
Xie S.-L. [1 ]
Yang Q.-Y. [1 ]
机构
[1] School of Automation, Guangdong University of Technology, Guangzhou
来源
基金
中国国家自然科学基金;
关键词
Deep learning; Generative adversarial networks; Self-attention model; Subspace clustering;
D O I
10.16383/j.aas.c200302
中图分类号
学科分类号
摘要
Subspace clustering is a popular spectral clustering framework for high-dimensional data. In recent years, deep neural networks are witnessed to effectively mine the features of data, which has attracted the attention from various fields. Deep subspace clustering aims to learn the low-dimensional feature representation of data via the deep network, and subsequently calculate the similarity matrix fed into spectral clustering framework for final clustering result. However, real data are often with too high dimensions and complex data structure. How to obtain a robust data representation and improve clustering performance remains a challenge. Therefore, this paper proposes a deep subspace clustering algorithm (SAADSC) based on the self-attention adversarial mechanism. Specifically, the self-attention adversarial network is developed to impose a priori distribution constraint in the feature learning of the autoencoder to guide the learned feature representation to be more robust, thereby improving clustering accuracy. Through the experiments on multiple datasets, the results show that the proposed algorithm in this paper is superior to the state-of-the-art methods in terms of accuracy rate (ACC) and standard mutual information (NMI). Copyright ©2022 Acta Automatica Sinica. All rights reserved.
引用
收藏
页码:271 / 281
页数:10
相关论文
共 53 条
  • [1] Aggarwal C C., An Introduction to Data Classification, Data Classification: Algorithms and Applications, 125, 3, (2014)
  • [2] RMacQueen J., Some methods for classification and analysis of multivariate observations, Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, 1, 14, pp. 281-297, (1967)
  • [3] Johnson S C., Hierarchical clustering schemes, Psychometrika, 32, 3, pp. 241-254, (1967)
  • [4] Ng A Y, Jordan M I, Weiss Y., On spectral clustering: Analysis and an algorithm, Advances in Neural Information Processing Systems, (2002)
  • [5] Basri R, Jacobs D W., Lambertian reflectance and linear subspaces, IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 2, pp. 218-233, (2003)
  • [6] Agrawal R, Gehrke J, Gunopulos D, Raghavan P., Automatic subspace clustering of high dimensional data, Data Mining and Knowledge Discovery, 11, 1, pp. 5-33, (2005)
  • [7] Wang Wei-Wei, Li Xiao-Ping, Feng Xiang-Chu, Wang Si-Qi, A survey on sparse subspace clustering, Acta Automatica Sinica, 41, 8, pp. 1373-1384, (2015)
  • [8] Bradley P S, Mangasarian O L., K-plane clustering, Journal of Global Optimization, 16, 1, pp. 23-32, (2000)
  • [9] Gear C W., Multibody grouping from motion images, International Journal of Computer Vision, 29, 2, pp. 133-150, (1998)
  • [10] Yang A Y, Rao S R, Ma Y., Robust statistical estimation and segmentation of multiple subspaces, Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06), (2006)