l0-Motivated Low-Rank Sparse Subspace Clustering

被引:62
|
作者
Brbic, Maria [1 ]
Kopriva, Ivica [1 ]
机构
[1] Rudjer Boskovic Inst, Lab Machine Learning & Knowledge Representat, Div Elect, Zagreb 10000, Croatia
关键词
Alternating direction method of multipliers (ADMMs); generalization of the minimax-concave (GMC) penalty; l(0) regularization; low-rank; sparsity; subspace clustering; NONNEGATIVE MATRIX FACTORIZATION; FACE RECOGNITION; P-NORM; CONVERGENCE; ALGORITHM; REPRESENTATION; SEGMENTATION; SELECTION; REGULARIZATION; MODELS;
D O I
10.1109/TCYB.2018.2883566
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In many applications, high-dimensional data points can be well represented by low-dimensional subspaces. To identify the subspaces, it is important to capture a global and local structure of the data which is achieved by imposing low-rank and sparseness constraints on the data representation matrix. In low-rank sparse subspace clustering (LRSSC), nuclear and l(1)-norms are used to measure rank and sparsity. However, the use of nuclear and l(1)-norms leads to an overpenalized problem and only approximates the original problem. In this paper, we propose two l(0) quasi-norm-based regularizations. First, this paper presents regularization based on multivariate generalization of minimax-concave penalty (GMC-LRSSC), which contains the global minimizers of a l(0) quasi-norm regularized objective. Afterward, we introduce the Schatten-0 (S-0) and l(0)-regularized objective and approximate the proximal map of the joint solution using a proximal average method (S-0/l(0)-LRSSC). The resulting nonconvex optimization problems are solved using an alternating direction method of multipliers with established convergence conditions of both algorithms. Results obtained on synthetic and four real-world datasets show the effectiveness of GMC-LRSSC and S-0/l(0)-LRSSC when compared to state-of-the-art methods.
引用
收藏
页码:1711 / 1725
页数:15
相关论文
共 50 条
  • [1] L0-Motivated Low Rank Sparse Subspace Clustering for Hyperspectral Imagery
    Tian, Long
    Du, Qian
    Kopriva, Ivica
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 1038 - 1041
  • [2] Low-Rank and Structured Sparse Subspace Clustering
    Zhang, Junjian
    Li, Chun-Guang
    Zhang, Honggang
    Guo, Jun
    [J]. 2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [3] Low-Rank Sparse Subspace for Spectral Clustering
    Zhu, Xiaofeng
    Zhang, Shichao
    Li, Yonggang
    Zhang, Jilian
    Yang, Lifeng
    Fang, Yue
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2019, 31 (08) : 1532 - 1543
  • [4] Sparse subspace clustering with low-rank transformation
    Xu, Gang
    Yang, Mei
    Wu, Qiufeng
    [J]. NEURAL COMPUTING & APPLICATIONS, 2019, 31 (07): : 3141 - 3154
  • [5] Multimodal sparse and low-rank subspace clustering
    Abavisani, Mahdi
    Patel, Vishal M.
    [J]. INFORMATION FUSION, 2018, 39 : 168 - 177
  • [6] Sparse subspace clustering with low-rank transformation
    Gang Xu
    Mei Yang
    Qiufeng Wu
    [J]. Neural Computing and Applications, 2019, 31 : 3141 - 3154
  • [7] Sparse and low-rank regularized deep subspace clustering
    Zhu, Wenjie
    Peng, Bo
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 204
  • [8] Latent Space Sparse and Low-Rank Subspace Clustering
    Patel, Vishal M.
    Hien Van Nguyen
    Vidal, Rene
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2015, 9 (04) : 691 - 701
  • [9] Low-rank sparse subspace clustering with a clean dictionary
    You, Cong-Zhe
    Shu, Zhen-Qiu
    Fan, Hong-Hui
    [J]. JOURNAL OF ALGORITHMS & COMPUTATIONAL TECHNOLOGY, 2021, 15
  • [10] Low-rank sparse subspace clustering with a clean dictionary
    You, Cong-Zhe
    Shu, Zhen-Qiu
    Fan, Hong-Hui
    [J]. JOURNAL OF ALGORITHMS & COMPUTATIONAL TECHNOLOGY, 2021, 15