AN ACCELERATED GRADIENT METHOD FOR NONCONVEX SPARSE SUBSPACE CLUSTERING PROBLEM

被引:0
|
作者
Li, Hongwu [1 ,2 ]
Zhang, Haibin [1 ]
Xiao, Yunhai [3 ]
机构
[1] Beijing Univ Technol, Sch Sci, Beijing 100124, Peoples R China
[2] Nanyang Normal Univ, Sch Math & Stat, Nanyang 473061, Peoples R China
[3] Henan Univ, Ctr Appl Math Henan Prov, Zhengzhou 450046, Peoples R China
来源
PACIFIC JOURNAL OF OPTIMIZATION | 2022年 / 18卷 / 02期
基金
中国国家自然科学基金;
关键词
sparse subspace clustering; nonconvex nonsmooth optimization; accelerated gradient method; Hopkins 155 real datasets; Extended Yale B database; ALGORITHM; SEGMENTATION;
D O I
暂无
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
The sparse subspace clustering problem is to group a set of data into their underlying subspaces and correct the underlying noise simultaneously. It was shown in the recent literature that, the clustering task can be characterized as a block diagonal matrix regularized nonconvex minimization problem. However, this problem is not easy to solve because it contains a nonconvex bilinear function. The earliest method named block diagonal regularization (BDR) only solved a penalized model, but not the original problem itself. The recently algorithm named accelerated block coordinated gradient descent (ABCGD) can solve the original problem efficiently, but its convergence is not given. In this paper, we attempt to use an accelerated gradient method (AGM), and establish its convergence in the sense of converging to a critical point with a certain stepsize policy. We show that closed-form solutions are enjoyed for each subproblem by taking full use of the constraints' structure so that the algorithm is easily implementable. Finally, we do numerical experiments by the using of two real datasets. The numerical results illustrate that the proposed algorithm AGM performs better than BDR and ABCGD evidently.
引用
收藏
页码:265 / 280
页数:16
相关论文
共 50 条
  • [1] Sparse subspace clustering via nonconvex approximation
    Wenhua Dong
    Xiao-Jun Wu
    Josef Kittler
    He-Feng Yin
    [J]. Pattern Analysis and Applications, 2019, 22 : 165 - 176
  • [2] Sparse subspace clustering via nonconvex approximation
    Dong, Wenhua
    Wu, Xiao-Jun
    Kittler, Josef
    Yin, He-Feng
    [J]. PATTERN ANALYSIS AND APPLICATIONS, 2019, 22 (01) : 165 - 176
  • [3] A Nonconvex Implementation of Sparse Subspace Clustering: Algorithm and Convergence Analysis
    Deng, Xiaoge
    Sun, Tao
    Du, Peibing
    Li, Dongsheng
    [J]. IEEE ACCESS, 2020, 8 : 54741 - 54750
  • [4] Accelerated gradient methods for sparse statistical learning with nonconvex penalties
    Yang, Kai
    Asgharian, Masoud
    Bhatnagar, Sahir
    [J]. STATISTICS AND COMPUTING, 2024, 34 (01)
  • [5] Accelerated gradient methods for sparse statistical learning with nonconvex penalties
    Kai Yang
    Masoud Asgharian
    Sahir Bhatnagar
    [J]. Statistics and Computing, 2024, 34
  • [6] Modified conjugate gradient method for solving sparse recovery problem with nonconvex penalty
    Aminifard, Zohre
    Hosseini, Alireza
    Babaie-Kafaki, Saman
    [J]. SIGNAL PROCESSING, 2022, 193
  • [7] Modified conjugate gradient method for solving sparse recovery problem with nonconvex penalty
    Aminifard, Zohre
    Hosseini, Alireza
    Babaie-Kafaki, Saman
    [J]. Signal Processing, 2022, 193
  • [8] Accelerated Gradient Method for Multi-Task Sparse Learning Problem
    Chen, Xi
    Pan, Weike
    Kwok, James T.
    Carbonell, Jaime G.
    [J]. 2009 9TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, 2009, : 746 - +
  • [9] Alternating Direction Method for Sparse Subspace Clustering
    Yang Min
    [J]. 2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 3632 - 3634
  • [10] Accelerated subspace iteration method of solving generalized eigenvalue problem on large sparse matrix
    Lin, Geng-Hao
    Wan, Fu-Lei
    Huang, Ji-Feng
    [J]. Beijing Ligong Daxue Xuebao/Transaction of Beijing Institute of Technology, 2014, 34 : 40 - 43