Augmented Lagrangian alternating direction method for matrix separation based on low-rank factorization

被引:198
|
作者
Shen, Y. [1 ]
Wen, Z. [2 ,3 ]
Zhang, Y. [4 ]
机构
[1] Nanjing Univ, Dept Math, Nanjing 210093, Jiangsu, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Math, Shanghai 200240, Peoples R China
[3] Shanghai Jiao Tong Univ, Inst Nat Sci, Shanghai 200240, Peoples R China
[4] Rice Univ, Dept Computat & Appl Math, Houston, TX 77005 USA
来源
OPTIMIZATION METHODS & SOFTWARE | 2014年 / 29卷 / 02期
基金
美国国家科学基金会;
关键词
matrix separation; alternating direction method; augmented Lagrangian function; ROBUST UNCERTAINTY PRINCIPLES; THRESHOLDING ALGORITHM; MINIMIZATION; DECOMPOSITION;
D O I
10.1080/10556788.2012.700713
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The matrix separation problem aims to separate a low-rank matrix and a sparse matrix from their sum. This problem has recently attracted considerable research attention due to its wide range of potential applications. Nuclear-norm minimization models have been proposed for matrix separation and proved to yield exact separations under suitable conditions. These models, however, typically require the calculation of a full or partial singular value decomposition at every iteration that can become increasingly costly as matrix dimensions and rank grow. To improve scalability, in this paper, we propose and investigate an alternative approach based on solving a non-convex, low-rank factorization model by an augmented Lagrangian alternating direction method. Numerical studies indicate that the effectiveness of the proposed model is limited to problems where the sparse matrix does not dominate the low-rank one in magnitude, though this limitation can be alleviated by certain data pre-processing techniques. On the other hand, extensive numerical results show that, within its applicability range, the proposed method in general has a much faster solution speed than nuclear-norm minimization algorithms and often provides better recoverability.
引用
收藏
页码:239 / 263
页数:25
相关论文
共 50 条
  • [1] Augmented Lagrangian alternating direction method for low-rank minimization via non-convex approximation
    Chen, Yongyong
    Wang, Yongli
    Li, Mingqiang
    He, Guoping
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2017, 11 (07) : 1271 - 1278
  • [2] Augmented Lagrangian alternating direction method for low-rank minimization via non-convex approximation
    Yongyong Chen
    Yongli Wang
    Mingqiang Li
    Guoping He
    [J]. Signal, Image and Video Processing, 2017, 11 : 1271 - 1278
  • [3] An augmented Lagrangian alternating direction method for overlapping community detection based on symmetric nonnegative matrix factorization
    Hu, Liying
    Guo, Gongde
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2020, 11 (02) : 403 - 415
  • [4] An augmented Lagrangian alternating direction method for overlapping community detection based on symmetric nonnegative matrix factorization
    Liying Hu
    Gongde Guo
    [J]. International Journal of Machine Learning and Cybernetics, 2020, 11 : 403 - 415
  • [5] An Approximate Augmented Lagrangian Method for Nonnegative Low-Rank Matrix Approximation
    Zhu, Hong
    Ng, Michael K.
    Song, Guang-Jing
    [J]. JOURNAL OF SCIENTIFIC COMPUTING, 2021, 88 (02)
  • [6] An Approximate Augmented Lagrangian Method for Nonnegative Low-Rank Matrix Approximation
    Hong Zhu
    Michael K. Ng
    Guang-Jing Song
    [J]. Journal of Scientific Computing, 2021, 88
  • [7] SPARSE AND LOW-RANK MATRIX DECOMPOSITION VIA ALTERNATING DIRECTION METHOD
    Yuan, Xiaoming
    Yang, Junfeng
    [J]. PACIFIC JOURNAL OF OPTIMIZATION, 2013, 9 (01): : 167 - 180
  • [8] Correction to: An Approximate Augmented Lagrangian Method for Nonnegative Low-Rank Matrix Approximation
    Hong Zhu
    Michael K. Ng
    Guang-Jing Song
    [J]. Journal of Scientific Computing, 2022, 90
  • [9] Low-rank generalized alternating direction implicit iteration method for solving matrix equations
    Zhang, Juan
    Xun, Wenlu
    [J]. COMPUTATIONAL & APPLIED MATHEMATICS, 2024, 43 (04):
  • [10] A DECOMPOSITION AUGMENTED LAGRANGIAN METHOD FOR LOW-RANK SEMIDEFINITE PROGRAMMING
    Wang, Yifei
    Deng, Kangkang
    Liu, Haoyang
    Wen, Zaiwen
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2023, 33 (03) : 1361 - 1390