A proximal partially parallel splitting method for separable convex programs

被引:10
|
作者
Wang, Kai [1 ]
Desai, Jitamitra [1 ]
He, Hongjin [2 ]
机构
[1] Nanyang Technol Univ, Sch Mech & Aerosp Engn, Singapore 639798, Singapore
[2] Hangzhou Dianzi Univ, Sch Sci, Dept Math, Hangzhou 310018, Zhejiang, Peoples R China
来源
OPTIMIZATION METHODS & SOFTWARE | 2017年 / 32卷 / 01期
关键词
augmented Lagrangian method; partially parallel splitting algorithm; separable convex programs; robust PCA problem; global convergence; convergence rate; ALTERNATING DIRECTION METHOD; AUGMENTED LAGRANGIAN METHOD; JACOBIAN DECOMPOSITION; MINIMIZATION PROBLEMS; CONVERGENCE; MULTIPLIERS; RANK;
D O I
10.1080/10556788.2016.1200044
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we propose a proximal partially parallel splitting method for solving convex minimization problems, where the objective function is separable into m individual operators without any coupled variables, and the structural constraint set comprises only linear functions. At each iteration of this algorithm, one selected subproblem is solved, and subsequently the remaining subproblems are solved in parallel, utilizing the new iterate information. Hence, the proposed method is a hybrid mechanism that combines the nice features of parallel decomposition methods and alternating direction methods, while simultaneously adopting the predictor-corrector strategy to ensure convergence of the algorithm. Our algorithmic framework is also amenable to admitting linearized versions of the subproblems, which frequently have closed-form solutions, thereby making the proposed method more implementable in practice. Furthermore, the worst-case convergence rate of the proposed method is obtained under both ergodic and nonergodic conditions. The efficiency of the proposed algorithm is also demonstrated by solving several instances of the robust PCA problem.
引用
收藏
页码:39 / 68
页数:30
相关论文
共 50 条
  • [1] A Parallel Splitting Method for Separable Convex Programs
    Wang, K.
    Han, D. R.
    Xu, L. L.
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2013, 159 (01) : 138 - 158
  • [2] A Parallel Splitting Method for Separable Convex Programs
    K. Wang
    D. R. Han
    L. L. Xu
    [J]. Journal of Optimization Theory and Applications, 2013, 159 : 138 - 158
  • [3] A proximal fully parallel splitting method with a relaxation factor for separable convex programming
    Yin, Jianghua
    Jian, Jinbao
    Jiang, Xianzhen
    Wu, Jiansheng
    Ma, Guodong
    [J]. APPLIED NUMERICAL MATHEMATICS, 2024, 195 : 17 - 38
  • [4] Improved proximal ADMM with partially parallel splitting for multi-block separable convex programming
    Min Sun
    Hongchun Sun
    [J]. Journal of Applied Mathematics and Computing, 2018, 58 : 151 - 181
  • [5] Improved proximal ADMM with partially parallel splitting for multi-block separable convex programming
    Sun, Min
    Sun, Hongchun
    [J]. JOURNAL OF APPLIED MATHEMATICS AND COMPUTING, 2018, 58 (1-2) : 151 - 181
  • [6] A Partially Parallel Prediction-Correction Splitting Method for Convex Optimization Problems with Separable Structure
    Bai F.-S.
    Xu L.
    [J]. Journal of the Operations Research Society of China, 2017, 5 (4) : 529 - 544
  • [7] A partially parallel splitting method for multiple-block separable convex programming with applications to robust PCA
    Hou, Liusheng
    He, Hongjin
    Yang, Junfeng
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2016, 63 (01) : 273 - 303
  • [8] A partially parallel splitting method for multiple-block separable convex programming with applications to robust PCA
    Liusheng Hou
    Hongjin He
    Junfeng Yang
    [J]. Computational Optimization and Applications, 2016, 63 : 273 - 303
  • [9] Linearized alternating direction method with parallel splitting and adaptive penalty for separable convex programs in machine learning
    Lin, Zhouchen
    Liu, Risheng
    Li, Huan
    [J]. MACHINE LEARNING, 2015, 99 (02) : 287 - 325
  • [10] Linearized alternating direction method with parallel splitting and adaptive penalty for separable convex programs in machine learning
    Zhouchen Lin
    Risheng Liu
    Huan Li
    [J]. Machine Learning, 2015, 99 : 287 - 325