On the convergence of the direct extension of ADMM for three-block separable convex minimization models with one strongly convex function

被引:71
|
作者
Cai, Xingju [1 ]
Han, Deren [1 ]
Yuan, Xiaoming [2 ]
机构
[1] Nanjing Normal Univ, Sch Math Sci, Key Lab NSLSCS Jiangsu Prov, Nanjing 210023, Jiangsu, Peoples R China
[2] Hong Kong Baptist Univ, Dept Math, Hong Kong, Hong Kong, Peoples R China
关键词
Alternating direction method of multipliers; Convergence analysis; Convex programming; Separable structure; LOCAL LINEAR CONVERGENCE; SPLITTING METHOD; LOW-RANK; MULTIPLIERS;
D O I
10.1007/s10589-016-9860-y
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
The alternating direction method of multipliers (ADMM) is a benchmark for solving a two-block linearly constrained convex minimization model whose objective function is the sum of two functions without coupled variables. Meanwhile, it is known that the convergence is not guaranteed if the ADMM is directly extended to a multiple-block convex minimization model whose objective function has more than two functions. Recently, some authors have actively studied the strong convexity condition on the objective function to sufficiently ensure the convergence of the direct extension of ADMM or the resulting convergence when the original scheme is appropriately twisted. We focus on the three-block case of such a model whose objective function is the sum of three functions, and discuss the convergence of the direct extension of ADMM. We show that when one function in the objective is strongly convex, the penalty parameter and the operators in the linear equality constraint are appropriately restricted, it is sufficient to guarantee the convergence of the direct extension of ADMM. We further estimate the worst-case convergence rate measured by the iteration complexity in both the ergodic and nonergodic senses, and derive the globally linear convergence in asymptotical sense under some additional conditions.
引用
收藏
页码:39 / 73
页数:35
相关论文
共 28 条
  • [1] On the convergence of the direct extension of ADMM for three-block separable convex minimization models with one strongly convex function
    Xingju Cai
    Deren Han
    Xiaoming Yuan
    [J]. Computational Optimization and Applications, 2017, 66 : 39 - 73
  • [2] Convergence analysis of the direct extension of ADMM for multiple-block separable convex minimization
    Min Tao
    Xiaoming Yuan
    [J]. Advances in Computational Mathematics, 2018, 44 : 773 - 813
  • [3] Convergence analysis of the direct extension of ADMM for multiple-block separable convex minimization
    Tao, Min
    Yuan, Xiaoming
    [J]. ADVANCES IN COMPUTATIONAL MATHEMATICS, 2018, 44 (03) : 773 - 813
  • [4] On the global and linear convergence of direct extension of ADMM for 3-block separable convex minimization models
    Sun, Huijie
    Wang, Jinjiang
    Deng, Tingquan
    [J]. JOURNAL OF INEQUALITIES AND APPLICATIONS, 2016,
  • [5] On the global and linear convergence of direct extension of ADMM for 3-block separable convex minimization models
    Huijie Sun
    Jinjiang Wang
    Tingquan Deng
    [J]. Journal of Inequalities and Applications, 2016
  • [6] A class of ADMM-based algorithms for three-block separable convex programming
    He, Bingsheng
    Yuan, Xiaoming
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2018, 70 (03) : 791 - 826
  • [7] A class of ADMM-based algorithms for three-block separable convex programming
    Bingsheng He
    Xiaoming Yuan
    [J]. Computational Optimization and Applications, 2018, 70 : 791 - 826
  • [8] A partially isochronous splitting algorithm for three-block separable convex minimization problems
    He, Hongjin
    Hou, Liusheng
    Xu, Hong-Kun
    [J]. ADVANCES IN COMPUTATIONAL MATHEMATICS, 2018, 44 (04) : 1091 - 1115
  • [9] A partially isochronous splitting algorithm for three-block separable convex minimization problems
    Hongjin He
    Liusheng Hou
    Hong-Kun Xu
    [J]. Advances in Computational Mathematics, 2018, 44 : 1091 - 1115
  • [10] A Convergent 3-Block Semi-Proximal ADMM for Convex Minimization Problems with One Strongly Convex Block
    Li, Min
    Sun, Defeng
    Toh, Kim-Chuan
    [J]. ASIA-PACIFIC JOURNAL OF OPERATIONAL RESEARCH, 2015, 32 (04)