Linear Convergence and Metric Selection for Douglas-Rachford Splitting and ADMM

被引:148
|
作者
Giselsson, Pontus [1 ]
Boyd, Stephen [2 ]
机构
[1] Lund Univ, Dept Automat Control, S-22100 Lund, Sweden
[2] Stanford Univ, Dept Elect Engn, Stanford, CA 94305 USA
关键词
Alternating direction method of multipliers (ADMM); Douglas-Rachford splitting; linear convergence; optimization algorithms; ALTERNATING DIRECTION METHOD; ALGORITHMS; MULTIPLIERS; SYSTEMS;
D O I
10.1109/TAC.2016.2564160
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, several convergence rate results for Douglas-Rachford splitting and the alternating direction method of multipliers (ADMM) have been presented in the literature. In this paper, we show global linear convergence rate bounds for Douglas-Rachford splitting and ADMM under strong convexity and smoothness assumptions. We further show that the rate bounds are tight for the class of problems under consideration for all feasible algorithm parameters. For problems that satisfy the assumptions, we show how to select step-size and metric for the algorithm that optimize the derived convergence rate bounds. For problems with a similar structure that do not satisfy the assumptions, we present heuristic step-size and metric selection methods.
引用
收藏
页码:532 / 544
页数:13
相关论文
共 50 条
  • [1] Tight Linear Convergence Rate Bounds for Douglas-Rachford Splitting and ADMM
    Giselsson, Pontus
    [J]. 2015 54TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2015, : 3305 - 3310
  • [2] DOUGLAS-RACHFORD SPLITTING AND ADMM FOR NONCONVEX OPTIMIZATION: TIGHT CONVERGENCE RESULTS
    Themelis, Andreas
    Patrinos, Panagiotis
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2020, 30 (01) : 149 - 181
  • [3] Diagonal Scaling in Douglas-Rachford Splitting and ADMM
    Giselsson, Pontus
    Boyd, Stephen
    [J]. 2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 5033 - 5039
  • [4] Douglas-Rachford splitting and ADMM for pathological convex optimization
    Ryu, Ernest K.
    Liu, Yanli
    Yin, Wotao
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2019, 74 (03) : 747 - 778
  • [5] Accelerated ADMM based on Accelerated Douglas-Rachford Splitting
    Pejcic, Ivan
    Jones, Colin N.
    [J]. 2016 EUROPEAN CONTROL CONFERENCE (ECC), 2016, : 1952 - 1957
  • [6] Anderson Acceleration for Nonconvex ADMM Based on Douglas-Rachford Splitting
    Ouyang, Wenqing
    Peng, Yue
    Yao, Yuxin
    Zhang, Juyong
    Deng, Bailin
    [J]. COMPUTER GRAPHICS FORUM, 2020, 39 (05) : 221 - 239
  • [7] Tight global linear convergence rate bounds for Douglas-Rachford splitting
    Giselsson, Pontus
    [J]. JOURNAL OF FIXED POINT THEORY AND APPLICATIONS, 2017, 19 (04) : 2241 - 2270
  • [8] On the convergence rate of Douglas-Rachford operator splitting method
    He, Bingsheng
    Yuan, Xiaoming
    [J]. MATHEMATICAL PROGRAMMING, 2015, 153 (02) : 715 - 722
  • [9] On Convergence of Heuristics Based on Douglas-Rachford Splitting and ADMM to Minimize Convex Functions over Nonconvex Sets
    Das Gupta, Shuvomoy
    [J]. 2018 56TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2018, : 56 - 63
  • [10] Local Linear Convergence of the ADMM/Douglas-Rachford Algorithms without Strong Convexity and Application to Statistical Imaging
    Aspelmeier, Timo
    Charitha, C.
    Luke, D. Russell
    [J]. SIAM JOURNAL ON IMAGING SCIENCES, 2016, 9 (02): : 842 - 868