Tight global linear convergence rate bounds for Douglas-Rachford splitting

被引:43
|
作者
Giselsson, Pontus [1 ]
机构
[1] Lund Univ, Dept Automat Control, Box 118, SE-22100 Lund, Sweden
关键词
Douglas-Rachford splitting; Linear convergence; Monotone operators; Fixed-point iterations; ALTERNATING DIRECTION METHOD; PROJECTIONS; MULTIPLIERS; ALGORITHMS; ADMM;
D O I
10.1007/s11784-017-0417-1
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Recently, several authors have shown local and global convergence rate results for Douglas-Rachford splitting under strong monotonicity, Lipschitz continuity, and cocoercivity assumptions. Most of these focus on the convex optimization setting. In the more general monotone inclusion setting, Lions and Mercier showed a linear convergence rate bound under the assumption that one of the two operators is strongly monotone and Lipschitz continuous. We show that this bound is not tight, meaning that no problem from the considered class converges exactly with that rate. In this paper, we present tight global linear convergence rate bounds for that class of problems. We also provide tight linear convergence rate bounds under the assumptions that one of the operators is strongly monotone and cocoercive, and that one of the operators is strongly monotone and the other is cocoercive. All our linear convergence results are obtained by proving the stronger property that the Douglas-Rachford operator is contractive.
引用
收藏
页码:2241 / 2270
页数:30
相关论文
共 50 条
  • [1] Tight Linear Convergence Rate Bounds for Douglas-Rachford Splitting and ADMM
    Giselsson, Pontus
    2015 54TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2015, : 3305 - 3310
  • [2] Tight global linear convergence rate bounds for Douglas–Rachford splitting
    Pontus Giselsson
    Journal of Fixed Point Theory and Applications, 2017, 19 : 2241 - 2270
  • [3] On the convergence rate of Douglas-Rachford operator splitting method
    He, Bingsheng
    Yuan, Xiaoming
    MATHEMATICAL PROGRAMMING, 2015, 153 (02) : 715 - 722
  • [4] DOUGLAS-RACHFORD SPLITTING AND ADMM FOR NONCONVEX OPTIMIZATION: TIGHT CONVERGENCE RESULTS
    Themelis, Andreas
    Patrinos, Panagiotis
    SIAM JOURNAL ON OPTIMIZATION, 2020, 30 (01) : 149 - 181
  • [5] Linear Convergence and Metric Selection for Douglas-Rachford Splitting and ADMM
    Giselsson, Pontus
    Boyd, Stephen
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (02) : 532 - 544
  • [6] Global exponential stability of the Douglas-Rachford splitting dynamics
    Hassan-Moghaddam, Sepideh
    Jovanovic, Mihailo R.
    IFAC PAPERSONLINE, 2020, 53 (02): : 7350 - 7354
  • [7] The rate of linear convergence of the Douglas-Rachford algorithm for subspaces is the cosine of the Friedrichs angle
    Bauschke, Heinz H.
    Cruz, J. Y. Bello
    Nghia, Tran T. A.
    Phan, Hung M.
    Wang, Xianfu
    JOURNAL OF APPROXIMATION THEORY, 2014, 185 : 63 - 79
  • [8] Tight Global Linear Convergence Rate Bounds for Operator Splitting Methods
    Banjac, Goran
    Goulart, Paul J.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (12) : 4126 - 4139
  • [9] ANDERSON ACCELERATED DOUGLAS-RACHFORD SPLITTING
    Fu, Anqi
    Zhang, Junzi
    Boyd, Stephen
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2020, 42 (06): : A3560 - A3583
  • [10] ON WEAK CONVERGENCE OF THE DOUGLAS-RACHFORD METHOD
    Svaiter, B. F.
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2011, 49 (01) : 280 - 287