ANDERSON ACCELERATED DOUGLAS-RACHFORD SPLITTING

被引:34
|
作者
Fu, Anqi [1 ]
Zhang, Junzi [2 ]
Boyd, Stephen [1 ]
机构
[1] Stanford Univ, Dept Elect Engn, Stanford, CA 94305 USA
[2] Stanford Univ, ICME, Palo Alto, CA 94304 USA
来源
SIAM JOURNAL ON SCIENTIFIC COMPUTING | 2020年 / 42卷 / 06期
关键词
Anderson acceleration; nonsmooth convex optimization; parallel and distributed optimization; proximal oracles; stabilization; global convergence; pathological settings; ALTERNATING DIRECTION METHOD; CONVERGENCE; OPTIMIZATION; ALGORITHM; EQUATIONS;
D O I
10.1137/19M1290097
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider the problem of nonsmooth convex optimization with linear equality constraints, where the objective function is only accessible through its proximal operator. This problem arises in many different fields such as statistical learning, computational imaging, telecommunications, and optimal control. To solve it, we propose an Anderson accelerated Douglas-Rachford splitting (A2DR) algorithm, which we show either globally converges or provides a certificate of infeasibility/unboundedness under very mild conditions. Applied to a block separable objective, A2DR partially decouples so that its steps may be carried out in parallel, yielding an algorithm that is fast and scalable to multiple processors. We describe an open-source implementation and demonstrate its performance on a wide range of examples.
引用
收藏
页码:A3560 / A3583
页数:24
相关论文
共 50 条
  • [1] Accelerated ADMM based on Accelerated Douglas-Rachford Splitting
    Pejcic, Ivan
    Jones, Colin N.
    [J]. 2016 EUROPEAN CONTROL CONFERENCE (ECC), 2016, : 1952 - 1957
  • [2] Douglas-Rachford Splitting: Complexity Estimates and Accelerated Variants
    Patrinos, Panagiotis
    Stella, Lorenzo
    Bemporad, Alberto
    [J]. 2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 4234 - 4239
  • [3] Anderson Acceleration for Nonconvex ADMM Based on Douglas-Rachford Splitting
    Ouyang, Wenqing
    Peng, Yue
    Yao, Yuxin
    Zhang, Juyong
    Deng, Bailin
    [J]. COMPUTER GRAPHICS FORUM, 2020, 39 (05) : 221 - 239
  • [4] An accelerated variance reducing stochastic method with Douglas-Rachford splitting
    Jingchang Liu
    Linli Xu
    Shuheng Shen
    Qing Ling
    [J]. Machine Learning, 2019, 108 : 859 - 878
  • [5] An accelerated variance reducing stochastic method with Douglas-Rachford splitting
    Liu, Jingchang
    Xu, Linli
    Shen, Shuheng
    Ling, Qing
    [J]. MACHINE LEARNING, 2019, 108 (05) : 859 - 878
  • [6] Shadow Douglas-Rachford Splitting for Monotone Inclusions
    Csetnek, Ernoe Robert
    Malitsky, Yura
    Tam, Matthew K.
    [J]. APPLIED MATHEMATICS AND OPTIMIZATION, 2019, 80 (03): : 665 - 678
  • [7] Douglas-Rachford splitting method for semidefinite programming
    Dong Y.
    [J]. Journal of Applied Mathematics and Computing, 2016, 51 (1-2) : 569 - 591
  • [8] Diagonal Scaling in Douglas-Rachford Splitting and ADMM
    Giselsson, Pontus
    Boyd, Stephen
    [J]. 2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 5033 - 5039
  • [9] Removing Multiplicative Noise by Douglas-Rachford Splitting Methods
    G. Steidl
    T. Teuber
    [J]. Journal of Mathematical Imaging and Vision, 2010, 36 : 168 - 184
  • [10] Removing Multiplicative Noise by Douglas-Rachford Splitting Methods
    Steidl, G.
    Teuber, T.
    [J]. JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2010, 36 (02) : 168 - 184