CONVERGENCE OF INEXACT FORWARD-BACKWARD ALGORITHMS USING THE FORWARD-BACKWARD ENVELOPE

被引:12
|
作者
Bonettini, S. [1 ]
Prato, M. [1 ]
Rebegoldi, S. [2 ]
机构
[1] Univ Modena & Reggio Emilia, Dipartimento Sci Fis Informat & Matemat, Via Campi 213-b, I-41125 Modena, Italy
[2] Univ Modena & Reggio Emilia, Dipartimento Sci Biomed Metab & Neurosci, Via Campi 287, I-41125 Modena, Italy
关键词
forward-backward algorithms; nonconvex optimization; image restoration; PROXIMAL ALGORITHM; GRADIENT METHODS; NONCONVEX; MINIMIZATION; RESTORATION; SPARSITY;
D O I
10.1137/19M1254155
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper deals with a general framework for inexact forward-backward algorithms aimed at minimizing the sum of an analytic function and a lower semicontinuous, subanalytic, convex term. Such a framework relies on an implementable inexactness condition for the computation of the proximal operator and on a linesearch procedure, which is possibly performed whenever a variable metric is allowed into the forward-backward step. The main focus of this work is the convergence of the considered scheme without additional convexity assumptions on the objective function. Toward this aim, we employ the recent concept of forward-backward envelope to define a continuously differentiable surrogate function, which coincides with the objective at its stationary points and satisfies the so-called Kurdyka-Lojasiewicz (KL) property on its domain. We adapt the abstract convergence scheme usually exploited in the KL framework to our inexact forward-backward scheme, prove the convergence of the iterates to a stationary point of the problem, and prove the convergence rates for the function values. Finally, we show the effectiveness and the flexibility of the proposed framework on a large-scale image restoration test problem.
引用
收藏
页码:3069 / 3097
页数:29
相关论文
共 50 条
  • [1] ACCELERATED AND INEXACT FORWARD-BACKWARD ALGORITHMS
    Villa, Silvia
    Salzo, Saverio
    Baldassarre, Luca
    Verri, Alessandro
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2013, 23 (03) : 1607 - 1633
  • [2] CONVERGENCE RATES OF INERTIAL FORWARD-BACKWARD ALGORITHMS
    Attouch, Hedy
    Cabot, Alexandre
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2018, 28 (01) : 849 - 874
  • [3] Convergence rates in forward-backward splitting
    Chen, GHG
    Rockafellar, RT
    [J]. SIAM JOURNAL ON OPTIMIZATION, 1997, 7 (02) : 421 - 444
  • [4] New convergence results for the inexact variable metric forward-backward method
    Bonettini, S.
    Prato, M.
    Rebegoldi, S.
    [J]. APPLIED MATHEMATICS AND COMPUTATION, 2021, 392
  • [5] An abstract convergence framework with application to inertial inexact forward-backward methods
    Bonettini, Silvia
    Ochs, Peter
    Prato, Marco
    Rebegoldi, Simone
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2023, 84 (02) : 319 - 362
  • [6] FORWARD-BACKWARD ASYMMETRIES
    BOHM, M
    HOLLIK, W
    [J]. Z PHYSICS AT LEP 1, VOL 1: STANDARD PHYSICS, 1989, : 203 - 234
  • [7] On the convergence of the forward-backward splitting method with linesearches
    Bello Cruz, Jose Yunier
    Nghia, Tran T. A.
    [J]. OPTIMIZATION METHODS & SOFTWARE, 2016, 31 (06): : 1209 - 1238
  • [8] Fast Convergence of Generalized Forward-Backward Algorithms for Structured Monotone Inclusions
    Mainge, Paul-Emile
    [J]. JOURNAL OF CONVEX ANALYSIS, 2022, 29 (03) : 893 - 920
  • [9] Forward-backward SDEs with reflections
    不详
    [J]. FORWARD-BACKWARD STOCHASTIC DIFFERENTIAL EQUATIONS AND THEIR APPLICATIONS, 1999, 1702 : 169 - 192
  • [10] Extended forward-backward algorithm
    Lassonde, Marc
    Nagesseur, Ludovic
    [J]. JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2013, 403 (01) : 167 - 172