Backward-forward algorithms for structured monotone inclusions in Hilbert spaces

被引:42
|
作者
Attouch, Hedy [1 ]
Peypouquet, Juan [2 ]
Redont, Patrick [1 ]
机构
[1] Univ Montpellier 2, Inst Montpellierain Alexander Grothendieek, IMAG UMR CNRS 5149, Pl Eugene Bataillon, F-34095 Montpellier 5, France
[2] Univ Tecn Federico Santa Maria, Dept Matemat, Ave Espana 1680, Valparaiso, Chile
关键词
Monotone inclusion; Forward backward algorithm; Proximal-gradient method; PROXIMAL POINT ALGORITHM; ITERATION-COMPLEXITY; CONVEX MINIMIZATION; SPLITTING METHOD; EXTRAGRADIENT; CONVERGENCE; OPERATORS; SUM; NONCONVEX;
D O I
10.1016/j.jmaa.2016.06.025
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we study the backward forward algorithm as a splitting method to solve structured monotone inclusions, and convex minimization problems in Hilbert spaces. It has a natural link with the forward backward algorithm and has the same computational complexity, since it involves the same basic blocks, but organized differently. Surprisingly enough, this kind of iteration arises when studying the time discretization of the regularized Newton method for maximally monotone operators. First, we show that these two methods enjoy remarkable involutive relations, which go far beyond the evident inversion of the order in which the forward and backward steps are applied. Next, we establish several convergence properties for both methods, some of which were unknown even for the forward backward algorithm. This brings further insight into this well-known scheme. Finally, we specialize our results to structured convex minimization problems, the gradient projection algorithms, and give a numerical illustration of theoretical interest. (C) 2016 Elsevier Inc. All rights reserved.
引用
收藏
页码:1095 / 1117
页数:23
相关论文
共 50 条
  • [1] Accelerated forward–backward algorithms for structured monotone inclusions
    Paul-Emile Maingé
    André Weng-Law
    [J]. Computational Optimization and Applications, 2024, 88 : 167 - 215
  • [2] Accelerated forward-backward algorithms for structured monotone inclusions
    Mainge, Paul-Emile
    Weng-Law, Andre
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2024, 88 (01) : 167 - 215
  • [3] Newton-Like Dynamics and Forward-Backward Methods for Structured Monotone Inclusions in Hilbert Spaces
    Abbas, B.
    Attouch, H.
    Svaiter, Benar F.
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2014, 161 (02) : 331 - 360
  • [4] Newton-Like Dynamics and Forward-Backward Methods for Structured Monotone Inclusions in Hilbert Spaces
    B. Abbas
    H. Attouch
    Benar F. Svaiter
    [J]. Journal of Optimization Theory and Applications, 2014, 161 : 331 - 360
  • [5] Stochastic relaxed inertial forward-backward-forward splitting for monotone inclusions in Hilbert spaces
    Cui, Shisheng
    Shanbhag, Uday
    Staudigl, Mathias
    Vuong, Phan
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2022, 83 (02) : 465 - 524
  • [6] Stochastic relaxed inertial forward-backward-forward splitting for monotone inclusions in Hilbert spaces
    Shisheng Cui
    Uday Shanbhag
    Mathias Staudigl
    Phan Vuong
    [J]. Computational Optimization and Applications, 2022, 83 : 465 - 524
  • [7] Fast Convergence of Generalized Forward-Backward Algorithms for Structured Monotone Inclusions
    Mainge, Paul-Emile
    [J]. JOURNAL OF CONVEX ANALYSIS, 2022, 29 (03) : 893 - 920
  • [8] Forward–backward–forward algorithms involving two inertial terms for monotone inclusions
    Suthep Suantai
    Papatsara Inkrong
    Prasit Cholamjiak
    [J]. Computational and Applied Mathematics, 2023, 42
  • [9] Convergence of a Relaxed Inertial Forward–Backward Algorithm for Structured Monotone Inclusions
    Hedy Attouch
    Alexandre Cabot
    [J]. Applied Mathematics & Optimization, 2019, 80 : 547 - 598
  • [10] Forward-backward-forward algorithms involving two inertial terms for monotone inclusions
    Suantai, Suthep
    Inkrong, Papatsara
    Cholamjiak, Prasit
    [J]. COMPUTATIONAL & APPLIED MATHEMATICS, 2023, 42 (06):