Fast Convergence of Generalized Forward-Backward Algorithms for Structured Monotone Inclusions

被引:0
|
作者
Mainge, Paul-Emile [1 ]
机构
[1] Univ Antilles, Schoelcher, Martinique, France
关键词
Nesterov-type algorithm; inertial-type algorithm; global rate of convergence; fast first-order method; relaxation factors; correction term; accelerated proximal algorithm; fixed point problem; PROXIMAL POINT ALGORITHM; THRESHOLDING ALGORITHM; INERTIAL DYNAMICS; SPLITTING METHOD; OPERATOR-THEORY; SUM;
D O I
暂无
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
We develop rapidly convergent forward-backward algorithms for computing zeroes of the sum of finitely many maximally monotone operators. A modification of the classical forward-backward method for two general operators is first considered, by incorporating an inertial term (close to the acceleration techniques introduced by Nesterov), a constant relaxation factor and a correction term. In a Hilbert space setting, we prove the weak convergence to equilibria of the iterates (x(n)), with worst-case rates of O(n(-1)) in terms of both the discrete velocity and the fixed point residual, instead of the classical rates of O(n(-1/2)) established so far for related algorithms. Our procedure is then adapted to more general monotone inclusions and a fast primal-dual algorithm is proposed for solving convex-concave saddle point problems.
引用
收藏
页码:893 / 920
页数:28
相关论文
共 50 条
  • [1] Accelerated forward-backward algorithms for structured monotone inclusions
    Mainge, Paul-Emile
    Weng-Law, Andre
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2024, 88 (01) : 167 - 215
  • [2] Convergence of a Relaxed Inertial Forward-Backward Algorithm for Structured Monotone Inclusions
    Attouch, Hedy
    Cabot, Alexandre
    [J]. APPLIED MATHEMATICS AND OPTIMIZATION, 2019, 80 (03): : 547 - 598
  • [3] Accelerated forward–backward algorithms for structured monotone inclusions
    Paul-Emile Maingé
    André Weng-Law
    [J]. Computational Optimization and Applications, 2024, 88 : 167 - 215
  • [4] On Regularized Forward-Backward Dynamical Systems Associated with Structured Monotone Inclusions
    Pham Ky Anh
    Trinh Ngoc Hai
    [J]. VIETNAM JOURNAL OF MATHEMATICS, 2023, 51 (02) : 545 - 562
  • [5] Strong convergence of inertial forward-backward methods for solving monotone inclusions
    Tan, Bing
    Cho, Sun Young
    [J]. APPLICABLE ANALYSIS, 2022, 101 (15) : 5386 - 5414
  • [6] On Regularized Forward-Backward Dynamical Systems Associated with Structured Monotone Inclusions
    Pham Ky Anh
    Trinh Ngoc Hai
    [J]. Vietnam Journal of Mathematics, 2023, 51 : 545 - 562
  • [7] FORWARD-BACKWARD SPLITTING WITH DEVIATIONS FOR MONOTONE INCLUSIONS
    Sadeghi H.
    Banert S.
    Giselsson P.
    [J]. Applied Set-Valued Analysis and Optimization, 2024, 6 (02): : 113 - 135
  • [8] An Inertial Forward-Backward Algorithm for Monotone Inclusions
    Lorenz, Dirk A.
    Pock, Thomas
    [J]. JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2015, 51 (02) : 311 - 325
  • [9] An Inertial Forward-Backward Algorithm for Monotone Inclusions
    Dirk A. Lorenz
    Thomas Pock
    [J]. Journal of Mathematical Imaging and Vision, 2015, 51 : 311 - 325
  • [10] Stochastic Forward-Backward Splitting for Monotone Inclusions
    Rosasco, Lorenzo
    Villa, Silvia
    Vu, Bang Cong
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2016, 169 (02) : 388 - 406