A Multi-step Inertial Forward-Backward Splitting Method for Non-convex Optimization

被引:0
|
作者
Liang, Jingwei [1 ]
Fadili, Jalal M. [1 ]
Peyre, Gabriel [2 ]
机构
[1] Normandie Univ, ENSICAEN, CNRS, GREYC, Caen, France
[2] CNRS, DMA, ENS Paris, Paris, France
基金
欧洲研究理事会;
关键词
PROXIMAL METHOD; ALGORITHM; CONVERGENCE;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a multi-step inertial Forward-Backward splitting algorithm for minimizing the sum of two non-necessarily convex functions, one of which is proper lower semi-continuous while the other is differentiable with a Lipschitz continuous gradient. We first prove global convergence of the algorithm with the help of the Kurdyka-Lojasiewicz property. Then, when the non-smooth part is also partly smooth relative to a smooth submanifold, we establish finite identification of the latter and provide sharp local linear convergence analysis. The proposed method is illustrated on several problems arising from statistics and machine learning.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] A Forward-Backward Algorithm With Different Inertial Terms for Structured Non-Convex Minimization Problems
    Laszlo, Szilard Csaba
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2023, 198 (01) : 387 - 427
  • [2] AN INERTIAL FORWARD-BACKWARD SPLITTING METHOD FOR APPROXIMATING SOLUTIONS OF CERTAIN OPTIMIZATION PROBLEMS
    Abass, H. A.
    Aremu, K. O.
    Jolaoso, L. O.
    Mewomo, O. T.
    [J]. JOURNAL OF NONLINEAR FUNCTIONAL ANALYSIS, 2020,
  • [3] Outer reflected forward-backward splitting algorithm with inertial extrapolation step
    Shehu, Yekini
    Jolaoso, Lateef O.
    Okeke, C. C.
    Xu, Renqi
    [J]. OPTIMIZATION, 2024,
  • [4] An Inertial Parallel and Asynchronous Forward-Backward Iteration for Distributed Convex Optimization
    Stathopoulos, Giorgos
    Jones, Colin N.
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2019, 182 (03) : 1088 - 1119
  • [5] The Modified Viscosity Approximation Method with Inertial Technique and Forward-Backward Algorithm for Convex Optimization Model
    Hanjing, Adisak
    Bussaban, Limpapat
    Suantai, Suthep
    [J]. MATHEMATICS, 2022, 10 (07)
  • [6] A Primal-Dual Forward-Backward Splitting Algorithm for Distributed Convex Optimization
    Li, Huaqing
    Su, Enbing
    Wang, Chengbo
    Liu, Jiawei
    Zheng, Zuqing
    Wang, Zheng
    Xia, Dawen
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (01): : 278 - 284
  • [7] Inertial forward-backward splitting method in Banach spaces with application to compressed sensing
    Cholamjiak, Prasit
    Shehu, Yekini
    [J]. APPLICATIONS OF MATHEMATICS, 2019, 64 (04) : 409 - 435
  • [8] An inertial forward-backward splitting method for solving inclusion problems in Hilbert spaces
    Cholamjiak, Watcharaporn
    Cholamjiak, Prasit
    Suantai, Suthep
    [J]. JOURNAL OF FIXED POINT THEORY AND APPLICATIONS, 2018, 20 (01) : 1 - 17
  • [9] Inertial forward-backward splitting method in Banach spaces with application to compressed sensing
    Prasit Cholamjiak
    Yekini Shehu
    [J]. Applications of Mathematics, 2019, 64 : 409 - 435
  • [10] A DYNAMICAL APPROACH TO AN INERTIAL FORWARD-BACKWARD ALGORITHM FOR CONVEX MINIMIZATION
    Attouch, Hedy
    Peypouquet, Juan
    Redont, Patrick
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2014, 24 (01) : 232 - 256