Convergence rates for an inertial algorithm of gradient type associated to a smooth non-convex minimization

被引:0
|
作者
Szilárd Csaba László
机构
[1] Technical University of Cluj-Napoca,Department of Mathematics
来源
Mathematical Programming | 2021年 / 190卷
关键词
inertial algorithm; Non-convex optimization; Kurdyka–Łojasiewicz inequality; Convergence rate; Łojasiewicz exponent; 90C26; 90C30; 65K10;
D O I
暂无
中图分类号
学科分类号
摘要
We investigate an inertial algorithm of gradient type in connection with the minimization of a non-convex differentiable function. The algorithm is formulated in the spirit of Nesterov’s accelerated convex gradient method. We prove some abstract convergence results which applied to our numerical scheme allow us to show that the generated sequences converge to a critical point of the objective function, provided a regularization of the objective function satisfies the Kurdyka–Łojasiewicz property. Further, we obtain convergence rates for the generated sequences and the objective function values formulated in terms of the Łojasiewicz exponent of a regularization of the objective function. Finally, some numerical experiments are presented in order to compare our numerical scheme and some algorithms well known in the literature.
引用
收藏
页码:285 / 329
页数:44
相关论文
共 50 条
  • [21] Non-smooth Non-convex Bregman Minimization: Unification and New Algorithms
    Ochs, Peter
    Fadili, Jalal
    Brox, Thomas
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2019, 181 (01) : 244 - 278
  • [22] Inertial Block Proximal Methods For Non-Convex Non-Smooth Optimization
    Le Thi Khanh Hien
    Gillis, Nicolas
    Patrinos, Panagiotis
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [23] Relaxed Majorization-Minimization for Non-Smooth and Non-Convex Optimization
    Xu, Chen
    Lin, Zhouchen
    Zhao, Zhenyu
    Zha, Hongbin
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 812 - 818
  • [24] Convergence guarantees for a class of non-convex and non-smooth optimization problems
    Khamaru, Koulik
    Wainwright, Martin J.
    Journal of Machine Learning Research, 2019, 20
  • [25] Convergence Rates of Non-Convex Stochastic Gradient Descent Under a Generic Lojasiewicz Condition and Local Smoothness
    Scaman, Kevin
    Malherbe, Cédric
    Dos Santos, Ludovic
    Proceedings of Machine Learning Research, 2022, 162 : 19310 - 19327
  • [26] Convergence Rates of Non-Convex Stochastic Gradient Descent Under a Generic Lojasiewicz Condition and Local Smoothness
    Scaman, Kevin
    Malherbe, Cedric
    Dos Santos, Ludovic
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022, : 19310 - 19327
  • [27] Convergence guarantees for a class of non-convex and non-smooth optimization problems
    Khamaru, Koulik
    Wainwright, Martin J.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20
  • [28] Convergence guarantees for a class of non-convex and non-smooth optimization problems
    Khamaru, Koulik
    Wainwright, Martin J.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [29] Inertial alternating direction method of multipliers for non-convex non-smooth optimization
    Le Thi Khanh Hien
    Duy Nhat Phan
    Nicolas Gillis
    Computational Optimization and Applications, 2022, 83 : 247 - 285