Nonconvex Proximal Incremental Aggregated Gradient Method with Linear Convergence

被引:0
|
作者
Wei Peng
Hui Zhang
Xiaoya Zhang
机构
[1] National University of Defense Technology,Department of Mathematics
关键词
Error bound; Linear convergence; Nonconvex; Incremental aggregated gradient; 90C26; 90C06; 90C15;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, we study the proximal incremental aggregated gradient algorithm for minimizing the sum of L-smooth nonconvex component functions and a proper closed convex function. By exploiting the L-smooth property and using an error bound condition, we can show that the method still enjoys some desired linear convergence properties, even for nonconvex minimization. Actually, we show that the generated iterative sequence globally converges to the stationary point set. Moreover, we give an explicit computable stepsize threshold to guarantee that both the objective value and iterative sequences are R-linearly convergent.
引用
收藏
页码:230 / 245
页数:15
相关论文
共 50 条
  • [1] Nonconvex Proximal Incremental Aggregated Gradient Method with Linear Convergence
    Peng, Wei
    Zhang, Hui
    Zhang, Xiaoya
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2019, 183 (01) : 230 - 245
  • [2] Linear convergence of proximal incremental aggregated gradient method for nonconvex nonsmooth minimization problems
    Liu, Y. C.
    Xia, F. Q.
    [J]. APPLICABLE ANALYSIS, 2022, 101 (09) : 3445 - 3464
  • [3] Inertial proximal incremental aggregated gradient method with linear convergence guarantees
    Zhang, Xiaoya
    Peng, Wei
    Zhang, Hui
    [J]. MATHEMATICAL METHODS OF OPERATIONS RESEARCH, 2022, 96 (02) : 187 - 213
  • [4] Inertial proximal incremental aggregated gradient method with linear convergence guarantees
    Xiaoya Zhang
    Wei Peng
    Hui Zhang
    [J]. Mathematical Methods of Operations Research, 2022, 96 : 187 - 213
  • [5] Proximal-Like Incremental Aggregated Gradient Method with Linear Convergence Under Bregman Distance Growth Conditions
    Zhang, Hui
    Dai, Yu-Hong
    Guo, Lei
    Peng, Wei
    [J]. MATHEMATICS OF OPERATIONS RESEARCH, 2021, 46 (01) : 61 - 81
  • [6] GLOBAL CONVERGENCE RATE OF PROXIMAL INCREMENTAL AGGREGATED GRADIENT METHODS
    Vanli, N. D.
    Gurbuzbalaban, M.
    Ozdaglar, A.
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2018, 28 (02) : 1282 - 1300
  • [7] Block-coordinate and incremental aggregated proximal gradient methods for nonsmooth nonconvex problems
    Puya Latafat
    Andreas Themelis
    Panagiotis Patrinos
    [J]. Mathematical Programming, 2022, 193 : 195 - 224
  • [8] Block-coordinate and incremental aggregated proximal gradient methods for nonsmooth nonconvex problems
    Latafat, Puya
    Themelis, Andreas
    Patrinos, Panagiotis
    [J]. MATHEMATICAL PROGRAMMING, 2022, 193 (01) : 195 - 224
  • [9] A DOUBLE INCREMENTAL AGGREGATED GRADIENT METHOD WITH LINEAR CONVERGENCE RATE FOR LARGE-SCALE OPTIMIZATION
    Mokhtari, Aryan
    Gurbuzbalaban, Mert
    Ribeiro, Alejandro
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 4696 - 4700
  • [10] Variable smoothing incremental aggregated gradient method for nonsmooth nonconvex regularized optimization
    Yuncheng Liu
    Fuquan Xia
    [J]. Optimization Letters, 2021, 15 : 2147 - 2164