Kurdyka-Lojasiewicz Exponent via Inf-projection

被引:25
|
作者
Yu, Peiran [1 ]
Li, Guoyin [2 ]
Pong, Ting Kei [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Appl Math, Hong Kong, Peoples R China
[2] Univ New South Wales, Dept Appl Math, Sydney, Australia
基金
澳大利亚研究理事会;
关键词
First-order methods; Convergence rate; Kurdyka-Lojasiewicz inequality; Kurdyka-Lojasiewicz exponent; Inf-projection; ERROR-BOUNDS; DESCENT METHODS; OPTIMIZATION; MINIMIZATION; CONVERGENCE; ALGORITHMS; REGULARITY; NONCONVEX;
D O I
10.1007/s10208-021-09528-6
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Kurdyka-Lojasiewicz (KL) exponent plays an important role in estimating the convergence rate of many contemporary first-order methods. In particular, a KL exponent of 1/2 for a suitable potential function is related to local linear convergence. Nevertheless, KL exponent is in general extremely hard to estimate. In this paper, we show under mild assumptions that KL exponent is preserved via inf-projection. Inf-projection is a fundamental operation that is ubiquitous when reformulating optimization problems via the lift-and-project approach. By studying its operation on KL exponent, we show that the KL exponent is 1/2 for several important convex optimization models, including some semidefinite-programming-representable functions and some functions that involve C-2-cone reducible structures, under conditions such as strict complementarity. Our results are applicable to concrete optimization models such as group-fused Lasso and overlapping group Lasso. In addition, for nonconvex models, we show that the KL exponent of many difference-of-convex functions can be derived from that of their natural majorant functions, and the KL exponent of the Bregman envelope of a function is the same as that of the function itself. Finally, we estimate the KL exponent of the sum of the least squares function and the indicator function of the set of matrices of rank at most k.
引用
收藏
页码:1171 / 1217
页数:47
相关论文
共 18 条
  • [1] Deducing Kurdyka-Lojasiewicz exponent via inf-projection
    Department of Applied Mathematics, Hong Kong Polytechnic University, Hong Kong, Hong Kong
    不详
    [J]. arXiv,
  • [2] Kurdyka–Łojasiewicz Exponent via Inf-projection
    Peiran Yu
    Guoyin Li
    Ting Kei Pong
    [J]. Foundations of Computational Mathematics, 2022, 22 : 1171 - 1217
  • [3] On the constrained minimization of smooth Kurdyka-Lojasiewicz functions with the scaled gradient projection method
    Prato, Marco
    Bonettini, Silvia
    Loris, Ignace
    Porta, Federica
    Rebegoldi, Simone
    [J]. 6TH INTERNATIONAL WORKSHOP ON NEW COMPUTATIONAL METHODS FOR INVERSE PROBLEMS, 2016, 756
  • [4] Calculus Rules of the Generalized Concave Kurdyka-Lojasiewicz Property
    Wang, Xianfu
    Wang, Ziyuan
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2023, 197 (03) : 839 - 854
  • [5] Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Lojasiewicz Inequality
    Attouch, Hedy
    Bolte, Jerome
    Redont, Patrick
    Soubeyran, Antoine
    [J]. MATHEMATICS OF OPERATIONS RESEARCH, 2010, 35 (02) : 438 - 457
  • [6] The Exact Modulus of the Generalized Concave Kurdyka-Lojasiewicz Property
    Wang, Xianfu
    Wang, Ziyuan
    [J]. MATHEMATICS OF OPERATIONS RESEARCH, 2022, 47 (04) : 2765 - 2783
  • [7] Kurdyka-Lojasiewicz Property of Zero-Norm Composite Functions
    Wu, Yuqia
    Pan, Shaohua
    Bi, Shujun
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2021, 188 (01) : 94 - 112
  • [8] Sharp Analysis of Stochastic Optimization under Global Kurdyka-Lojasiewicz Inequality
    Fatkhullin, Ilyas
    Etesami, Jalal
    He, Niao
    Kiyavash, Negar
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [9] Sharp Analysis of Stochastic Optimization under Global Kurdyka-Lojasiewicz Inequality
    Fatkhullin, Ilyas
    Etesami, Jalal
    He, Niao
    Kiyavash, Negar
    [J]. arXiv, 2022,
  • [10] Convergence of Linesearch and Trust-Region Methods Using the Kurdyka-Lojasiewicz Inequality
    Noll, Dominikus
    Rondepierre, Aude
    [J]. COMPUTATIONAL AND ANALYTICAL MATHEMATICS: IN HONOR OF JONATHAN BORWEIN'S 60TH BIRTHDAY, 2013, 50 : 593 - 611