ON CONVERGENCE RATES OF LINEARIZED PROXIMAL ALGORITHMS FOR CONVEX COMPOSITE OPTIMIZATION WITH APPLICATIONS

被引:45
|
作者
Hu, Yaohua [1 ]
Li, Chong [2 ]
Yang, Xiaoqi [3 ]
机构
[1] Shenzhen Univ, Coll Math & Stat, Shenzhen 518060, Peoples R China
[2] Zhejiang Univ, Dept Math, Hangzhou 310027, Zhejiang, Peoples R China
[3] Hong Kong Polytech Univ, Dept Appl Math, Kowloon, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
convex composite optimization; linearized proximal algorithm; weak sharp minima; quasi-regularity condition; feasibility problem; sensor network localization; GAUSS-NEWTON METHOD; WEAK SHARP MINIMA; SENSOR NETWORK LOCALIZATION; SUFFICIENT CONDITIONS; 2ND-ORDER;
D O I
10.1137/140993090
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In the present paper, we investigate a linearized proximal algorithm (LPA) for solving a convex composite optimization problem. Each iteration of the LPA is a proximal minimization of the convex composite function with the inner function being linearized at the current iterate. The LPA has the attractive computational advantage that the solution of each subproblem is a singleton, which avoids the difficulty as in the Gauss-Newton method (GNM) of finding a solution with minimum norm among the set of minima of its subproblem, while still maintaining the same local convergence rate as that of the GNM. Under the assumptions of local weak sharp minima of order p (p is an element of[1, 2]) and a quasi-regularity condition, we establish a local superlinear convergence rate for the LPA. We also propose a globalization strategy for the LPA based on a backtracking line-search and an inexact version of the LPA. We further apply the LPA to solve a (possibly nonconvex) feasibility problem, as well as a sensor network localization problem. Our numerical results illustrate that the LPA meets the demand for an efficient and robust algorithm for the sensor network localization problem.
引用
收藏
页码:1207 / 1235
页数:29
相关论文
共 50 条
  • [1] Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications
    Hu, Yaohua
    Li, Chong
    Wang, Jinhua
    Yang, Xiaoqi
    Zhu, Linglingzhi
    [J]. APPLIED MATHEMATICS AND OPTIMIZATION, 2023, 87 (03):
  • [2] Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications
    Yaohua Hu
    Chong Li
    Jinhua Wang
    Xiaoqi Yang
    Linglingzhi Zhu
    [J]. Applied Mathematics & Optimization, 2023, 87
  • [3] Decentralized proximal splitting algorithms for composite constrained convex optimization
    Zheng, Lifeng
    Ran, Liang
    Li, Huaqing
    Feng, Liping
    Wang, Zheng
    Lu, Qingguo
    Xia, Dawen
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2022, 359 (14): : 7482 - 7509
  • [4] Global convergence of a proximal linearized algorithm for difference of convex functions
    Souza, Joao Carlos O.
    Oliveira, Paulo Roberto
    Soubeyran, Antoine
    [J]. OPTIMIZATION LETTERS, 2016, 10 (07) : 1529 - 1539
  • [5] Global convergence of a proximal linearized algorithm for difference of convex functions
    João Carlos O. Souza
    Paulo Roberto Oliveira
    Antoine Soubeyran
    [J]. Optimization Letters, 2016, 10 : 1529 - 1539
  • [6] ON THE CONVERGENCE RATES OF PROXIMAL SPLITTING ALGORITHMS
    Liang, Jingwei
    Fadili, Jalal M.
    Peyre, Gabriel
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 4146 - 4150
  • [7] DOUBLE INERTIAL PROXIMAL GRADIENT ALGORITHMS FOR CONVEX OPTIMIZATION PROBLEMS AND APPLICATIONS
    Kunrada KANKAM
    Prasit CHOLAMJIAK
    [J]. Acta Mathematica Scientia, 2023, 43 (03) : 1462 - 1476
  • [8] Double Inertial Proximal Gradient Algorithms for Convex Optimization Problems and Applications
    Kankam, Kunrada
    Cholamjiak, Prasit
    [J]. ACTA MATHEMATICA SCIENTIA, 2023, 43 (03) : 1462 - 1476
  • [9] Double Inertial Proximal Gradient Algorithms for Convex Optimization Problems and Applications
    Kunrada Kankam
    Prasit Cholamjiak
    [J]. Acta Mathematica Scientia, 2023, 43 : 1462 - 1476
  • [10] On the rate of convergence of the proximal alternating linearized minimization algorithm for convex problems
    Shefi, Ron
    Teboulle, Marc
    [J]. EURO JOURNAL ON COMPUTATIONAL OPTIMIZATION, 2016, 4 (01) : 27 - 46