Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

被引:0
|
作者
Yaohua Hu
Chong Li
Jinhua Wang
Xiaoqi Yang
Linglingzhi Zhu
机构
[1] Shenzhen University,College of Mathematics and Statistics
[2] Zhejiang University,School of Mathematical Sciences
[3] Hangzhou Normal University,Department of Mathematics
[4] The Hong Kong Polytechnic University,Department of Applied Mathematics
[5] The Chinese University of Hong Kong,Department of Systems Engineering and Engineering Management
来源
关键词
Convex composite optimization; Linearized proximal algorithm; Adaptive stepsize; Quadratic convergence; Convex inclusion problem; Primary 65K05; 49M37; Secondary 90C26;
D O I
暂无
中图分类号
学科分类号
摘要
We propose an inexact linearized proximal algorithm with an adaptive stepsize, together with its globalized version based on the backtracking line-search, to solve a convex composite optimization problem. Under the assumptions of local weak sharp minima of order p(p≥1)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$p\ (p\ge 1)$$\end{document} for the outer convex function and a quasi-regularity condition for the inclusion problem associated to the inner function, we establish superlinear/quadratic convergence results for proposed algorithms. Compared to the linearized proximal algorithms with a constant stepsize proposed in Hu et al. (SIAM J Optim 26(2):1207–1235, 2016), our algorithms own broader applications and higher convergence rates, and the idea of analysis used in the present paper deviates significantly from that of Hu et al. (2016). Numerical applications to the nonnegative inverse eigenvalue problem and the wireless sensor network localization problem indicate that the proposed algorithms are more efficient and robust, and outperform the algorithms in Hu et al. (2016) and some popular algorithms for relevant problems.
引用
收藏
相关论文
共 50 条
  • [1] Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications
    Hu, Yaohua
    Li, Chong
    Wang, Jinhua
    Yang, Xiaoqi
    Zhu, Linglingzhi
    [J]. APPLIED MATHEMATICS AND OPTIMIZATION, 2023, 87 (03):
  • [2] ON CONVERGENCE RATES OF LINEARIZED PROXIMAL ALGORITHMS FOR CONVEX COMPOSITE OPTIMIZATION WITH APPLICATIONS
    Hu, Yaohua
    Li, Chong
    Yang, Xiaoqi
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (02) : 1207 - 1235
  • [3] Decentralized Inexact Proximal Gradient Method With Network-Independent Stepsizes for Convex Composite Optimization
    Guo, Luyao
    Shi, Xinli
    Cao, Jinde
    Wang, Zihao
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 786 - 801
  • [4] Decentralized proximal splitting algorithms for composite constrained convex optimization
    Zheng, Lifeng
    Ran, Liang
    Li, Huaqing
    Feng, Liping
    Wang, Zheng
    Lu, Qingguo
    Xia, Dawen
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2022, 359 (14): : 7482 - 7509
  • [5] FAC (FAST ADAPTIVE COMPOSITE) ALGORITHMS IN CONVEX-OPTIMIZATION
    BOYER, R
    [J]. RAIRO-MATHEMATICAL MODELLING AND NUMERICAL ANALYSIS-MODELISATION MATHEMATIQUE ET ANALYSE NUMERIQUE, 1994, 28 (01): : 95 - 119
  • [6] DOUBLE INERTIAL PROXIMAL GRADIENT ALGORITHMS FOR CONVEX OPTIMIZATION PROBLEMS AND APPLICATIONS
    Kunrada KANKAM
    Prasit CHOLAMJIAK
    [J]. Acta Mathematica Scientia, 2023, 43 (03) : 1462 - 1476
  • [7] Double Inertial Proximal Gradient Algorithms for Convex Optimization Problems and Applications
    Kankam, Kunrada
    Cholamjiak, Prasit
    [J]. ACTA MATHEMATICA SCIENTIA, 2023, 43 (03) : 1462 - 1476
  • [8] Double Inertial Proximal Gradient Algorithms for Convex Optimization Problems and Applications
    Kunrada Kankam
    Prasit Cholamjiak
    [J]. Acta Mathematica Scientia, 2023, 43 : 1462 - 1476
  • [9] Fast proximal algorithms for nonsmooth convex optimization
    Ouorou, Adam
    [J]. OPERATIONS RESEARCH LETTERS, 2020, 48 (06) : 777 - 783
  • [10] Composite splitting algorithms for convex optimization
    Huang, Junzhou
    Zhang, Shaoting
    Li, Hongsheng
    Metaxas, Dimitris
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2011, 115 (12) : 1610 - 1622