Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

被引:0
|
作者
Yaohua Hu
Chong Li
Jinhua Wang
Xiaoqi Yang
Linglingzhi Zhu
机构
[1] Shenzhen University,College of Mathematics and Statistics
[2] Zhejiang University,School of Mathematical Sciences
[3] Hangzhou Normal University,Department of Mathematics
[4] The Hong Kong Polytechnic University,Department of Applied Mathematics
[5] The Chinese University of Hong Kong,Department of Systems Engineering and Engineering Management
来源
关键词
Convex composite optimization; Linearized proximal algorithm; Adaptive stepsize; Quadratic convergence; Convex inclusion problem; Primary 65K05; 49M37; Secondary 90C26;
D O I
暂无
中图分类号
学科分类号
摘要
We propose an inexact linearized proximal algorithm with an adaptive stepsize, together with its globalized version based on the backtracking line-search, to solve a convex composite optimization problem. Under the assumptions of local weak sharp minima of order p(p≥1)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$p\ (p\ge 1)$$\end{document} for the outer convex function and a quasi-regularity condition for the inclusion problem associated to the inner function, we establish superlinear/quadratic convergence results for proposed algorithms. Compared to the linearized proximal algorithms with a constant stepsize proposed in Hu et al. (SIAM J Optim 26(2):1207–1235, 2016), our algorithms own broader applications and higher convergence rates, and the idea of analysis used in the present paper deviates significantly from that of Hu et al. (2016). Numerical applications to the nonnegative inverse eigenvalue problem and the wireless sensor network localization problem indicate that the proposed algorithms are more efficient and robust, and outperform the algorithms in Hu et al. (2016) and some popular algorithms for relevant problems.
引用
收藏
相关论文
共 50 条
  • [31] Inexact proximal stochastic gradient method for convex composite optimization
    Wang, Xiao
    Wang, Shuxiong
    Zhang, Hongchao
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2017, 68 (03) : 579 - 618
  • [32] An Asynchronous Distributed Proximal Gradient Method for Composite Convex Optimization
    Aybat, N. S.
    Wang, Z.
    Iyengar, G.
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 2454 - 2462
  • [33] A NOTE ON THE (ACCELERATED) PROXIMAL GRADIENT METHOD FOR COMPOSITE CONVEX OPTIMIZATION
    Li, Qingjing
    Tan, Li
    Guo, Ke
    [J]. JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2022, 23 (12) : 2847 - 2857
  • [34] Distributed Linearized Alternating Direction Method of Multipliers for Composite Convex Consensus Optimization
    Aybat, N. S.
    Wang, Z.
    Lin, T.
    Ma, S.
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (01) : 5 - 20
  • [35] A class of customized proximal point algorithms for linearly constrained convex optimization
    Feng Ma
    Mingfang Ni
    [J]. Computational and Applied Mathematics, 2018, 37 : 896 - 911
  • [36] A class of customized proximal point algorithms for linearly constrained convex optimization
    Ma, Feng
    Ni, Mingfang
    [J]. COMPUTATIONAL & APPLIED MATHEMATICS, 2018, 37 (02): : 896 - 911
  • [37] Proximal point algorithms for nonsmooth convex optimization with fixed point constraints
    Iiduka, Hideaki
    [J]. EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2016, 253 (02) : 503 - 513
  • [38] Convex Optimization and its Applications in Robust Adaptive Beamforming
    Yu, Z. L.
    Gu, Z.
    Ser, W.
    Er, M. H.
    [J]. 2013 9TH INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATIONS AND SIGNAL PROCESSING (ICICS), 2013,
  • [39] Golden Ratio Proximal Gradient ADMM for Distributed Composite Convex Optimization
    Yin, Chao
    Yang, Junfeng
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 200 (03) : 895 - 922
  • [40] Adaptive Mirror Descent Algorithms for Convex and Strongly Convex Optimization Problems with Functional Constraints
    Stonyakin F.S.
    Alkousa M.
    Stepanov A.N.
    Titov A.A.
    [J]. Journal of Applied and Industrial Mathematics, 2019, 13 (03) : 557 - 574