An inexact quasi-Newton algorithm for large-scale l1 optimization with box constraints

被引:0
|
作者
Cheng, Wanyou [1 ]
Linpeng, Zhuanghan [2 ]
Li, Donghui [3 ]
机构
[1] Dongguan Univ Technol, Coll Comp, Dongguan 523000, Peoples R China
[2] Dongguan Univ Technol, Coll Comp & Sci Technol, Dongguan 523000, Peoples R China
[3] South China Normal Univ, Sch Math Sci, Guangzhou 510620, Guangdong, Peoples R China
关键词
l(1) optimization; Quasi-Newton; Proximity operator; THRESHOLDING ALGORITHM; SHRINKAGE; CONVERGENCE; MATRICES;
D O I
10.1016/j.apnum.2023.07.004
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we develop an inexact quasi-Newton algorithm for l(1)-regularization optimization problems subject to box constraints. The algorithm uses the identification technique of the proximal gradient algorithm to estimate the active set and free variables. To accelerate the convergence, we utilize the inexact quasi-Newton algorithm to update free variables. Under certain conditions, we show that the sequence generated by the algorithm converges R-linearly to a first-order optimality point of the problem. Moreover, the corresponding sequence of objective function values is also linearly convergent. Experiment results demonstrate the competitiveness of the proposed algorithm. (C) 2023 IMACS. Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:179 / 195
页数:17
相关论文
共 50 条
  • [1] A STOCHASTIC QUASI-NEWTON METHOD FOR LARGE-SCALE OPTIMIZATION
    Byrd, R. H.
    Hansen, S. L.
    Nocedal, Jorge
    Singer, Y.
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (02) : 1008 - 1031
  • [2] A quasi-Newton algorithm for large-scale nonlinear equations
    Huang, Linghua
    [J]. JOURNAL OF INEQUALITIES AND APPLICATIONS, 2017,
  • [3] A quasi-Newton algorithm for large-scale nonlinear equations
    Linghua Huang
    [J]. Journal of Inequalities and Applications, 2017
  • [4] Inexact free derivative quasi-Newton method for large-scale nonlinear system of equations
    Arias, C. A.
    Gomez, C.
    [J]. NUMERICAL ALGORITHMS, 2023, 94 (03) : 1103 - 1123
  • [5] Inexact free derivative quasi-Newton method for large-scale nonlinear system of equations
    C. A. Arias
    C. Gómez
    [J]. Numerical Algorithms, 2023, 94 : 1103 - 1123
  • [6] Scaling on Diagonal Quasi-Newton Update for Large-Scale Unconstrained Optimization
    Leong, Wah June
    Farid, Mahboubeh
    Abu Hassan, Malik
    [J]. BULLETIN OF THE MALAYSIAN MATHEMATICAL SCIENCES SOCIETY, 2012, 35 (02) : 247 - 256
  • [7] A Sequential Subspace Quasi-Newton Method for Large-Scale Convex Optimization
    Senov, Aleksandr
    Granichin, Oleg
    Granichina, Olga
    [J]. 2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 3627 - 3632
  • [8] A Stochastic Quasi-Newton Method for Large-Scale Nonconvex Optimization With Applications
    Chen, Huiming
    Wu, Ho-Chun
    Chan, Shing-Chow
    Lam, Wong-Hing
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (11) : 4776 - 4790
  • [9] A subspace limited memory quasi-Newton algorithm for large-scale nonlinear bound constrained optimization
    Ni, Q
    Yuan, Y
    [J]. MATHEMATICS OF COMPUTATION, 1997, 66 (220) : 1509 - 1520
  • [10] COMBINED LP AND QUASI-NEWTON METHODS FOR NONLINEAR L1 OPTIMIZATION
    HALD, J
    MADSEN, K
    [J]. SIAM JOURNAL ON NUMERICAL ANALYSIS, 1985, 22 (01) : 68 - 80