An inexact quasi-Newton algorithm for large-scale l1 optimization with box constraints

被引:0
|
作者
Cheng, Wanyou [1 ]
Linpeng, Zhuanghan [2 ]
Li, Donghui [3 ]
机构
[1] Dongguan Univ Technol, Coll Comp, Dongguan 523000, Peoples R China
[2] Dongguan Univ Technol, Coll Comp & Sci Technol, Dongguan 523000, Peoples R China
[3] South China Normal Univ, Sch Math Sci, Guangzhou 510620, Guangdong, Peoples R China
关键词
l(1) optimization; Quasi-Newton; Proximity operator; THRESHOLDING ALGORITHM; SHRINKAGE; CONVERGENCE; MATRICES;
D O I
10.1016/j.apnum.2023.07.004
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we develop an inexact quasi-Newton algorithm for l(1)-regularization optimization problems subject to box constraints. The algorithm uses the identification technique of the proximal gradient algorithm to estimate the active set and free variables. To accelerate the convergence, we utilize the inexact quasi-Newton algorithm to update free variables. Under certain conditions, we show that the sequence generated by the algorithm converges R-linearly to a first-order optimality point of the problem. Moreover, the corresponding sequence of objective function values is also linearly convergent. Experiment results demonstrate the competitiveness of the proposed algorithm. (C) 2023 IMACS. Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:179 / 195
页数:17
相关论文
共 50 条
  • [21] Quasi-Newton algorithms for large-scale nonlinear least-squares
    Al-Baali, M
    [J]. HIGH PERFORMANCE ALGORITHMS AND SOFTWARE FOR NONLINEAR OPTIMIZATION, 2003, 82 : 1 - 21
  • [22] A Class of Diagonal Quasi-Newton Methods for Large-Scale Convex Minimization
    Leong, Wah June
    [J]. BULLETIN OF THE MALAYSIAN MATHEMATICAL SCIENCES SOCIETY, 2016, 39 (04) : 1659 - 1672
  • [23] A Class of Diagonal Quasi-Newton Methods for Large-Scale Convex Minimization
    Wah June Leong
    [J]. Bulletin of the Malaysian Mathematical Sciences Society, 2016, 39 : 1659 - 1672
  • [24] An Active-Set Proximal-Newton Algorithm for l1 Regularized Optimization Problems with Box Constraints
    Shen, Chungen
    Xue, Wenjuan
    Zhang, Lei-Hong
    Wang, Baiyun
    [J]. JOURNAL OF SCIENTIFIC COMPUTING, 2020, 85 (03)
  • [25] An Overview of Stochastic Quasi-Newton Methods for Large-Scale Machine Learning
    Guo, Tian-De
    Liu, Yan
    Han, Cong-Ying
    [J]. JOURNAL OF THE OPERATIONS RESEARCH SOCIETY OF CHINA, 2023, 11 (02) : 245 - 275
  • [26] An Overview of Stochastic Quasi-Newton Methods for Large-Scale Machine Learning
    Tian-De Guo
    Yan Liu
    Cong-Ying Han
    [J]. Journal of the Operations Research Society of China, 2023, 11 : 245 - 275
  • [27] Preconditioning On Subspace Quasi-Newton Method For Large Scale Unconstrained Optimization
    Sim, Hong Seng
    Leong, Wah June
    Ismail, Fudziah
    [J]. STATISTICS AND OPERATIONAL RESEARCH INTERNATIONAL CONFERENCE (SORIC 2013), 2014, 1613 : 297 - 305
  • [28] Limited memory quasi-Newton methods for problems with box constraints
    Pytlak, R.
    Tarnawski, T.
    [J]. 2007 AMERICAN CONTROL CONFERENCE, VOLS 1-13, 2007, : 2450 - 2455
  • [29] A PARALLEL QUASI-NEWTON ALGORITHM FOR UNCONSTRAINED OPTIMIZATION
    CHEN, Z
    FEI, P
    ZHENG, H
    [J]. COMPUTING, 1995, 55 (02) : 125 - 133
  • [30] STRUCTURED QUASI-NEWTON METHODS FOR OPTIMIZATION WITH ORTHOGONALITY CONSTRAINTS
    Hu, Jiang
    Jiang, Bo
    Lin, Lin
    Wen, Zaiwen
    Yuan, Ya-Xiang
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2019, 41 (04): : A2239 - A2269