Complexity of a projected Newton-CG method for optimization with bounds

被引:1
|
作者
Xie, Yue [1 ,2 ]
Wright, Stephen J. [3 ]
机构
[1] Univ Hong Kong, Dept Math, Pokfulam, Hong Kong, Peoples R China
[2] Univ Hong Kong, Musketeers Fdn Inst Data Sci, Pokfulam, Hong Kong, Peoples R China
[3] Univ Wisconsin, Comp Sci Dept, 1210 W Dayton St, Madison, WI 53706 USA
关键词
Nonconvex bound-constrained optimization; Complexity guarantees; Projected gradient method; Newton's method; Conjugate gradient method; NONNEGATIVE MATRIX FACTORIZATION; NONCONVEX OPTIMIZATION; REGULARIZATION; ALGORITHM;
D O I
10.1007/s10107-023-02000-z
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper describes a method for solving smooth nonconvex minimization problems subject to bound constraints with good worst-case complexity guarantees and practical performance. The method contains elements of two existing methods: the classi-cal gradient projection approach for bound-constrained optimization and a recently proposed Newton-conjugate gradient algorithm for unconstrained nonconvex opti-mization. Using a new definition of approximate second-order optimality parametrized by some tolerance E (which is compared with related definitions from previous works), we derive complexity bounds in terms of E for both the number of iterations required and the total amount of computation. The latter is measured by the number of gradient evaluations or Hessian-vector products. We also describe illustrative computational results on several test problems from low-rank matrix optimization.
引用
收藏
页码:107 / 144
页数:38
相关论文
共 50 条
  • [11] TRUST-REGION NEWTON-CG WITH STRONG SECOND-ORDER COMPLEXITY GUARANTEES FOR NONCONVEX OPTIMIZATION
    Curtis, Frank E.
    Robinson, Daniel P.
    Royer, Clement W.
    Wright, Stephen J.
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2021, 31 (01) : 518 - 544
  • [12] A Newton-CG based barrier-augmented Lagrangian method for general nonconvex conic optimization
    He, Chuan
    Huang, Heng
    Lu, Zhaosong
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2024,
  • [13] A smoothing trust-region Newton-CG method for minimax problem
    Ye, Feng
    Liu, Hongwei
    Zhou, Shuisheng
    Liu, Sanyang
    [J]. APPLIED MATHEMATICS AND COMPUTATION, 2008, 199 (02) : 581 - 589
  • [14] A SEMISMOOTH NEWTON-CG METHOD FOR CONSTRAINED PARAMETER IDENTIFICATION IN SEISMIC TOMOGRAPHY
    Boehm, Christian
    Ulbrich, Michael
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2015, 37 (05): : S334 - S364
  • [15] A NEWTON-CG BASED AUGMENTED LAGRANGIAN METHOD FOR FINDING A SECOND-ORDER STATIONARY POINT OF NONCONVEX EQUALITY CONSTRAINED OPTIMIZATION WITH COMPLEXITY GUARANTEES
    He, Chuan
    Lu, Zhaosong
    Pong, Ting Kei
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2023, 33 (03) : 1734 - 1766
  • [16] A Riemannian inexact Newton-CG method for stochastic inverse singular value problems
    Ma, Ru-Ru
    Bai, Zheng-Jian
    [J]. NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2021, 28 (01)
  • [17] An Improved Distributed Dual Newton-CG Method for Convex Quadratic Programming Problems
    Kozma, Attila
    Klintberg, Emil
    Gros, Sebastien
    Diehl, Moritz
    [J]. 2014 AMERICAN CONTROL CONFERENCE (ACC), 2014,
  • [18] An Inexact Accelerated Proximal Gradient Method and a Dual Newton-CG Method for the Maximal Entropy Problem
    Wang, Chengjing
    Xu, Aimin
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2013, 157 (02) : 436 - 450
  • [19] An Inexact Accelerated Proximal Gradient Method and a Dual Newton-CG Method for the Maximal Entropy Problem
    Chengjing Wang
    Aimin Xu
    [J]. Journal of Optimization Theory and Applications, 2013, 157 : 436 - 450
  • [20] A Riemannian inexact Newton-CG method for constructing a nonnegative matrix with prescribed realizable spectrum
    Zhi Zhao
    Zheng-Jian Bai
    Xiao-Qing Jin
    [J]. Numerische Mathematik, 2018, 140 : 827 - 855