An inexact Newton method for nonconvex equality constrained optimization

被引:33
|
作者
Byrd, Richard H. [2 ]
Curtis, Frank E. [1 ]
Nocedal, Jorge [3 ]
机构
[1] Northwestern Univ, Dept Ind Engn & Management Sci, Evanston, IL 60208 USA
[2] Univ Colorado, Dept Comp Sci, Boulder, CO 80309 USA
[3] Northwestern Univ, Dept Elect Engn & Comp Sci, Evanston, IL 60208 USA
基金
美国国家科学基金会;
关键词
Large-scale optimization; Constrained optimization; Nonconvex programming; Inexact linear system solvers; Krylov subspace methods; CONVERGENCE; 2ND-ORDER; ALGORITHM; POINT;
D O I
10.1007/s10107-008-0248-3
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We present a matrix-free line search algorithm for large-scale equality constrained optimization that allows for inexact step computations. For strictly convex problems, the method reduces to the inexact sequential quadratic programming approach proposed by Byrd et al. [SIAM J. Optim. 19(1) 351-369, 2008]. For nonconvex problems, the methodology developed in this paper allows for the presence of negative curvature without requiring information about the inertia of the primal-dual iteration matrix. Negative curvature may arise from second-order information of the problem functions, but in fact exact second derivatives are not required in the approach. The complete algorithm is characterized by its emphasis on sufficient reductions in a model of an exact penalty function. We analyze the global behavior of the algorithm and present numerical results on a collection of test problems.
引用
收藏
页码:273 / 299
页数:27
相关论文
共 50 条
  • [31] An improved inexact Newton's method for unary optimization
    Deng, NY
    Wang, ZZ
    Zhang, JZ
    OPTIMIZATION METHODS & SOFTWARE, 2001, 15 (3-4): : 257 - 282
  • [32] ON THE COMPLEXITY OF AN INEXACT RESTORATION METHOD FOR CONSTRAINED OPTIMIZATION
    Bueno, Luis Felipe
    Martinez, Jose Mario
    SIAM JOURNAL ON OPTIMIZATION, 2020, 30 (01) : 80 - 101
  • [33] An improved inexact Newton's method for unary optimization
    Deng, Naiyang
    Wang, Zhaozhi
    Zhang, Jianzhong
    Optimization Methods and Software, 2002, 15 (3-4) : 257 - 282
  • [34] Stochastic inexact augmented Lagrangian method for nonconvex expectation constrained optimization (vol 87, pg 117, 2024)
    Li, Zichong
    Chen, Pin-Yu
    Liu, Sijia
    Lu, Songtao
    Xu, Yangyang
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2024, : 575 - 578
  • [35] Fast Newton Hard Thresholding Pursuit for Sparsity Constrained Nonconvex Optimization
    Chen, Jinghui
    Gu, Quanquan
    KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, : 757 - 766
  • [36] A truncated SQP algorithm for solving nonconvex equality constrained optimization problems
    Chauvier, L
    Fuduli, A
    Gilbert, JC
    HIGH PERFORMANCE ALGORITHMS AND SOFTWARE FOR NONLINEAR OPTIMIZATION, 2003, 82 : 149 - 176
  • [37] A proximal bundle method-based algorithm with penalty strategy and inexact oracles for constrained nonsmooth nonconvex optimization
    Wang, Xiaoliang
    Pang, Liping
    Xiao, Xiantao
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2023, 422
  • [38] Bundle Method for Nonconvex Nonsmooth Constrained Optimization
    Minh Ngoc Dao
    JOURNAL OF CONVEX ANALYSIS, 2015, 22 (04) : 1061 - 1090
  • [39] A truncated Newton method for constrained optimization
    Di Pillo, G
    Lucidi, S
    Palagi, L
    NONLINEAR OPTIMIZATION AND RELATED TOPICS, 2000, 36 : 79 - 103
  • [40] A STOCHASTIC SEMISMOOTH NEWTON METHOD FOR NONSMOOTH NONCONVEX OPTIMIZATION
    Milzarek, Andre
    Xiao, Xiantao
    Cen, Shicong
    Wen, Zaiwen
    Ulbrich, Michael
    SIAM JOURNAL ON OPTIMIZATION, 2019, 29 (04) : 2916 - 2948