A new regularized quasi-Newton method for unconstrained optimization

被引:4
|
作者
Zhang, Hao [1 ,2 ]
Ni, Qin [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Sci, Nanjing 210016, Jiangsu, Peoples R China
[2] Nanjing Agr Univ, Coll Engn, Nanjing 210031, Jiangsu, Peoples R China
关键词
Unconstrained optimization; Regularized quasi-Newton method; Non-monotone line search; LIMITED-MEMORY; LINE SEARCH; ALGORITHM; MATRICES;
D O I
10.1007/s11590-018-1236-z
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper, we propose a new regularized quasi-Newton method for unconstrained optimization. At each iteration, a regularized quasi-Newton equation is solved to obtain the search direction. The step size is determined by a non-monotone Armijo backtracking line search. An adaptive regularized parameter, which is updated according to the step size of the line search, is employed to compute the next search direction. The presented method is proved to be globally convergent. Numerical experiments show that the proposed method is effective for unconstrained optimizations and outperforms the existing regularized Newton method.
引用
收藏
页码:1639 / 1658
页数:20
相关论文
共 50 条
  • [31] Preconditioning On Subspace Quasi-Newton Method For Large Scale Unconstrained Optimization
    Sim, Hong Seng
    Leong, Wah June
    Ismail, Fudziah
    [J]. STATISTICS AND OPERATIONAL RESEARCH INTERNATIONAL CONFERENCE (SORIC 2013), 2014, 1613 : 297 - 305
  • [32] New Self-scaling Quasi-Newton methods for unconstrained optimization
    Moghrabi, Issam A. R.
    Hassan, Basim A.
    Askar, Aadil
    [J]. INTERNATIONAL JOURNAL OF MATHEMATICS AND COMPUTER SCIENCE, 2022, 17 (03): : 1061 - 1077
  • [33] IMPROVED DAMPED QUASI-NEWTON METHODS FOR UNCONSTRAINED OPTIMIZATION
    Al-Baali, M.
    Grandinetti, L.
    [J]. PACIFIC JOURNAL OF OPTIMIZATION, 2019, 15 (01): : 45 - 54
  • [34] A family of quasi-Newton methods for unconstrained optimization problems
    Salim, M. S.
    Ahmed, A. I.
    [J]. OPTIMIZATION, 2018, 67 (10) : 1717 - 1727
  • [35] Global convergence of quasi-Newton methods for unconstrained optimization
    Han, LX
    Liu, GH
    [J]. CHINESE SCIENCE BULLETIN, 1996, 41 (07): : 529 - 533
  • [36] Global convergence of quasi-Newton methods for unconstrained optimization
    韩立兴
    刘光辉
    [J]. Science Bulletin, 1996, (07) : 529 - 533
  • [37] QUASI-NEWTON METHOD WITH MEMORY FOR UNCONSTRAINED FUNCTION MINIMIZATION
    WOLFE, MA
    [J]. JOURNAL OF THE INSTITUTE OF MATHEMATICS AND ITS APPLICATIONS, 1975, 15 (01): : 85 - 94
  • [38] A self-scaling quasi-newton method for large scale unconstrained optimization
    Jiang, Xiaowei
    Yang, Yueting
    [J]. Journal of Information and Computational Science, 2010, 7 (08): : 1739 - 1745
  • [39] Regularized Newton method for unconstrained convex optimization
    Polyak, Roman A.
    [J]. MATHEMATICAL PROGRAMMING, 2009, 120 (01) : 125 - 145
  • [40] Regularized Newton method for unconstrained convex optimization
    Roman A. Polyak
    [J]. Mathematical Programming, 2009, 120 : 125 - 145