A modified limited-memory BNS method for unconstrained minimization based on the conjugate directions idea

被引:5
|
作者
Vlcek, Jan [1 ]
Luksan, Ladislav [1 ,2 ]
机构
[1] Acad Sci Czech Republ, Inst Comp Sci, Prague 18207 8, Czech Republic
[2] Tech Univ Liberec, Fac Mech & Comp Sci, Liberec 46117, Czech Republic
来源
OPTIMIZATION METHODS & SOFTWARE | 2015年 / 30卷 / 03期
关键词
unconstrained minimization; variable metric methods; limited-memory methods; the BFGS update; conjugate directions; numerical results; QUASI-NEWTON MATRICES;
D O I
10.1080/10556788.2014.955101
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
A modification of the limited-memory variable metric BNS method for large-scale unconstrained optimization is proposed, which consists in corrections (derived from the idea of conjugate directions) of the used difference vectors for better satisfaction of the previous quasi-Newton (QN) conditions. In comparison with [Vlek and Lukan, A conjugate directions approach to improve the limited-memory BFGS method, Appl. Math. Comput. 219 (2012), pp. 800-809], where a similar approach is used, correction vectors from more previous iterations can be applied here. For quadratic objective functions, the improvement of convergence is the best one in some sense, all stored corrected difference vectors are conjugate and the QN conditions with these vectors are satisfied. Global convergence of the algorithm is established for convex sufficiently smooth functions. Numerical experiments demonstrate the efficiency of the new method.
引用
收藏
页码:616 / 633
页数:18
相关论文
共 50 条
  • [1] A MODIFIED LIMITED-MEMORY BNS METHOD FOR UNCONSTRAINED MINIMIZATION DERIVED FROM THE CONJUGATE DIRECTIONS IDEA
    Vlcek, Jan
    Luksan, Ladislav
    [J]. Programs and Algorithms of Numerical Mathematics 17, 2015, : 237 - 243
  • [2] MODIFICATIONS OF THE LIMITED-MEMORY BFGS METHOD BASED ON THE IDEA OF CONJUGATE DIRECTIONS
    Vlcek, Jan
    Luksan, Ladislav
    [J]. PROGRAMS AND ALGORITHMS OF NUMERICAL MATHEMATICS 16, 2013, : 209 - 214
  • [3] Properties of the block BFGS update and its application to the limited-memory block BNS method for unconstrained minimization
    Vlcek, Jan
    Luksan, Ladislav
    [J]. NUMERICAL ALGORITHMS, 2019, 80 (03) : 957 - 987
  • [4] Properties of the block BFGS update and its application to the limited-memory block BNS method for unconstrained minimization
    Jan Vlček
    Ladislav Lukšan
    [J]. Numerical Algorithms, 2019, 80 : 957 - 987
  • [5] A limited-memory optimization method using the infinitely many times repeated BNS update and conjugate directions
    Vlcek, Jan
    Luksan, Ladislav
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2019, 351 : 14 - 28
  • [6] A conjugate directions approach to improve the limited-memory BFGS method
    Vlcek, J.
    Luksan, L.
    [J]. APPLIED MATHEMATICS AND COMPUTATION, 2012, 219 (03) : 800 - 809
  • [7] A GENERALIZED LIMITED-MEMORY BNS METHOD BASED ON THE BLOCK BFGS UPDATE
    Vlcek, Jan
    Luksan, Ladislav
    [J]. PROGRAMS AND ALGORITHMS OF NUMERICAL MATHEMATICS 18, 2017, : 164 - 171
  • [8] APPLICATION OF THE INFINITELY MANY TIMES REPEATED BNS UPDATE AND CONJUGATE DIRECTIONS TO LIMITED-MEMORY OPTIMIZATION METHODS
    Vlcek, Jan
    Luksan, Ladislav
    [J]. PROGRAMS AND ALGORITHMS OF NUMERICAL MATHEMATICS 19, 2019, : 177 - 185
  • [9] A regularized limited memory subspace minimization conjugate gradient method for unconstrained optimization
    Wumei Sun
    Hongwei Liu
    Zexian Liu
    [J]. Numerical Algorithms, 2023, 94 : 1919 - 1948
  • [10] A regularized limited memory subspace minimization conjugate gradient method for unconstrained optimization
    Sun, Wumei
    Liu, Hongwei
    Liu, Zexian
    [J]. NUMERICAL ALGORITHMS, 2023, 94 (04) : 1919 - 1948