A New Supermemory Gradient Method without Line Search for Unconstrained Optimization

被引:0
|
作者
Liu, June [1 ]
Liu, Huanbin [1 ]
Zheng, Yue [1 ]
机构
[1] Huanggang Normal Univ, Inst Uncertain Syst, Coll Math & Informat Sci, Huanggang 438000, Hubei, Peoples R China
关键词
Unconstrained optimization; Memory gradient method; Global convergence; Convergence rate; GLOBAL CONVERGENCE; DESCENT METHODS; FAMILY;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we present a new supermemory gradient method without line search for unconstrained optimization problems. The new method can guarantee a descent at each iteration. It sufficiently uses the previous multi-step iterative information at each iteration and avoids the storage and computation of matrices associated with the Hessian of objective functions, so that it is suitable to solve large scale optimization problems. We also prove its global convergence under some mild conditions. In addition, We analyze the linear convergence rate of the new method when the objective function is uniformly convex and twice continuously differentiable.
引用
收藏
页码:641 / 647
页数:7
相关论文
共 50 条
  • [1] A New Supermemory Gradient Method for Unconstrained Optimization
    Zheng, Yue
    Liu, Huanbin
    Liu, June
    [J]. ADVANCING KNOWLEDGE DISCOVERY AND DATA MINING TECHNOLOGIES, PROCEEDINGS, 2009, : 177 - 179
  • [2] A new supermemory gradient method for unconstrained optimization problems
    Ou, Yi-gui
    Wang, Guan-shu
    [J]. OPTIMIZATION LETTERS, 2012, 6 (05) : 975 - 992
  • [3] A new supermemory gradient method for unconstrained optimization problems
    Yi-gui Ou
    Guan-shu Wang
    [J]. Optimization Letters, 2012, 6 : 975 - 992
  • [4] Supermemory gradient method for unconstrained optimization problem
    Shi, Zhenjun
    [J]. Gongcheng Shuxue Xuebao/Chinese Journal of Engineering Mathematics, 2000, 17 (02): : 99 - 104
  • [5] A New Conjugate Gradient Method with Sufficient Descent without any Line Search for Unconstrained Optimization
    Omer, Osman
    Rivaie, Mohd
    Mamat, Mustafa
    Amani, Zahrahtul
    [J]. 2ND ISM INTERNATIONAL STATISTICAL CONFERENCE 2014 (ISM-II): EMPOWERING THE APPLICATIONS OF STATISTICAL AND MATHEMATICAL SCIENCES, 2015, 1643 : 602 - 608
  • [6] A nonmonotone supermemory gradient algorithm for unconstrained optimization
    Ou Y.
    Liu Y.
    [J]. Ou, Y. (ouyigui@tom.com), 1600, Springer Verlag (46): : 215 - 235
  • [7] A new subspace minimization conjugate gradient method with nonmonotone line search for unconstrained optimization
    Li, Ming
    Liu, Hongwei
    Liu, Zexian
    [J]. NUMERICAL ALGORITHMS, 2018, 79 (01) : 195 - 219
  • [8] A new subspace minimization conjugate gradient method with nonmonotone line search for unconstrained optimization
    Ming Li
    Hongwei Liu
    Zexian Liu
    [J]. Numerical Algorithms, 2018, 79 : 195 - 219
  • [9] A regularized Newton method without line search for unconstrained optimization
    Ueda, Kenji
    Yamashita, Nobuo
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2014, 59 (1-2) : 321 - 351
  • [10] A regularized Newton method without line search for unconstrained optimization
    Kenji Ueda
    Nobuo Yamashita
    [J]. Computational Optimization and Applications, 2014, 59 : 321 - 351