A new nonmonotone line search technique for unconstrained optimization

被引:32
|
作者
Huang, Shuai [1 ]
Wan, Zhong [1 ]
Chen, Xiaohong [2 ]
机构
[1] Cent S Univ, Sch Math & Stat, Changsha, Hunan, Peoples R China
[2] Cent S Univ, Sch Business, Changsha, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
Nonmonotone line search; Armijo line search; Global convergence; R-linear convergence; GRADIENT-METHOD; NEWTON METHOD; MINIMIZATION; ALGORITHM; SOFTWARE;
D O I
10.1007/s11075-014-9866-4
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, a new nonmonotone line search rule is proposed,which is verified to be an improved version of the nonmonotone line search technique proposed by Zhang and Hager. Unlike the Zhang and Hager's method, our nonmonotone line search is proved to own a nice property similar to the standard Armijo line search. In virtue of such a property, global convergence is established for the developed algorithm, where the search direction is supposed to satisfy some mild conditions and the stepsize is chosen by the new line search rule. R-linear convergence of the developed algorithm is proved for strongly convex objective functions. The developed algorithm is used to solve the test problems available in the CUTEr, the numerical results demonstrate that the new line search strategy outperforms the other similar ones.
引用
收藏
页码:671 / 689
页数:19
相关论文
共 50 条
  • [21] A new subspace minimization conjugate gradient method with nonmonotone line search for unconstrained optimization
    Ming Li
    Hongwei Liu
    Zexian Liu
    Numerical Algorithms, 2018, 79 : 195 - 219
  • [22] Global Convergence of Algorithms with Nonmonotone Line Search Strategy in Unconstrained Optimization
    Hüther B.
    Results in Mathematics, 2002, 41 (3-4) : 320 - 333
  • [23] Accelerated nonmonotone line search technique for multiobjective optimization
    Aminifard, Zohre
    Babaie-Kafaki, Saman
    Habibian-Dehkordi, Fereidoun
    Toofan, Maria
    RAIRO-OPERATIONS RESEARCH, 2024, 58 (04) : 2783 - 2795
  • [24] NONMONOTONE CURVED SEARCH METHODS FOR UNCONSTRAINED OPTIMIZATION
    邓乃扬
    肖奕
    周方俊
    Numerical Mathematics A Journal of Chinese Universities(English Series), 1992, (01) : 34 - 48
  • [25] An inexact line search approach using modified nonmonotone strategy for unconstrained optimization
    Amini, Keyvan
    Ahookhosh, Masoud
    Nosratipour, Hadi
    NUMERICAL ALGORITHMS, 2014, 66 (01) : 49 - 78
  • [26] An inexact line search approach using modified nonmonotone strategy for unconstrained optimization
    Keyvan Amini
    Masoud Ahookhosh
    Hadi Nosratipour
    Numerical Algorithms, 2014, 66 : 49 - 78
  • [27] A class of nonmonotone Armijo-type line search method for unconstrained optimization
    Ahookhosh, Masoud
    Amini, Keyvan
    Bahrami, Somayeh
    OPTIMIZATION, 2012, 61 (04) : 387 - 404
  • [28] A cubic regularization algorithm for unconstrained optimization using line search and nonmonotone techniques
    Bianconcini, Tommaso
    Sciandrone, Marco
    OPTIMIZATION METHODS & SOFTWARE, 2016, 31 (05): : 1008 - 1035
  • [29] Combining nonmonotone conic trust region and line search techniques for unconstrained optimization
    Cui, Zhaocheng
    Wu, Boying
    Qu, Shaojian
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2011, 235 (08) : 2432 - 2441
  • [30] MODIFIED LIMITED MEMORY BFGS METHOD WITH NONMONOTONE LINE SEARCH FOR UNCONSTRAINED OPTIMIZATION
    Yuan, Gonglin
    Wei, Zengxin
    Wu, Yanlin
    JOURNAL OF THE KOREAN MATHEMATICAL SOCIETY, 2010, 47 (04) : 767 - 788