A new nonmonotone line search technique for unconstrained optimization

被引:32
|
作者
Huang, Shuai [1 ]
Wan, Zhong [1 ]
Chen, Xiaohong [2 ]
机构
[1] Cent S Univ, Sch Math & Stat, Changsha, Hunan, Peoples R China
[2] Cent S Univ, Sch Business, Changsha, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
Nonmonotone line search; Armijo line search; Global convergence; R-linear convergence; GRADIENT-METHOD; NEWTON METHOD; MINIMIZATION; ALGORITHM; SOFTWARE;
D O I
10.1007/s11075-014-9866-4
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, a new nonmonotone line search rule is proposed,which is verified to be an improved version of the nonmonotone line search technique proposed by Zhang and Hager. Unlike the Zhang and Hager's method, our nonmonotone line search is proved to own a nice property similar to the standard Armijo line search. In virtue of such a property, global convergence is established for the developed algorithm, where the search direction is supposed to satisfy some mild conditions and the stepsize is chosen by the new line search rule. R-linear convergence of the developed algorithm is proved for strongly convex objective functions. The developed algorithm is used to solve the test problems available in the CUTEr, the numerical results demonstrate that the new line search strategy outperforms the other similar ones.
引用
收藏
页码:671 / 689
页数:19
相关论文
共 50 条
  • [31] A Filter and Nonmonotone Adaptive Trust Region Line Search Method for Unconstrained Optimization
    Qu, Quan
    Ding, Xianfeng
    Wang, Xinyi
    SYMMETRY-BASEL, 2020, 12 (04):
  • [32] A nonmonotone conic trust region method based on line search for solving unconstrained optimization
    Qu, Shao-Jian
    Zhang, Qing-Pu
    Yang, Yue-Ting
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2009, 224 (02) : 514 - 526
  • [33] An efficient nonmonotone adaptive cubic regularization method with line search for unconstrained optimization problem
    Li, Qun
    Zheng, Bing
    Zheng, Yutao
    APPLIED MATHEMATICS LETTERS, 2019, 98 : 74 - 80
  • [34] An unconstrained optimization method using nonmonotone second order Goldstein's line search
    Wen-yu SUN~(1+) Qun-yan ZHOU~(1
    ~2 Department of Basic Courses
    Science in China(Series A:Mathematics), 2007, (10) : 1389 - 1400
  • [35] An unconstrained optimization method using nonmonotone second order Goldstein's line search
    Wen-yu Sun
    Qun-yan Zhou
    SCIENCE IN CHINA SERIES A-MATHEMATICS, 2007, 50 (10): : 1389 - 1400
  • [36] A THREE-TERM CONJUGATE GRADIENT METHOD WITH NONMONOTONE LINE SEARCH FOR UNCONSTRAINED OPTIMIZATION
    Moyi, Aliyu Usman
    Leong, Wah June
    PACIFIC JOURNAL OF OPTIMIZATION, 2016, 12 (03): : 587 - 601
  • [37] New line search methods for unconstrained optimization
    Gonglin Yuan
    Zengxin Wei
    Journal of the Korean Statistical Society, 2009, 38 : 29 - 39
  • [38] New line search methods for unconstrained optimization
    Yuan, Gonglin
    Wei, Zengxin
    JOURNAL OF THE KOREAN STATISTICAL SOCIETY, 2009, 38 (01) : 29 - 39
  • [39] An unconstrained optimization method using nonmonotone second order Goldstein’s line search
    Wen-yu Sun
    Qun-yan Zhou
    Science in China Series A: Mathematics, 2007, 50 : 1389 - 1400
  • [40] Nonmonotone line searches for unconstrained multiobjective optimization problems
    Kanako Mita
    Ellen H. Fukuda
    Nobuo Yamashita
    Journal of Global Optimization, 2019, 75 : 63 - 90