The CG-BFGS Method for Unconstrained Optimization Problems

被引:0
|
作者
Bin Ibrahim, Mohd Asrul Hery [1 ]
Mamat, Mustafa [2 ]
June, Leong Wah [3 ]
Sofi, Azfi Zaidi Mohammad [4 ]
机构
[1] IUKL, Fac Appl Sci & Fdn, Kajang, Malaysia
[2] Univ Malaysia Terengganu UMT, Fac Sci & Technol, Dept Math, Terengganu, Malaysia
[3] Univ Putra Malaysia, Fac Sci, Dept Math, Serdang 43400, Malaysia
[4] Kolej Univ Islam Antarabangsa Selangor KUIS, Fac Sci & Informat Technol, Kajang, Selangor, Malaysia
关键词
Conjugate Gradient method; BFGS method; Search Direction; CONJUGATE-GRADIENT ALGORITHMS; QUASI-NEWTON METHODS; CONVERGENCE CONDITIONS; ASCENT METHODS; MINIMIZATION; SOFTWARE;
D O I
10.1063/1.4887583
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper we present a new search direction known as the CG-BFGS method, which uses the search direction of the conjugate gradient method approach in the quasi-Newton methods. The new algorithm is compared with the quasi-Newton methods in terms of the number of iterations and CPU-time. The Broyden-Fletcher-Goldfarb-Shanno (BFGS) method is used as an updating formula for the approximation of the Hessian for both methods. Our numerical analysis provides strong evidence that our CG-BFGS method is more efficient than the ordinary BFGS method. Besides, we also prove that the new algorithm is globally convergent.
引用
收藏
页码:167 / 172
页数:6
相关论文
共 50 条
  • [1] The Hybrid BFGS-CG Method in Solving Unconstrained Optimization Problems
    Ibrahim, Mohd Asrul Hery
    Mamat, Mustafa
    Leong, Wah June
    [J]. ABSTRACT AND APPLIED ANALYSIS, 2014,
  • [2] A new modified BFGS method for unconstrained optimization problems
    Razieh Dehghani
    Narges Bidabadi
    Mohammad Mehdi Hosseini
    [J]. Computational and Applied Mathematics, 2018, 37 : 5113 - 5125
  • [3] A new modified BFGS method for unconstrained optimization problems
    Dehghanil, Razieh
    Bidabadi, Narges
    Hosseini, Mohammad Mehdi
    [J]. COMPUTATIONAL & APPLIED MATHEMATICS, 2018, 37 (04): : 5113 - 5125
  • [4] An adaptive projection BFGS method for nonconvex unconstrained optimization problems
    Yuan, Gonglin
    Zhao, Xiong
    Liu, Kejun
    Chen, Xiaoxuan
    [J]. NUMERICAL ALGORITHMS, 2024, 95 (04) : 1747 - 1767
  • [5] On the global convergence of the BFGS method or nonconvex unconstrained optimization problems
    Li, DH
    Fukushima, M
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2001, 11 (04) : 1054 - 1064
  • [6] An adaptive projection BFGS method for nonconvex unconstrained optimization problems
    Gonglin Yuan
    Xiong Zhao
    Kejun Liu
    Xiaoxuan Chen
    [J]. Numerical Algorithms, 2024, 95 : 1747 - 1767
  • [7] The modified BFGS method with new secant relation for unconstrained optimization problems
    Dehghani, Razieh
    Hosseini, Mohammad Mehdi
    Bidabadi, Narges
    [J]. COMPUTATIONAL METHODS FOR DIFFERENTIAL EQUATIONS, 2019, 7 (01): : 28 - 41
  • [8] CG method with modifying βk for solving unconstrained optimization problems
    Dwail, Hasan H.
    Mahdi, Mohammed Maad
    Shiker, Mushtak A. K.
    [J]. JOURNAL OF INTERDISCIPLINARY MATHEMATICS, 2022, 25 (05) : 1347 - 1355
  • [9] An adaptive scaled BFGS method for unconstrained optimization
    Andrei, Neculai
    [J]. NUMERICAL ALGORITHMS, 2018, 77 (02) : 413 - 432
  • [10] An adaptive sizing BFGS method for unconstrained optimization
    Hao Liu
    Jianfeng Shao
    Haijun Wang
    Baoxian Chang
    [J]. Calcolo, 2015, 52 : 233 - 244