New Self-scaling Quasi-Newton methods for unconstrained optimization

被引:0
|
作者
Moghrabi, Issam A. R. [1 ]
Hassan, Basim A. [2 ]
Askar, Aadil [3 ]
机构
[1] Gulf Univ Sci & Technol, Coll Business Adm, Dept Accounting & MIS, West Meshref, Kuwait
[2] Univ Mosul, Dept Math, Mosul, Iraq
[3] King Saud Univ, Dept Self Dev Skills, Riyadh, Saudi Arabia
关键词
Unconstrained optimization; nonlinear optimization; Quasi-Newton methods; Self-scaling quasi-Newton Broyden family; machine learning; BFGS METHOD; CONVERGENCE; ALGORITHMS;
D O I
暂无
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
The quasi-Newton technique is one of the most well-known iterative solutions for unconstrained optimization problems. The quasi-Newton techniques are known for their high accuracy and rapid convergence. In this paper, we derive four self-scaling BFGS methods. The Wolfe line search criteria define the step size selection. The method of global convergence is demonstrated when the objective function is uniformly convex. Preliminary computational tests on a set of 30 unconstrained optimization test functions suggest that this technique is more efficient and resilient than implementing the non-scaled version of the BFGS. In terms of iteration count and function/gradient evaluations, comparative findings reveal that the suggested strategy is computationally efficient.
引用
收藏
页码:1061 / 1077
页数:17
相关论文
共 50 条
  • [1] A new self-scaling memoryless quasi-Newton update for unconstrained optimization
    Jourak, M.
    Nezhadhosein, S.
    Rahpeymaii, F.
    [J]. 4OR-A QUARTERLY JOURNAL OF OPERATIONS RESEARCH, 2023, 22 (2): : 235 - 252
  • [2] A combined class of self-scaling and modified quasi-Newton methods
    Mehiddin Al-Baali
    Humaid Khalfan
    [J]. Computational Optimization and Applications, 2012, 52 : 393 - 408
  • [3] A combined class of self-scaling and modified quasi-Newton methods
    Al-Baali, Mehiddin
    Khalfan, Humaid
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2012, 52 (02) : 393 - 408
  • [4] ANALYSIS OF A SELF-SCALING QUASI-NEWTON METHOD
    NOCEDAL, J
    YUAN, YX
    [J]. MATHEMATICAL PROGRAMMING, 1993, 61 (01) : 19 - 37
  • [5] New quasi-Newton methods for unconstrained optimization problems
    Wei, Zengxin
    Li, Guoyin
    Qi, Liqun
    [J]. APPLIED MATHEMATICS AND COMPUTATION, 2006, 175 (02) : 1156 - 1188
  • [6] LEARNING ALGORITHMS FOR NEURAL NETWORKS BASED ON QUASI-NEWTON METHODS WITH SELF-SCALING
    BEIGI, HSM
    LI, CJ
    [J]. JOURNAL OF DYNAMIC SYSTEMS MEASUREMENT AND CONTROL-TRANSACTIONS OF THE ASME, 1993, 115 (01): : 38 - 43
  • [7] VARIATIONAL QUASI-NEWTON METHODS FOR UNCONSTRAINED OPTIMIZATION
    ALBAALI, M
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1993, 77 (01) : 127 - 143
  • [8] A modified quasi-Newton methods for unconstrained optimization
    Hassan, Basim A.
    [J]. ITALIAN JOURNAL OF PURE AND APPLIED MATHEMATICS, 2019, (42): : 504 - 511
  • [9] PARALLEL QUASI-NEWTON METHODS FOR UNCONSTRAINED OPTIMIZATION
    BYRD, RH
    SCHNABEL, RB
    SHULTZ, GA
    [J]. MATHEMATICAL PROGRAMMING, 1988, 42 (02) : 273 - 306
  • [10] New quasi-Newton equation and related methods for unconstrained optimization
    Zhang, JZ
    Deng, NY
    Chen, LH
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1999, 102 (01) : 147 - 167