Multi-Step Skipping Methods for Unconstrained Optimization

被引:0
|
作者
Ford, John A. [1 ]
Aamir, Nudrat [1 ]
机构
[1] Univ Essex, Dept Math Sci, Colchester CO4 3SQ, Essex, England
关键词
unconstrained non-linear optimization; quasi-Newton methods; approximation to the inverse Hessian; skipping updates; multi-step methods; BFGS;
D O I
10.1063/1.3636959
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
When dealing with unconstrained non-linear optimization problems using quasi-Newton methods, updating the approximation to the inverse Hessian is a computationally expensive operation and, therefore, in this paper we investigate the possibility of skipping updates on every second step. The experimental results show that the new methods (i.e. with skipping) give better performance in general than existing multi-step methods, particularly as the dimension of the test problem increases.
引用
收藏
页数:3
相关论文
共 50 条
  • [41] Distributed multi-step subgradient optimization for multi-agent system
    Li, Chaoyong
    Chen, Sai
    Li, Jianqing
    Wang, Feng
    SYSTEMS & CONTROL LETTERS, 2019, 128 : 26 - 33
  • [42] Thermodynamic model and optimization of a multi-step irreversible Brayton cycle
    Sanchez-Orgaz, S.
    Medina, A.
    Calvo Hernandez, A.
    ENERGY CONVERSION AND MANAGEMENT, 2010, 51 (11) : 2134 - 2143
  • [43] Numerical simulation and optimization of multi-step batch membrane processes
    Kovacs, Z.
    Discacciati, M.
    Samhaber, W.
    JOURNAL OF MEMBRANE SCIENCE, 2008, 324 (1-2) : 50 - 58
  • [44] Optimization of Electrostatic Energy Harvesting Device with Multi-step Structure
    Guo, Xinge
    Zhang, Yulong
    Wang, Fei
    2018 13TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON NANO/MICRO ENGINEERED AND MOLECULAR SYSTEMS (NEMS 2018), 2018, : 167 - 172
  • [45] Optimization of a Multi-Step Procedure for Isolation of Chicken Bone Collagen
    Cansu, Umran
    Boran, Gokhan
    KOREAN JOURNAL FOR FOOD SCIENCE OF ANIMAL RESOURCES, 2015, 35 (04) : 431 - 440
  • [46] Solving conbinatorial optimization problems with multi-step genetic algorithms
    Watabe, H
    Kawaoka, T
    GECCO-99: PROCEEDINGS OF THE GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 1999, : 813 - 813
  • [47] Multi-Step Budgeted Bayesian Optimization with Unknown Evaluation Costs
    Astudillo, Raul
    Jiang, Daniel R.
    Balandat, Maximilian
    Bakshy, Eytan
    Frazier, Peter, I
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [48] Some multi-step iterative methods for solving nonlinear equations
    Rafiq, Arif
    Rafiullah, Muhammad
    COMPUTERS & MATHEMATICS WITH APPLICATIONS, 2009, 58 (08) : 1589 - 1597
  • [49] Multi-step Maruyama methods for stochastic delay differential equations
    Buckwar, Evelyn
    Winkler, Renate
    STOCHASTIC ANALYSIS AND APPLICATIONS, 2007, 25 (05) : 933 - 959
  • [50] Multi-step methods for random ODEs driven by Ito diffusions
    Asai, Y.
    Kloeden, P. E.
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2016, 294 : 210 - 224