Multi-Step Skipping Methods for Unconstrained Optimization

被引:0
|
作者
Ford, John A. [1 ]
Aamir, Nudrat [1 ]
机构
[1] Univ Essex, Dept Math Sci, Colchester CO4 3SQ, Essex, England
关键词
unconstrained non-linear optimization; quasi-Newton methods; approximation to the inverse Hessian; skipping updates; multi-step methods; BFGS;
D O I
10.1063/1.3636959
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
When dealing with unconstrained non-linear optimization problems using quasi-Newton methods, updating the approximation to the inverse Hessian is a computationally expensive operation and, therefore, in this paper we investigate the possibility of skipping updates on every second step. The experimental results show that the new methods (i.e. with skipping) give better performance in general than existing multi-step methods, particularly as the dimension of the test problem increases.
引用
收藏
页数:3
相关论文
共 50 条
  • [31] Evolutionary Optimization of Multi-step Dynamic Systems Learning
    Perez, Edgar Ademir Morales
    Iba, Hitoshi
    2022 8TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND ROBOTICS ENGINEERING (ICMRE 2022), 2022, : 152 - 156
  • [32] Bayesian Emulation for Multi-Step Optimization in Decision Problems
    Irie, Kaoru
    West, Mike
    BAYESIAN ANALYSIS, 2019, 14 (01): : 137 - 160
  • [33] The multi-step parts free abrasive machining optimization
    Tamarkin, M.A.
    Azarova, A.I.
    2001, Mashinostroeni
  • [34] A multi-step class of iterative methods for nonlinear systems
    Fazlollah Soleymani
    Taher Lotfi
    Parisa Bakhtiari
    Optimization Letters, 2014, 8 : 1001 - 1015
  • [35] A multi-step class of iterative methods for nonlinear systems
    Soleymani, Fazlollah
    Lotfi, Taher
    Bakhtiari, Parisa
    OPTIMIZATION LETTERS, 2014, 8 (03) : 1001 - 1015
  • [36] Solving monotone inclusions with linear multi-step methods
    Pennanen, T
    Svaiter, BF
    MATHEMATICAL PROGRAMMING, 2003, 96 (03) : 469 - 487
  • [37] Methods to Improve Multi-Step Time Series Prediction
    Koesdwiady, Arief
    El Khatib, Alaa
    Karray, Fakhri
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [38] Solving monotone inclusions with linear multi-step methods
    Teemu Pennanen
    B. F. Svaiter
    Mathematical Programming, 2003, 96 : 469 - 487
  • [39] Comparison of multi-step forecasting methods for renewable energy
    Dolgintseva, E.
    Wu, H.
    Petrosian, O.
    Zhadan, A.
    Allakhverdyan, A.
    Martemyanov, A.
    ENERGY SYSTEMS-OPTIMIZATION MODELING SIMULATION AND ECONOMIC ASPECTS, 2024,
  • [40] Multi-Step Subgradient Methods for Distributed Optimization over Unbalanced Digraphs with Local Constraint Sets
    Xiong, Yongyang
    You, Keyou
    Wu, Ligang
    2020 IEEE 16TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION (ICCA), 2020, : 330 - 335