ACCELERATION OF UNIVARIATE GLOBAL OPTIMIZATION ALGORITHMS WORKING WITH LIPSCHITZ FUNCTIONS AND LIPSCHITZ FIRST DERIVATIVES

被引:50
|
作者
Lera, Daniela [1 ]
Sergeyev, Yaroslav D. [2 ,3 ,4 ]
机构
[1] Univ Cagliari, Dipartimento Matemat & Informat, Cagliari, Italy
[2] Univ Calabria, Dept Elect Comp Sci & Syst, I-87036 Arcavacata Di Rende, Italy
[3] NI Lobatchevsky State Univ, Nizhnii Novgorod, Russia
[4] Natl Res Council Italy, Inst High Performance Comp & Networking, Rome, Italy
关键词
global optimization; Lipschitz functions; Lipschitz derivatives; balancing local and global information; acceleration; MINIMAL ROOT; SET;
D O I
10.1137/110859129
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper deals with two kinds of the one-dimensional global optimization problem over a closed finite interval: (i) the objective function f(x) satisfies the Lipschitz condition with a constant L; (ii) the first derivative of f(x) satisfies the Lipschitz condition with a constant M. In the paper, six algorithms are presented for the case (i) and six algorithms for the case (ii). In both cases, auxiliary functions are constructed and adaptively improved during the search. In the case (i), piecewise linear functions are constructed and in the case (ii) smooth piecewise quadratic functions are used. The constants L and M either are taken as values known a priori or are dynamically estimated during the search. A recent technique that adaptively estimates the local Lipschitz constants over different zones of the search region is used to accelerate the search. A new technique called the local improvement is introduced in order to accelerate the search in both cases (i) and (ii). The algorithms are described in a unique framework, their properties are studied from a general viewpoint, and convergence conditions of the proposed algorithms are given. Numerical experiments executed on 120 test problems taken from the literature show quite a promising performance of the new acceleration techniques.
引用
收藏
页码:508 / 529
页数:22
相关论文
共 50 条
  • [1] UNIVARIATE GEOMETRIC LIPSCHITZ GLOBAL OPTIMIZATION ALGORITHMS
    Kvasov, Dmitri E.
    Sergeyev, Yaroslav D.
    NUMERICAL ALGEBRA CONTROL AND OPTIMIZATION, 2012, 2 (01): : 69 - 90
  • [2] Acceleration Techniques in he Univariate Lipschitz Global Optimization
    Sergeyev, Yaroslav D.
    Kvasov, Dmitri E.
    Mukhametzhanov, Marat S.
    De Franco, Angela
    NUMERICAL COMPUTATIONS: THEORY AND ALGORITHMS (NUMTA-2016), 2016, 1776
  • [3] GLOBAL OPTIMIZATION OF UNIVARIATE LIPSCHITZ FUNCTIONS .2. NEW ALGORITHMS AND COMPUTATIONAL COMPARISON
    HANSEN, P
    JAUMARD, B
    LU, SH
    MATHEMATICAL PROGRAMMING, 1992, 55 (03) : 273 - 292
  • [4] On Acceleration of Derivative-Free Univariate Lipschitz Global Optimization Methods
    Kvasov, Dmitri E.
    Mukhametzhanov, Marat S.
    Nasso, Maria Chiara
    Sergeyev, Yaroslav D.
    NUMERICAL COMPUTATIONS: THEORY AND ALGORITHMS, PT II, 2020, 11974 : 413 - 421
  • [5] A univariate global search working with a set of Lipschitz constants for the first derivative
    Kvasov, Dmitri E.
    Sergeyev, Yaroslav D.
    OPTIMIZATION LETTERS, 2009, 3 (02) : 303 - 318
  • [6] A univariate global search working with a set of Lipschitz constants for the first derivative
    Dmitri E. Kvasov
    Yaroslav D. Sergeyev
    Optimization Letters, 2009, 3 : 303 - 318
  • [7] GLOBAL OPTIMIZATION OF UNIVARIATE LIPSCHITZ FUNCTIONS .1. SURVEY AND PROPERTIES
    HANSEN, P
    JAUMARD, B
    LU, SH
    MATHEMATICAL PROGRAMMING, 1992, 55 (03) : 251 - 272
  • [8] Global optimization of Lipschitz functions
    Malherbe, Cedric
    Vayatis, Nicolas
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [9] Efficient smooth minorants for global optimization of univariate functions with the first derivative satisfying the interval Lipschitz condition
    Posypkin, Mikhail A.
    Sergeyev, Yaroslav D.
    JOURNAL OF GLOBAL OPTIMIZATION, 2022,
  • [10] An always convergent algorithm for global minimization of univariate Lipschitz functions
    Abaffy, Jozsef
    Galantai, Aurel
    ACTA POLYTECHNICA HUNGARICA, 2013, 10 (07) : 21 - 39