Analysis of runtime of optimization algorithms for noisy functions over discrete codomains

被引:25
|
作者
Akimoto, Youhei [1 ]
Astete-Morales, Sandra [2 ]
Teytaud, Olivier [2 ]
机构
[1] Shinshu Univ, Inst Engn, Nagano, Japan
[2] Univ Paris Sud, TAO INRIA LRI, F-91405 Orsay, France
关键词
Discrete optimization; Additive noise; Runtime analysis; LOWER BOUNDS; MODEL;
D O I
10.1016/j.tcs.2015.04.008
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We consider in this work the application of optimization algorithms to problems over discrete codomains corrupted by additive unbiased noise. We propose a modification of the algorithms by repeating the fitness evaluation of the noisy function sufficiently so that, with a fix probability, the function evaluation on the noisy case is identical to the true value. If the runtime of the algorithms on the noise-free case is known, the number of resampling is chosen accordingly. If not, the number of resampling is chosen regarding to the number of fitness evaluations, in an anytime manner. We conclude that if the additive noise is Gaussian, then the runtime on the noisy case, for an adapted algorithm using resamplings, is similar to the runtime on the noise-free case: we incur only an extra logarithmic factor. If the noise is non-Gaussian but with finite variance, then the total runtime of the noisy case is quadratic in function of the runtime on the noise-free case. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:42 / 50
页数:9
相关论文
共 50 条
  • [1] Runtime analysis of discrete particle swarm optimization algorithms: A survey
    Muehlenthaler, Moritz
    Rass, Alexander
    IT-INFORMATION TECHNOLOGY, 2019, 61 (04): : 177 - 185
  • [2] Bandit-Based Estimation of Distribution Algorithms for Noisy Optimization: Rigorous Runtime Analysis
    Rolet, Philippe
    Teytaud, Olivier
    LEARNING AND INTELLIGENT OPTIMIZATION, 2010, 6073 : 97 - 110
  • [3] A Runtime Analysis of Parallel Evolutionary Algorithms in Dynamic Optimization
    Andrei Lissovoi
    Carsten Witt
    Algorithmica, 2017, 78 : 641 - 659
  • [4] A runtime analysis of evolutionary algorithms for constrained optimization problems
    Zhou, Yuren
    He, Jun
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2007, 11 (05) : 608 - 619
  • [5] A Runtime Analysis of Parallel Evolutionary Algorithms in Dynamic Optimization
    Lissovoi, Andrei
    Witt, Carsten
    ALGORITHMICA, 2017, 78 (02) : 641 - 659
  • [6] Convergence of estimation of distribution algorithms in optimization of additively noisy fitness functions
    Hong, Y
    Ren, QS
    Zeng, J
    Chang, YC
    ICTAI 2005: 17TH IEEE INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2005, : 219 - 223
  • [7] Effects of Noisy Multiobjective Test Functions Applied to Evolutionary Optimization Algorithms
    Ryter, Remo
    Hanne, Thomas
    Dornberger, Rolf
    JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2020, 11 (03) : 128 - 134
  • [8] Simulation-based optimization over discrete sets with noisy constraints
    Luo, Yao
    Lim, Eunji
    IIE TRANSACTIONS, 2013, 45 (07) : 699 - 715
  • [9] SIMULATION-BASED OPTIMIZATION OVER DISCRETE SETS WITH NOISY CONSTRAINTS
    Luo, Yao
    Lim, Eunji
    PROCEEDINGS OF THE 2011 WINTER SIMULATION CONFERENCE (WSC), 2011, : 4008 - 4020
  • [10] Stability Analysis of Some Discrete Optimization Algorithms
    M. V. Devyaterikova
    A. A. Kolokolov
    Automation and Remote Control, 2004, 65 : 401 - 406