Surrogate-based distributed optimisation for expensive black-box functions

被引:17
|
作者
Li, Zhongguo [1 ]
Dong, Zhen [1 ]
Liang, Zhongchao [2 ]
Ding, Zhengtao [1 ]
机构
[1] Univ Manchester, Dept Elect & Elect Engn, Manchester M13 9PL, Lancs, England
[2] Northeastern Univ, Sch Mech Engn & Automat, Shenyang 110819, Peoples R China
基金
英国科学技术设施理事会;
关键词
Distributed algorithms; Expensive optimisation methods; Black-box functions; Surrogate models; Multi-agent systems;
D O I
10.1016/j.automatica.2020.109407
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper considers distributed optimisation problems with black-box functions using surrogate-assisted methods. Since the cost functions and their derivatives are usually impossible to be expressed by explicit functions due to the complexity of modern systems, function calls have to be performed to obtain those values. Moreover, the cost functions are often expensive to evaluate, and therefore designers prefer to reduce the number of evaluations. In this paper, surrogate-based methods are utilised to approximate the true functions, and conditions for constructing smooth and convex surrogates are established, by which the requirements for explicit functions are eliminated. To improve the quality of surrogate models, a distance-based infill strategy is proposed to balance the exploitation and exploration, which guarantees the density of the decision sequence in a compact set. Then, a distributed optimisation algorithm is developed to solve the reformulated auxiliary sub-problems, and the convergence of the proposed algorithm is established via Lyapunov theory. Simulation examples are provided to validate the effectiveness of the theoretical development and demonstrate the potential significance of the framework. (C) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Efficient global optimization of expensive black-box functions
    Jones, DR
    Schonlau, M
    Welch, WJ
    JOURNAL OF GLOBAL OPTIMIZATION, 1998, 13 (04) : 455 - 492
  • [22] Efficient Global Optimization of Expensive Black-Box Functions
    Donald R. Jones
    Matthias Schonlau
    William J. Welch
    Journal of Global Optimization, 1998, 13 : 455 - 492
  • [23] Surrogate optimization of computationally expensive black-box problems with hidden constraints
    Müller J.
    Day M.
    INFORMS Journal on Computing, 2019, 31 (04): : 689 - 702
  • [24] Surrogate-based branch-and-bound algorithms for simulation-based black-box optimization
    Zhai, Jianyuan
    Boukouvala, Fani
    OPTIMIZATION AND ENGINEERING, 2023, 24 (03) : 1463 - 1491
  • [25] Surrogate-based branch-and-bound algorithms for simulation-based black-box optimization
    Jianyuan Zhai
    Fani Boukouvala
    Optimization and Engineering, 2023, 24 : 1463 - 1491
  • [26] Surrogate Optimization of Computationally Expensive Black-Box Problems with Hidden Constraints
    Muller, Juliane
    Day, Marcus
    INFORMS JOURNAL ON COMPUTING, 2019, 31 (04) : 689 - 702
  • [27] MACHINE-LEARNING IN OPTIMIZATION OF EXPENSIVE BLACK-BOX FUNCTIONS
    Tenne, Yoel
    INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS AND COMPUTER SCIENCE, 2017, 27 (01) : 105 - 118
  • [28] Feasibility and flexibility analysis of black-box processes part 2: Surrogate-based flexibility analysis
    Rogers, Amanda
    Ierapetritou, Marianthi
    CHEMICAL ENGINEERING SCIENCE, 2015, 137 : 1005 - 1013
  • [29] DISTRIBUTED BLACK-BOX OPTIMIZATION OF NONCONVEX FUNCTIONS
    Valcarcel Macua, Sergio
    Zazo, Santiago
    Zazo, Javier
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 3591 - 3595
  • [30] Feasibility and flexibility analysis of black-box processes Part 1: Surrogate-based feasibility analysis
    Rogers, Amanda
    Ierapetritou, Marianthi
    CHEMICAL ENGINEERING SCIENCE, 2015, 137 : 986 - 1004