Constrained Bayesian Optimization with Lower Confidence Bound

被引:0
|
作者
Upadhye, Neelesh S. [1 ]
Chowdhury, Raju [1 ]
机构
[1] Indian Inst Technol Madras, Dept Math, Chennai 600036, Tamil Nadu, India
关键词
Bayesian optimization; Black-box function; Gaussian process; Lower confidence bound;
D O I
10.1080/00401706.2024.2336535
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this article, we present a hybrid Bayesian optimization (BO) framework to solve constrained optimization problems by adopting a state-of-the-art acquisition function from the unconstrained BO literature, the well-known lower confidence bound acquisition function and propose a novel variant that analyzes the feasible and infeasible regions which ensure the theoretical convergence guarantee. The proposed variant is compared with the existing state-of-the-art approaches in the constrained BO literature via implementing these approaches on six different problems, including black-box, classical engineering, and hyperparameter tuning problems. Further, we demonstrate the effectiveness of our approach through graphical and statistical testing.
引用
收藏
页码:561 / 574
页数:14
相关论文
共 50 条
  • [31] An interval algorithm for bound constrained global optimization
    Wolfe, MA
    OPTIMIZATION METHODS & SOFTWARE, 1995, 6 (02): : 145 - 159
  • [32] A LIMITED MEMORY ALGORITHM FOR BOUND CONSTRAINED OPTIMIZATION
    BYRD, RH
    LU, PH
    NOCEDAL, J
    ZHU, CY
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1995, 16 (05): : 1190 - 1208
  • [33] Nonconvex constrained optimization by a filtering branch and bound
    Eichfelder, Gabriele
    Klamroth, Kathrin
    Niebling, Julia
    JOURNAL OF GLOBAL OPTIMIZATION, 2021, 80 (01) : 31 - 61
  • [34] A rigorous lower confidence bound for the expectation of a positive random variable
    Gat, Yoram
    ELECTRONIC JOURNAL OF STATISTICS, 2008, 2 : 1021 - 1027
  • [35] An improved approach for constructing lower confidence bound on process yield
    Wu, Chien-Wei
    Liao, Mou-Yuan
    Chen, James C.
    EUROPEAN JOURNAL OF INDUSTRIAL ENGINEERING, 2012, 6 (03) : 369 - 390
  • [36] DEVELOPING AN ESTIMATE OF THE LOWER BOUND OF A CONFIDENCE RATIO FOR STATISTICAL DECISIONS
    HAND, J
    JANNARONE, RJ
    LAUGHLIN, JE
    HAND, MR
    PERCEPTUAL AND MOTOR SKILLS, 1985, 61 (02) : 599 - 602
  • [37] Lack of confidence, the zero lower bound, and the virtue of fiscal rules
    Schmidt, Sebastian
    JOURNAL OF ECONOMIC DYNAMICS & CONTROL, 2016, 70 : 36 - 53
  • [38] A Lower Bound for the Optimization of Finite Sums
    Agarwal, Alekh
    Bottou, Leon
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 78 - 86
  • [39] THE BAYESIAN CRAMER-RAO LOWER BOUND IN PHOTOMETRY
    Espinosa, Sebastian
    Silva, Jorge F.
    Mendez, Rene A.
    Orchard, Marcos
    VII REUNION DE ASTRONOMIA DINAMICA EN LATINOAMERICA (ADELA 2016), 2018, 50 : 50 - 51
  • [40] An Improved Lower Bound for Bayesian Network Structure Learning
    Fan, Xiannian
    Yuan, Changhe
    PROCEEDINGS OF THE TWENTY-NINTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2015, : 3526 - 3532