Efficient Acquisition Rules for Model-Based Approximate Bayesian Computation

被引:33
|
作者
Jarvenpaa, Marko [1 ]
Gutmann, Michael U. [2 ]
Pleska, Arijus [1 ]
Vehtari, Aki [1 ]
Marttinen, Pekka [1 ]
机构
[1] Aalto Univ, Dept Comp Sci, Helsinki Inst Informat Technol HIIT, Helsinki, Finland
[2] Univ Edinburgh, Sch Informat, Edinburgh, Midlothian, Scotland
来源
BAYESIAN ANALYSIS | 2019年 / 14卷 / 02期
基金
芬兰科学院;
关键词
approximate Bayesian computation; intractable likelihood; Gaussian processes; Bayesian optimisation; sequential experiment design; MONTE-CARLO; STATISTICAL-INFERENCE; REDUCTION;
D O I
10.1214/18-BA1121
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Approximate Bayesian computation (ABC) is a method for Bayesian inference when the likelihood is unavailable but simulating from the model is possible. However, many ABC algorithms require a large number of simulations, which can be costly. To reduce the computational cost, Bayesian optimisation (BO) and surrogate models such as Gaussian processes have been proposed. Bayesian optimisation enables one to intelligently decide where to evaluate the model next but common BO strategies are not designed for the goal of estimating the posterior distribution. Our paper addresses this gap in the literature. We propose to compute the uncertainty in the ABC posterior density, which is due to a lack of simulations to estimate this quantity accurately, and define a loss function that measures this uncertainty. We then propose to select the next evaluation location to minimise the expected loss. Experiments show that the proposed method often produces the most accurate approximations as compared to common BO strategies.
引用
收藏
页码:595 / 622
页数:28
相关论文
共 50 条
  • [1] Model-based Policy Optimization under Approximate Bayesian Inference
    Wang, Chaoqi
    Chen, Yuxin
    Murphy, Kevin
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 238, 2024, 238
  • [2] Approximate Bayesian Computation
    Beaumont, Mark A.
    ANNUAL REVIEW OF STATISTICS AND ITS APPLICATION, VOL 6, 2019, 6 : 379 - 403
  • [3] Approximate Bayesian Computation
    Sunnaker, Mikael
    Busetto, Alberto Giovanni
    Numminen, Elina
    Corander, Jukka
    Foll, Matthieu
    Dessimoz, Christophe
    PLOS COMPUTATIONAL BIOLOGY, 2013, 9 (01)
  • [4] Model-Based Computation
    Beebe, Cameron
    UNCONVENTIONAL COMPUTATION AND NATURAL COMPUTATION, UCNC 2016, 2016, 9726 : 75 - 86
  • [5] Model-based computation
    Beebe, Cameron
    NATURAL COMPUTING, 2018, 17 (02) : 271 - 281
  • [6] Model-based computation
    Cameron Beebe
    Natural Computing, 2018, 17 : 271 - 281
  • [7] Quantum approximate Bayesian computation for NMR model inference
    Sels, Dries
    Dashti, Hesam
    Mora, Samia
    Demler, Olga
    Demler, Eugene
    NATURE MACHINE INTELLIGENCE, 2020, 2 (07) : 396 - 402
  • [8] Lack of confidence in approximate Bayesian computation model choice
    Robert, Christian P.
    Cornuet, Jean-Marie
    Marin, Jean-Michel
    Pillai, Natesh S.
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2011, 108 (37) : 15112 - 15117
  • [9] Quantum approximate Bayesian computation for NMR model inference
    Dries Sels
    Hesam Dashti
    Samia Mora
    Olga Demler
    Eugene Demler
    Nature Machine Intelligence, 2020, 2 : 396 - 402
  • [10] Approximate Bayesian computation with semiparametric density ratio model
    Zhu, Weixuan
    Zuo, Tiantian
    Wang, Chunlin
    JOURNAL OF NONPARAMETRIC STATISTICS, 2023,