Sequential Likelihood-Free Inference with Neural Proposal

被引:0
|
作者
Kim, Dongjun [1 ]
Song, Kyungwoo [2 ]
Kim, Yoon-Yeong [3 ]
Shin, Yongjin [4 ]
Kang, Wanmo [5 ]
Moon, Il-Chul [1 ]
Joo, Weonyoung [6 ]
机构
[1] Korea Adv Inst Sci & Technol, Dept Ind & Syst Engn, Daejeon, South Korea
[2] Yonsei Univ, Dept Appl Stat, Seoul, South Korea
[3] AI Autonomy Technol Ctr, Agcy Def Dev, Seoul, South Korea
[4] ioCrops, Seoul, South Korea
[5] Korea Adv Inst Sci & Technol, Dept Math Sci, Daejeon, South Korea
[6] EWHA Womans Univ, Dept Stat, Seoul, South Korea
关键词
Likelihood-Free inference; Simulation parameter calibration; MCMC; Generative models; MONTE-CARLO; MODEL;
D O I
10.1016/j.patrec.2023.03.021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Bayesian inference without the likelihood evaluation, or likelihood-free inference , has been a key research topic in simulation studies for gaining quantitatively validated simulation models on real-world datasets. As the likelihood evaluation is inaccessible, previous papers train the amortized neural network to esti-mate the ground-truth posterior for the simulation of interest. Training the network and accumulating the dataset alternatively in a sequential manner could save the total simulation budget by orders of mag-nitude. In the data accumulation phase, the new simulation inputs are chosen within a portion of the total simulation budget to accumulate upon the collected dataset so far. This newly accumulated data degenerates because the set of simulation inputs is hardly mixed, and this degenerated data collection process ruins the posterior inference. This paper introduces a new sampling approach, called Neural Pro-posal (NP), of the simulation input that resolves the biased data collection as it guarantees the i.i.d. sam-pling. The experiments show the improved performance of our sampler, especially for the simulations with multi-modal posteriors. (c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页码:102 / 109
页数:8
相关论文
共 50 条
  • [1] Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flows
    Papamakarios, George
    Sterratt, David C.
    Murray, Iain
    [J]. 22ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 89, 2019, 89 : 837 - 848
  • [2] CoLFI: Cosmological Likelihood-free Inference with Neural Density Estimators
    Wang, Guo-Jian
    Cheng, Cheng
    Ma, Yin-Zhe
    Xia, Jun-Qing
    Abebe, Amare
    Beesham, Aroonkumar
    [J]. ASTROPHYSICAL JOURNAL SUPPLEMENT SERIES, 2023, 268 (01):
  • [3] Score Matched Neural Exponential Families for Likelihood-Free Inference
    Pacchiardi, Lorenzo
    Dutta, Ritabrata
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23 : 1 - 71
  • [4] Score Matched Neural Exponential Families for Likelihood-Free Inference
    Pacchiardi, Lorenzo
    Dutta, Ritabrata
    [J]. Journal of Machine Learning Research, 2022, 23
  • [5] Generalized Bayesian likelihood-free inference
    Pacchiardi, Lorenzo
    Khoo, Sherman
    Dutta, Ritabrata
    [J]. ELECTRONIC JOURNAL OF STATISTICS, 2024, 18 (02): : 3628 - 3686
  • [6] Likelihood-free inference via classification
    Gutmann, Michael U.
    Dutta, Ritabrata
    Kaski, Samuel
    Corander, Jukka
    [J]. STATISTICS AND COMPUTING, 2018, 28 (02) : 411 - 425
  • [7] Likelihood-Free Inference by Ratio Estimation
    Thomas, Owen
    Dutta, Ritabrata
    Corander, Jukka
    Kaski, Samuel
    Gutmann, Michael U.
    [J]. BAYESIAN ANALYSIS, 2022, 17 (01): : 1 - 31
  • [8] pyABC: distributed, likelihood-free inference
    Klinger, Emmanuel
    Rickert, Dennis
    Hasenauer, Jan
    [J]. BIOINFORMATICS, 2018, 34 (20) : 3591 - 3593
  • [9] ELFI: Engine for Likelihood-Free Inference
    Lintusaari, Jarno
    Vuollekoski, Henri
    Kangasraasio, Antti
    Skyten, Kusti
    Jarvenpaa, Marko
    Marttinen, Pekka
    Gutmann, Michael U.
    Vehtari, Aki
    Corander, Jukka
    Kaski, Samuel
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2018, 19
  • [10] Expectation Propagation for Likelihood-Free Inference
    Barthelme, Simon
    Chopin, Nicolas
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2014, 109 (505) : 315 - 333