Cyclical Variational Bayes Monte Carlo for efficient multi-modal posterior distributions evaluation

被引:3
|
作者
Igea, Felipe [1 ]
Cicirello, Alice [1 ,2 ]
机构
[1] Univ Oxford, Dept Engn Sci, Parks Rd, Oxford OX1 3PJ, England
[2] Delft Univ Technol, Fac Civil Engn & Geosci, Dept Engn Struct, Sect Mech & Phys Struct MPS, Stevinweg 1, NL-2628 Delft, Netherlands
基金
英国工程与自然科学研究理事会;
关键词
Bayesian inference; Variational inference; Bayesian quadrature; Gaussian process; Model updating; Cyclical annealing; UPDATING MODELS; UNCERTAINTIES;
D O I
10.1016/j.ymssp.2022.109868
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Multi-modal distributions of some physics-based model parameters are often encountered in engineering due to different situations such as a change in some environmental conditions, and the presence of some types of damage and non-linearity. In statistical model updating, for locally identifiable parameters, it can be anticipated that multi-modal posterior distributions would be found. The full characterization of these multi-modal distributions is important as methodologies for structural condition monitoring in structures are frequently based in the comparison of the damaged and healthy models of the structure. The characterization of posterior multi-modal distributions using state-of-the-art sampling techniques would require a large number of simu-lations of expensive-to-run physics-based models. Therefore, when a limited number of simula-tions can be run, as it often occurs in engineering, the traditional sampling techniques would not be able to capture accurately the multi-modal distributions. This could potentially lead to large numerical errors when assessing the performance of an engineering structure under uncertainty.Therefore, an approach is proposed for drastically reducing the number of models runs while yielding accurate estimates of highly multi-modal posterior distributions. This approach in-troduces a cyclical annealing schedule into the Variational Bayes Monte Carlo (VBMC) method to improve the algorithm's phase of exploration and the finding of high probability areas in the multi-modal posteriors throughout the different cycles.Three numerical and one experimental investigations are used to compare the proposed cyclical VBMC with the standard VBMC algorithm, the monotonic VBMC and the Transitional Ensemble Markov Chain Monte Carlo (TEMCMC). It is shown that the standard VBMC fails in capturing multi-modal posteriors as it is unable to escape already found regions of high posterior density. In the presence of highly multi-modal posteriors, the proposed cyclical VBMC algorithm outperforms all the other approaches in terms of accuracy of the resulting posterior, and number of model runs required.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] Variational Hybrid Monte Carlo for Efficient Multi-Modal Data Sampling
    Sun, Shiliang
    Zhao, Jing
    Gu, Minghao
    Wang, Shanhu
    [J]. ENTROPY, 2023, 25 (04)
  • [2] Monte Carlo methods for multi-modal distributions
    Rudoy, Daniel
    Wolfe, Patrick J.
    [J]. 2006 FORTIETH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS, VOLS 1-5, 2006, : 2019 - +
  • [3] Variational Bayes on Monte Carlo Steroids
    Grover, Aditya
    Ermon, Stefano
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [4] Development of a new multi-modal Monte-Carlo radiotherapy planning system
    Kumada, H.
    Nakamura, T.
    Komeda, M.
    Matsumura, A.
    [J]. APPLIED RADIATION AND ISOTOPES, 2009, 67 (7-8) : S118 - S121
  • [5] Efficient accuracy evaluation for multi-modal sensed data
    Yan Zhang
    Hongzhi Wang
    Hong Gao
    Jianzhong Li
    [J]. Journal of Combinatorial Optimization, 2016, 32 : 1068 - 1088
  • [6] Efficient accuracy evaluation for multi-modal sensed data
    Zhang, Yan
    Wang, Hongzhi
    Gao, Hong
    Li, Jianzhong
    [J]. JOURNAL OF COMBINATORIAL OPTIMIZATION, 2016, 32 (04) : 1068 - 1088
  • [7] Beyond Log-concavity: Provable Guarantees for Sampling Multi-modal Distributions using Simulated Tempering Langevin Monte Carlo
    Ge, Rong
    Lee, Holden
    Risteski, Andrej
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [8] Transdimensional sequential Monte Carlo using variational Bayes - SMCVB
    McGrory, C. A.
    Pettitt, A. N.
    Titterington, D. M.
    Alston, C. L.
    Kelly, M.
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2016, 93 : 246 - 254
  • [9] A variational approach to multi-modal image matching
    Chefd'Hotel, C
    Hermosillo, G
    Faugeras, O
    [J]. IEEE WORKSHOP ON VARIATIONAL AND LEVEL SET METHODS IN COMPUTER VISION, PROCEEDINGS, 2001, : 21 - 28
  • [10] An efficient sampling algorithm for variational Monte Carlo
    Scemama, Anthony
    Lelievre, Tomy
    Stoltz, Gabriel
    Cances, Eric
    Caffarel, Michel
    [J]. JOURNAL OF CHEMICAL PHYSICS, 2006, 125 (11):