Mean-field variational approximate Bayesian inference for latent variable models

被引:39
|
作者
Consonni, Guido [2 ]
Marin, Jean-Michel [1 ]
机构
[1] Univ Orsay, Lab Math Bat 425, INRIA FUTURS Projects SELECT, F-91405 Orsay, France
[2] Univ Pavia, Dept Econ & Quantitat Methods, I-27100 Pavia, Italy
关键词
bayesian inference; Bayesian probit model; Gibbs sampling; latent variable models; marginal distribution; mean-field variational methods;
D O I
10.1016/j.csda.2006.10.028
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The ill-posed nature of missing variable models offers a challenging testing ground for new computational techniques. This is the case for the mean-field variational Bayesian inference. The behavior of this approach in the setting of the Bayesian probit model is illustrated. It is shown that the mean-field variational method always underestimates the posterior variance and, that, for small sample sizes, the mean-field variational approximation to the posterior location could be poor. (c) 2006 Elsevier B.V. All rights reserved.
引用
收藏
页码:790 / 798
页数:9
相关论文
共 50 条
  • [1] A note on mean-field variational approximations in Bayesian probit models
    Armagan, Artin
    Zaretzki, Russell L.
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2011, 55 (01) : 641 - 643
  • [2] Latent tree models and approximate inference in Bayesian networks
    Wang, Yi
    Zhang, Nevin L.
    Chen, Tao
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2008, 32 : 879 - 900
  • [3] Statistical inference for mean-field queueing models
    Yiqiang Q. Zhao
    Queueing Systems, 2022, 100 : 569 - 571
  • [4] Statistical inference for mean-field queueing models
    Zhao, Yiqiang Q.
    QUEUEING SYSTEMS, 2022, 100 (3-4) : 569 - 571
  • [5] Bayesian Learning in Sparse Graphical Factor Models via Variational Mean-Field Annealing
    Yoshida, Ryo
    West, Mike
    JOURNAL OF MACHINE LEARNING RESEARCH, 2010, 11 : 1771 - 1798
  • [6] Bayesian learning in sparse graphical factor models via variational mean-field annealing
    Yoshida, Ryo
    West, Mike
    Journal of Machine Learning Research, 2010, 11 : 1771 - 1798
  • [7] Approximate Inference in Credal Networks by Variational Mean Field Methods
    Ide, Jaime Shinsuke
    Cozman, Fabio Gagliardi
    ISIPTA 05-PROCEEDINGS OF THE FOURTH INTERNATIONAL SYMPOSIUM ON IMPRECISE PROBABILITIES AND THEIR APPLICATIONS, 2005, : 203 - 212
  • [8] Bayesian model selection via mean-field variational approximation
    Zhang, Yangfan
    Yang, Yun
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2024, 86 (03) : 742 - 770
  • [9] Perturbative Corrections for Approximate Inference in Gaussian Latent Variable Models
    Opper, Manfred
    Paquet, Ulrich
    Winther, Ole
    JOURNAL OF MACHINE LEARNING RESEARCH, 2013, 14 : 2857 - 2898
  • [10] Building blocks for variational Bayesian learning of latent variable models
    Raiko, Tapani
    Valpola, Harri
    Harva, Markus
    Karhunen, Juha
    Journal of Machine Learning Research, 2007, 8 : 155 - 201