Accelerating Bayesian Structure Learning in Sparse Gaussian Graphical Models

被引:9
|
作者
Mohammadi, Reza [1 ]
Massam, Helene [2 ]
Letac, Gerard [3 ]
机构
[1] Univ Amsterdam, Dept Business Analyt, Amsterdam, Netherlands
[2] York Univ, Dept Math & Stat, N York, ON, Canada
[3] Univ Paul Sabatier, Lab Stat & Probabilites, Toulouse, France
关键词
Bayes factors; Model selection; Normalizing constants; G-Wishart; WISHART DISTRIBUTIONS; INFERENCE; SAMPLER;
D O I
10.1080/01621459.2021.1996377
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Bayesian structure learning in Gaussian graphical models is often done by search algorithms over the graph space.The conjugate prior for the precision matrix satisfying graphical constraints is the well-known G-Wishart.With this prior, the transition probabilities in the search algorithms necessitate evaluating the ratios of the prior normalizing constants of G-Wishart.In moderate to high-dimensions, this ratio is often approximated by using sampling-based methods as computationally expensive updates in the search algorithm.Calculating this ratio so far has been a major computational bottleneck.We overcome this issue by representing a search algorithm in which the ratio of normalizing constants is carried out by an explicit closed-form approximation.Using this approximation within our search algorithm yields significant improvement in the scalability of structure learning without sacrificing structure learning accuracy.We study the conditions under which the approximation is valid.We also evaluate the efficacy of our method with simulation studies.We show that the new search algorithm with our approximation outperforms state-of-the-art methods in both computational efficiency and accuracy.The implementation of our work is available in the R package BDgraph.
引用
收藏
页码:1345 / 1358
页数:14
相关论文
共 50 条
  • [1] Bayesian Structure Learning in Sparse Gaussian Graphical Models
    Mohammadi, A.
    Wit, E. C.
    [J]. BAYESIAN ANALYSIS, 2015, 10 (01): : 109 - 138
  • [2] Learning Sparse Gaussian Graphical Models with Overlapping Blocks
    Hosseini, Mohammad Javad
    Lee, Su-In
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [3] Asymptotic Bayesian structure learning using graph supports for Gaussian graphical models
    Marrelec, Guillaume
    Benali, Habib
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2006, 97 (06) : 1451 - 1466
  • [4] Bayesian Estimation for Gaussian Graphical Models: Structure Learning, Predictability, and Network Comparisons
    Williams, Donald R.
    [J]. MULTIVARIATE BEHAVIORAL RESEARCH, 2021, 56 (02) : 336 - 352
  • [5] Inferring sparse Gaussian graphical models with latent structure
    Ambroise, Christophe
    Chiquet, Julien
    Matias, Catherine
    [J]. ELECTRONIC JOURNAL OF STATISTICS, 2009, 3 : 205 - 238
  • [6] Bayesian structure learning in graphical models
    Banerjee, Sayantan
    Ghosal, Subhashis
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2015, 136 : 147 - 162
  • [7] Joint Learning of Multiple Sparse Matrix Gaussian Graphical Models
    Huang, Feihu
    Chen, Songcan
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (11) : 2606 - 2620
  • [8] Singular Gaussian graphical models: Structure learning
    Masmoudi, Khalil
    Masmoudi, Afif
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2018, 47 (10) : 3106 - 3117
  • [9] Bayesian sparse graphical models and their mixtures
    Talluri, Rajesh
    Baladandayuthapani, Veerabhadran
    Mallick, Bani K.
    [J]. STAT, 2014, 3 (01): : 109 - 125
  • [10] Bayesian Covariate-Dependent Gaussian Graphical Models with Varying Structure
    Ni, Yang
    Stingo, Francesco C.
    Baladandayuthapani, Veerabhadran
    [J]. Journal of Machine Learning Research, 2022, 23