Accelerating Bayesian Structure Learning in Sparse Gaussian Graphical Models

被引:9
|
作者
Mohammadi, Reza [1 ]
Massam, Helene [2 ]
Letac, Gerard [3 ]
机构
[1] Univ Amsterdam, Dept Business Analyt, Amsterdam, Netherlands
[2] York Univ, Dept Math & Stat, N York, ON, Canada
[3] Univ Paul Sabatier, Lab Stat & Probabilites, Toulouse, France
关键词
Bayes factors; Model selection; Normalizing constants; G-Wishart; WISHART DISTRIBUTIONS; INFERENCE; SAMPLER;
D O I
10.1080/01621459.2021.1996377
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Bayesian structure learning in Gaussian graphical models is often done by search algorithms over the graph space.The conjugate prior for the precision matrix satisfying graphical constraints is the well-known G-Wishart.With this prior, the transition probabilities in the search algorithms necessitate evaluating the ratios of the prior normalizing constants of G-Wishart.In moderate to high-dimensions, this ratio is often approximated by using sampling-based methods as computationally expensive updates in the search algorithm.Calculating this ratio so far has been a major computational bottleneck.We overcome this issue by representing a search algorithm in which the ratio of normalizing constants is carried out by an explicit closed-form approximation.Using this approximation within our search algorithm yields significant improvement in the scalability of structure learning without sacrificing structure learning accuracy.We study the conditions under which the approximation is valid.We also evaluate the efficacy of our method with simulation studies.We show that the new search algorithm with our approximation outperforms state-of-the-art methods in both computational efficiency and accuracy.The implementation of our work is available in the R package BDgraph.
引用
收藏
页码:1345 / 1358
页数:14
相关论文
共 50 条
  • [41] Approximate Bayesian estimation in large coloured graphical Gaussian models
    Li, Qiong
    Gao, Xin
    Massam, Helene
    [J]. CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2018, 46 (01): : 176 - 203
  • [42] Bayesian inference for Gaussian graphical models beyond decomposable graphs
    Khare, Kshitij
    Rajaratnam, Bala
    Saha, Abhishek
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2018, 80 (04) : 727 - 747
  • [43] Bayesian inference of clustering and multiple Gaussian graphical models selection
    Wei Dai
    Baisuo Jin
    [J]. Journal of the Korean Statistical Society, 2022, 51 : 422 - 440
  • [44] Bayesian model-averaged regularization for Gaussian graphical models
    Liu, Zhe
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2017, 46 (04) : 3213 - 3223
  • [45] Quasi-Bayesian estimation of large Gaussian graphical models
    Atchade, Yves F.
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2019, 173 : 656 - 671
  • [46] Bayesian Uncertainty Estimation for Gaussian Graphical Models and Centrality Indices
    Jongerling, J.
    Epskamp, S.
    Williams, D. R.
    [J]. MULTIVARIATE BEHAVIORAL RESEARCH, 2023, 58 (02) : 311 - 339
  • [47] Bayesian inference of clustering and multiple Gaussian graphical models selection
    Dai, Wei
    Jin, Baisuo
    [J]. JOURNAL OF THE KOREAN STATISTICAL SOCIETY, 2022, 51 (02) : 422 - 440
  • [48] Fast and Scalable Learning of Sparse Changes in High-Dimensional Gaussian Graphical Model Structure
    Wang, Beilun
    Sekhon, Arshdeep
    Qi, Yanjun
    [J]. INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 84, 2018, 84
  • [49] Empirical Bayesian learning in AR graphical models
    Zorzi, Mattia
    [J]. AUTOMATICA, 2019, 109
  • [50] Gaussian Kernel Width Optimization for Sparse Bayesian Learning
    Mohsenzadeh, Yalda
    Sheikhzadeh, Hamid
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (04) : 709 - 719