Bayesian model selection using encompassing priors

被引:45
|
作者
Klugkist, I [1 ]
Kato, B [1 ]
Hoijtink, H [1 ]
机构
[1] Univ Utrecht, Dept Methodol & Stat, NL-3508 TC Utrecht, Netherlands
关键词
Bayes factors; inequality constraints; objective Bayesian inference; posterior probability;
D O I
10.1111/j.1467-9574.2005.00279.x
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This paper deals with Bayesian selection of models that can be specified using inequality constraints among the model parameters. The concept of encompassing priors is introduced, that is, a prior distribution for an unconstrained model from which the prior distributions of the constrained models can be derived. It is shown that the Bayes factor for the encompassing and a constrained model has a very nice interpretation: it is the ratio of the proportion of the prior and posterior distribution of the encompassing model in agreement with the constrained model. It is also shown that, for a specific class of models, selection based on encompassing priors will render a virtually objective selection procedure. The paper concludes with three illustrative examples: an analysis of variance with ordered means; a contingency table analysis with ordered odds-ratios; and a multilevel model with ordered slopes.
引用
收藏
页码:57 / 69
页数:13
相关论文
共 50 条
  • [1] Intrinsic priors for model selection using an encompassing model with applications to censored failure time data
    Kim, SW
    Sun, DC
    [J]. LIFETIME DATA ANALYSIS, 2000, 6 (03) : 251 - 269
  • [2] Intrinsic Priors for Model Selection Using an Encompassing Model with Applications to Censored Failure Time Data
    Seong W. Kim
    Dongchu Sun
    [J]. Lifetime Data Analysis, 2000, 6 : 251 - 269
  • [3] Entropic Priors and Bayesian Model Selection
    Brewer, Brendon J.
    Francis, Matthew J.
    [J]. BAYESIAN INFERENCE AND MAXIMUM ENTROPY METHODS IN SCIENCE AND ENGINEERING, 2009, 1193 : 179 - +
  • [4] Selection of model discrepancy priors in Bayesian calibration
    Ling, You
    Mullins, Joshua
    Mahadevan, Sankaran
    [J]. JOURNAL OF COMPUTATIONAL PHYSICS, 2014, 276 : 665 - 680
  • [5] Bayesian model selection for generalized linear models using non-local priors
    Shi, Guiling
    Lim, Chae Young
    Maiti, Tapabrata
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2019, 133 : 285 - 296
  • [6] Model selection in Bayesian neural networks via horseshoe priors
    Ghosh, Soumya
    Yao, Jiayu
    Doshi-Velez, Finale
    [J]. Journal of Machine Learning Research, 2019, 20
  • [7] Model Selection in Bayesian Neural Networks via Horseshoe Priors
    Ghosh, Soumya
    Yao, Jiayu
    Doshi-Velez, Finale
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20
  • [8] BAYESIAN MODEL SELECTION FOR UNSUPERVISED IMAGE DECONVOLUTION WITH STRUCTURED GAUSSIAN PRIORS
    Harroue, B.
    Giovannelli, J-F
    Pereyra, M.
    [J]. 2021 IEEE STATISTICAL SIGNAL PROCESSING WORKSHOP (SSP), 2021, : 241 - 245
  • [9] Bayesian Feature Selection with Strongly Regularizing Priors Maps to the Ising Model
    Fisher, Charles K.
    Mehta, Pankaj
    [J]. NEURAL COMPUTATION, 2015, 27 (11) : 2411 - 2422
  • [10] Bayesian analysis for the Lomax model using noninformative priors
    He, Daojiang
    Sun, Dongchu
    Zhu, Qing
    [J]. STATISTICAL THEORY AND RELATED FIELDS, 2023, 7 (01) : 61 - 68