Checking for Prior-Data Conflict Using Prior-to-Posterior Divergences

被引:17
|
作者
Nott, David J. [1 ,2 ]
Wang, Xueou [3 ]
Evans, Michael [4 ]
Englert, Berthold-Georg [5 ,6 ,7 ]
机构
[1] Dept Stat & Appl Probabil, Singapore 117546, Singapore
[2] Natl Univ Singapore, Operat Res & Analyt Cluster, Singapore 119077, Singapore
[3] Natl Univ Singapore, Dept Stat & Appl Probabil, Singapore 117546, Singapore
[4] Univ Toronto, Dept Stat Sci, Toronto, ON M5S 3G3, Canada
[5] Natl Univ Singapore, Ctr Quantum Technol, Singapore 117542, Singapore
[6] Natl Univ Singapore, Dept Phys, Singapore 117542, Singapore
[7] CNRS UNS NUS NTU Int Joint Res Unit, MajuLab, UMI 3654, Singapore, Singapore
基金
新加坡国家研究基金会; 加拿大自然科学与工程研究理事会;
关键词
Bayesian inference; model checking; prior data-conflict; variational Bayes; P-VALUES;
D O I
10.1214/19-STS731
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
y When using complex Bayesian models to combine information, checking consistency of the information contributed by different components of the model for inference is good statistical practice. Here a new method is developed for detecting prior-data conflicts in Bayesian models based on comparing the observed value of a prior-to-posterior divergence to its distribution under the prior predictive distribution for the data. The divergence measure used in our model check is a measure of how much beliefs have changed from prior to posterior, and can be thought of as a measure of the overall size of a relative belief function. It is shown that the proposed method is intuitive, has desirable properties, can be extended to hierarchical settings, and is related asymptotically to Jeffreys' and reference prior distributions. In the case where calculations are difficult, the use of variational approximations as a way of relieving the computational burden is suggested. The methods are compared in a number of examples with an alternative but closely related approach in the literature based on the prior predictive distribution of a minimal sufficient statistic.
引用
收藏
页码:234 / 253
页数:20
相关论文
共 50 条
  • [1] Using Prior Expansions for Prior-Data Conflict Checking
    Nott, David J.
    Seah, Max
    Al-Labadi, Luai
    Evans, Michael
    Ng, Hui Khoon
    Englert, Berthold-Georg
    [J]. BAYESIAN ANALYSIS, 2021, 16 (01): : 203 - 231
  • [2] Checking for Prior-Data Conflict
    Evans, Michael
    Moshonov, Hadas
    [J]. BAYESIAN ANALYSIS, 2006, 1 (04): : 893 - 914
  • [3] A limit result for the prior predictive applied to checking for prior-data conflict
    Evans, Michael
    Jang, Gun Ho
    [J]. STATISTICS & PROBABILITY LETTERS, 2011, 81 (08) : 1034 - 1038
  • [4] Checking for model failure and for prior-data conflict with the constrained multinomial model
    Berthold-Georg Englert
    Michael Evans
    Gun Ho Jang
    Hui Khoon Ng
    David Nott
    Yi-Lin Seah
    [J]. Metrika, 2021, 84 : 1141 - 1168
  • [5] Checking for model failure and for prior-data conflict with the constrained multinomial model
    Englert, Berthold-Georg
    Evans, Michael
    Jang, Gun Ho
    Ng, Hui Khoon
    Nott, David
    Seah, Yi-Lin
    [J]. METRIKA, 2021, 84 (08) : 1141 - 1168
  • [6] Weakly informative priors and prior-data conflict checking for likelihood-free inference
    Chakraborty, Atlanta
    Nott, David J.
    Evans, Michael
    [J]. STATISTICS AND ITS INTERFACE, 2023, 16 (03) : 445 - 457
  • [7] On Prior-Data Conflict in Predictive Bernoulli Inferences
    Walter, Gero
    Augustin, Thomas
    Coolen, Frank P. A.
    [J]. ISIPTA '11 - PROCEEDINGS OF THE SEVENTH INTERNATIONAL SYMPOSIUM ON IMPRECISE PROBABILITY: THEORIES AND APPLICATIONS, 2011, : 391 - 400
  • [8] Imprecision and Prior-data Conflict in Generalized Bayesian Inference
    Walter, Gero
    Augustin, Thomas
    [J]. JOURNAL OF STATISTICAL THEORY AND PRACTICE, 2009, 3 (01) : 255 - 271
  • [9] System Reliability Estimation under Prior-Data Conflict
    Walter, Gero
    Coolen, Frank P. A.
    Flapper, Simme Douwe
    [J]. PROCEEDINGS OF THE 9TH INTERNATIONAL SYMPOSIUM ON IMPRECISE PROBABILITY: THEORIES AND APPLICATIONS (ISIPTA '15), 2015, : 350 - 350
  • [10] Sets of Priors Reflecting Prior-Data Conflict and Agreement
    Walter, Gero
    Coolen, Frank P. A.
    [J]. INFORMATION PROCESSING AND MANAGEMENT OF UNCERTAINTY IN KNOWLEDGE-BASED SYSTEMS, IPMU 2016, PT I, 2016, 610 : 153 - 164