An approach to diagnosing total variation convergence of MCMC algorithms

被引:13
|
作者
Brooks, SP
Dellaportas, P
Roberts, GO
机构
[1] ATHENS UNIV ECON,DEPT STAT,GR-10434 ATHENS,GREECE
[2] UNIV CAMBRIDGE,STAT LAB,CAMBRIDGE CB2 1SB,ENGLAND
关键词
Gibbs sampler; L-1; Distance; Markov chain Monte Carlo; Metropolis Hastings;
D O I
10.2307/1390732
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We introduce a convergence diagnostic procedure for MCMC that operates by estimating total variation distances for the distribution of the algorithm after certain numbers of iterations. The method has advantages over many existing methods in terms of applicability, utility, and interpretability. It can be used to assess convergence of both marginal and joint posterior densities, and we show how it can be applied to the two most commonly used MCMC samplers-the Gibbs Sampler and the Metropolis Hastings algorithm. In some cases, the computational burden of this method may be large, but we show how lower dimensional analogues of the full-dimensional method are available at a lower computational cost. Illustrative examples highlight the utility and interpretability of the proposed diagnostic, but also highlight some of its limitations.
引用
收藏
页码:251 / 265
页数:15
相关论文
共 50 条
  • [1] Convergence Rates of Attractive-Repulsive MCMC Algorithms
    Yu Hang Jiang
    Tong Liu
    Zhiya Lou
    Jeffrey S. Rosenthal
    Shanshan Shangguan
    Fei Wang
    Zixuan Wu
    Methodology and Computing in Applied Probability, 2022, 24 : 2029 - 2054
  • [2] Convergence Rates of Attractive-Repulsive MCMC Algorithms
    Jiang, Yu Hang
    Liu, Tong
    Lou, Zhiya
    Rosenthal, Jeffrey S.
    Shangguan, Shanshan
    Wang, Fe
    Wu, Zixuan
    METHODOLOGY AND COMPUTING IN APPLIED PROBABILITY, 2022, 24 (03) : 2029 - 2054
  • [3] Convergence controls for MCMC algorithms, with applications to hidden Markov chains
    Robert, CP
    Rydén, T
    Titterington, DM
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 1999, 64 (04) : 327 - 355
  • [4] On some method for diagnosing convergence in MCMC setups via atoms and renewal sets
    Romaniuk, Maciej
    CONTROL AND CYBERNETICS, 2007, 36 (04): : 985 - 1008
  • [5] On the Convergence of Primal–Dual Hybrid Gradient Algorithms for Total Variation Image Restoration
    Silvia Bonettini
    Valeria Ruggiero
    Journal of Mathematical Imaging and Vision, 2012, 44 : 236 - 253
  • [6] On the total-variation convergence of regularizing algorithms for ill-posed problems
    Leonov A.S.
    Computational Mathematics and Mathematical Physics, 2007, 47 (5) : 732 - 747
  • [7] Is partial-dimension convergence a problem for inferences from MCMC algorithms?
    Gill, Jeff
    POLITICAL ANALYSIS, 2008, 16 (02) : 153 - 178
  • [8] On the Convergence of Stochastic Gradient MCMC Algorithms with High-Order Integrators
    Chen, Changyou
    Ding, Nan
    Carin, Lawrence
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [9] Convergence rates for MCMC algorithms for a robust Bayesian binary regression model
    Roy, Vivekananda
    ELECTRONIC JOURNAL OF STATISTICS, 2012, 6 : 2463 - 2485
  • [10] TOTAL VARIATION + UNIFORM CONVERGENCE
    SANCHEZ, DA
    AMERICAN MATHEMATICAL MONTHLY, 1964, 71 (05): : 537 - +