Bayesian analysis of mixture models with an unknown number of components - An alternative to reversible jump methods

被引:311
|
作者
Stephens, M [1 ]
机构
[1] Univ Oxford, Dept Stat, Oxford OX1 3TG, England
来源
ANNALS OF STATISTICS | 2000年 / 28卷 / 01期
关键词
Bayesian analysis; birth-death process; Markov process; MCMC; mixture model; model choice; reversible jump; spatial point process;
D O I
10.1214/aos/1016120364
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Richardson and Green present a method of performing a Bayesian analysis of data from a finite mixture distribution with an unknown number of components. Their method is a Markov Chain Monte Carlo (MCMC) approach, which makes use of the "reversible jump" methodology described by Green. We describe an alternative MCMC method which views the parameters of the model as a (marked point process, extending methods suggested by Ripley to create a Markov birth-death process with an appropriate stationary distribution. Our method is easy Co implement, even in the case of data in more than one dimension, and we illustrate it on both univariate and bivariate data. There appears to be considerable potential for applying these ideas to other contexts, as an alternative to more general reversible jump methods, and we conclude with a brief discussion of how this might be achieved.
引用
收藏
页码:40 / 74
页数:35
相关论文
共 50 条
  • [1] Bayesian Analysis of Mixture Structural Equation Models With an Unknown Number of Components
    Liu, Hefei
    Song, Xin Yuan
    [J]. STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL, 2018, 25 (01) : 41 - 55
  • [2] Overfitting Bayesian Mixture Models with an Unknown Number of Components
    van Havre, Zoe
    White, Nicole
    Rousseau, Judith
    Mengersen, Kerrie
    [J]. PLOS ONE, 2015, 10 (07):
  • [3] Particle filters for mixture models with an unknown number of components
    Paul Fearnhead
    [J]. Statistics and Computing, 2004, 14 : 11 - 21
  • [4] Particle filters for mixture models with an unknown number of components
    Fearnhead, P
    [J]. STATISTICS AND COMPUTING, 2004, 14 (01) : 11 - 21
  • [5] Bayesian estimation for a mixture of simplex distributions with an unknown number of components: HDI analysis in Brazil
    Fernando da Paza, Rosineide
    Bazan, Jorge Luis
    Milan, Luis Aparecido
    [J]. JOURNAL OF APPLIED STATISTICS, 2017, 44 (09) : 1630 - 1643
  • [6] On Bayesian analysis of mixtures with an unknown number of components
    Richardson, S
    Green, PJ
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1997, 59 (04): : 731 - 758
  • [7] A practical sampling approach for a Bayesian mixture model with unknown number of components
    Wang, Liqun
    Fu, James C.
    [J]. STATISTICAL PAPERS, 2007, 48 (04) : 631 - 653
  • [8] A practical sampling approach for a Bayesian mixture model with unknown number of components
    Liqun Wang
    James C. Fu
    [J]. Statistical Papers, 2007, 48 : 631 - 653
  • [9] Unsupervised learning of regression mixture models with unknown number of components
    Chamroukhi, Faicel
    [J]. JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2016, 86 (12) : 2308 - 2334
  • [10] On Bayesian analysis of mixtures with an unknown number of components - Discussion
    Robert, CP
    Aitkin, M
    Cox, DR
    Stephens, M
    Polymenis, A
    Gilks, WR
    Nobile, A
    Hodgson, M
    OHagan, A
    Longford, NT
    Dawid, AP
    Atkinson, AC
    Bernardo, JM
    Besag, J
    Brooks, SP
    Byers, S
    Raftery, A
    Celeux, G
    Cheng, RCH
    Liu, WB
    Chien, YH
    George, EI
    Cressie, N
    Huang, HC
    Gruet, MA
    Heath, SC
    Jennison, C
    Lawson, AB
    Clark, A
    McLachlan, G
    Peel, D
    Mengersen, K
    George, A
    Philippe, A
    Roeder, K
    Wasserman, L
    Schlattmann, P
    Bohning, D
    Titterington, DM
    Tong, H
    West, M
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1997, 59 (04) : 758 - 792