Robust estimation of mixing measures in finite mixture models

被引:4
|
作者
Nhat Ho [1 ]
XuanLong Nguyen [2 ]
Ritov, Ya'acov [2 ]
机构
[1] Univ Calif Berkeley, Dept EECS, Berkeley, CA 94720 USA
[2] Univ Michigan, Dept Stat, Ann Arbor, MI 48109 USA
关键词
convergence rates; Fisher singularities; minimum distance estimator; mixture models; model misspecification; model selection; strong identifiability; superefficiency; Wasserstein distances; MINIMUM HELLINGER DISTANCE; STRONG IDENTIFIABILITY; PARAMETER-ESTIMATION; CONVERGENCE-RATES; ORDER; INFERENCE; NUMBER; COMPONENTS; SELECTION;
D O I
10.3150/18-BEJ1087
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In finite mixture models, apart from underlying mixing measure, true kernel density function of each sub-population in the data is, in many scenarios, unknown. Perhaps the most popular approach is to choose some kernel functions that we empirically believe our data are generated from and use these kernels to fit our models. Nevertheless, as long as the chosen kernel and the true kernel are different, statistical inference of mixing measure under this setting will be highly unstable. To overcome this challenge, we propose flexible and efficient robust estimators of the mixing measure in these models, which are inspired by the idea of minimum Hellinger distance estimator, model selection criteria, and superefficiency phenomenon. We demonstrate that our estimators consistently recover the true number of components and achieve the optimal convergence rates of parameter estimation under both the well- and misspecified kernel settings for any fixed bandwidth. These desirable asymptotic properties are illustrated via careful simulation studies with both synthetic and real data.
引用
收藏
页码:828 / 857
页数:30
相关论文
共 50 条
  • [1] Robust Estimation in Finite Mixture Models*
    Lecestre, Alexandre
    [J]. ESAIM-PROBABILITY AND STATISTICS, 2023, 27 : 402 - 460
  • [2] Robust estimation for the order of finite mixture models
    Sangyeol Lee
    Taewook Lee
    [J]. Metrika, 2008, 68 : 365 - 390
  • [3] Robust estimation for the order of finite mixture models
    Lee, Sangyeol
    Lee, Taewook
    [J]. METRIKA, 2008, 68 (03) : 365 - 390
  • [4] CONVERGENCE OF LATENT MIXING MEASURES IN FINITE AND INFINITE MIXTURE MODELS
    Xuanlong Nguyen
    [J]. ANNALS OF STATISTICS, 2013, 41 (01): : 370 - 400
  • [5] The robust estimation method for a finite mixture of Poisson mixed-effect models
    Xiang, Liming
    Yau, Kelvin K. W.
    Lee, Andy H.
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2012, 56 (06) : 1994 - 2005
  • [6] Unsupervised selection and estimation of finite mixture models
    Figueiredo, MAT
    Jain, AK
    [J]. 15TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 2, PROCEEDINGS: PATTERN RECOGNITION AND NEURAL NETWORKS, 2000, : 87 - 90
  • [7] Directional mixture models and optimal estimation of the mixing density
    Kim, PT
    Koo, JY
    [J]. CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2000, 28 (02): : 383 - 398
  • [8] Large deviations for risk measures in finite mixture models
    Bignozzi, Valeria
    Macci, Claudio
    Petrella, Lea
    [J]. INSURANCE MATHEMATICS & ECONOMICS, 2018, 80 : 84 - 92
  • [9] Robust variable selection for finite mixture regression models
    Tang, Qingguo
    Karunamuni, R. J.
    [J]. ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2018, 70 (03) : 489 - 521
  • [10] Robust variable selection for finite mixture regression models
    Qingguo Tang
    R. J. Karunamuni
    [J]. Annals of the Institute of Statistical Mathematics, 2018, 70 : 489 - 521