Fast Bootstrapping Nonparametric Maximum Likelihood for Latent Mixture Models

被引:0
|
作者
Wang, Shijie [1 ]
Shin, Minsuk [2 ]
Bai, Ray [1 ]
机构
[1] Univ South Carolina, Dept Stat, Columbia, SC 29208 USA
[2] Gauss Labs, Palo Alto, CA 94301 USA
基金
美国国家科学基金会;
关键词
Bootstrap/resampling; deep neural network; generative process; mixing density estimation; nonparametric maximum likelihood estimation; two-stage algorithm; CONVEX-OPTIMIZATION; ESTIMATOR;
D O I
10.1109/LSP.2024.3376205
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Estimating the mixing density of a latent mixture model is an important task in signal processing. Nonparametric maximum likelihood estimation is one popular approach to this problem. If the latent variable distribution is assumed to be continuous, then bootstrapping can be used to approximate it. However, traditional bootstrapping requires repeated evaluations on resampled data and is not scalable. In this letter, we construct a generative process to rapidly produce nonparametric maximum likelihood bootstrap estimates. Our method requires only a single evaluation of a novel two-stage optimization algorithm. Simulations and real data analyses demonstrate that our procedure accurately estimates the mixing density with little computational cost even when there are a hundred thousand observations.
引用
收藏
页码:870 / 874
页数:5
相关论文
共 50 条
  • [1] Asymptotic theory for maximum likelihood in nonparametric mixture models
    van de Geer, S
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2003, 41 (3-4) : 453 - 464
  • [2] Constrained nonparametric maximum-likelihood estimation for mixture models
    Susko, E
    Kalbfleisch, JD
    Chen, J
    [J]. CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 1998, 26 (04): : 601 - 617
  • [3] On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture Models
    Zhang, Yangjing
    Cui, Ying
    Sen, Bodhisattva
    Toh, Kim-Chuan
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2024, 25
  • [4] On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture Models
    ZHANG, Y. A. N. G. J. I. N. G.
    CUI, Y. I. N. G.
    SEN, B. O. D. H. I. S. A. T. T. V. A.
    TOH, KIM-CHUAN
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2024, 25 : 1 - 46
  • [5] MCMC maximum likelihood for latent state models
    Jacquier, Eric
    Johannes, Michael
    Polson, Nicholas
    [J]. JOURNAL OF ECONOMETRICS, 2007, 137 (02) : 615 - 640
  • [6] Estimation of dynamic models with nonparametric simulated maximum likelihood
    Kristensen, Dennis
    Shin, Yongseok
    [J]. JOURNAL OF ECONOMETRICS, 2012, 167 (01) : 76 - 94
  • [7] Maximum Likelihood Robust Regression by Mixture Models
    Sami S. Brandt
    [J]. Journal of Mathematical Imaging and Vision, 2006, 25 : 25 - 48
  • [8] Maximum likelihood robust regression by mixture models
    Brandt, Sami S.
    [J]. JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2006, 25 (01) : 25 - 48
  • [9] A note on maximum likelihood estimation for mixture models
    G. Jogesh Babu
    [J]. Journal of the Korean Statistical Society, 2022, 51 : 1327 - 1333
  • [10] A note on maximum likelihood estimation for mixture models
    Babu, G. Jogesh
    [J]. JOURNAL OF THE KOREAN STATISTICAL SOCIETY, 2022, 51 (04) : 1327 - 1333