Bayesian estimation of generalized Gamma mixture model based on variational EM algorithm

被引:29
|
作者
Liu, Chi [1 ]
Li, Heng-Chao [1 ]
Fu, Kun [2 ]
Zhang, Fan [3 ]
Datcu, Mihai [4 ]
Emery, William J. [5 ]
机构
[1] Southwest Jiaotong Univ, Sichuan Prov Key Lab Informat Coding & Transmiss, Chengdu 610031, Sichuan, Peoples R China
[2] Chinese Acad Sci, Inst Elect, Key Lab Spatial Informat Proc & Applicat Syst Tec, Beijing 100190, Peoples R China
[3] Beijing Univ Chem Technol, Coll Informat Sci & Technol, Beijing 100029, Peoples R China
[4] German Aerosp Ctr, Remote Sensing Technol Inst, D-82234 Wessling, Germany
[5] Univ Colorado, Dept Aerosp Engn Sci, Boulder, CO 80309 USA
基金
中国国家自然科学基金;
关键词
Finite mixture models; Generalized Gamma distribution; Variational expectation-maximization (VEM); Maximum likelihood estimation; Extended factorized approximation; CLASSIFICATION; LIKELIHOOD;
D O I
10.1016/j.patcog.2018.10.025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a Bayesian inference method for the generalized Gamma mixture model (G Gamma MM) based on variational expectation-maximization algorithm. Specifically, the shape parameters, the inverse scale parameters, and the mixing coefficients in the G Gamma MM are treated as random variables, while the power parameters are left as parameters without assigning prior distributions. The help function is designed to approximate the lower bound of the variational objective function, which facilitates the assignment of the conjugate prior distributions and leads to the closed-form update equations. On this basis, the variational E-step and the variational M-step are alternatively implemented to infer the posteriors of the variables and estimate the parameters. The computational demand is reduced by the proposed method. More importantly, the effective number of components of the G Gamma MM can be determined automatically. The experimental results demonstrate the effectiveness of the proposed method especially in modeling the asymmetric and heavy-tailed data. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:269 / 284
页数:16
相关论文
共 50 条
  • [1] A Gradient-Based Algorithm Competitive with Variational Bayesian EM for Mixture of Gaussians
    Kuusela, Mikael
    Raiko, Tapani
    Honkela, Antti
    Karhunen, Juha
    [J]. IJCNN: 2009 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1- 6, 2009, : 1011 - 1018
  • [2] PARAMETER ESTIMATION OF GAUSSIAN MIXTURE MODEL BASED ON VARIATIONAL BAYESIAN LEARNING
    Zhao, Linchang
    Shang, Zhaowei
    Qin, Anyong
    Tang, Yuan Yan
    [J]. PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOL 1, 2018, : 99 - 104
  • [3] Bayesian estimation of Dirichlet mixture model with variational inference
    Ma, Zhanyu
    Rana, Pravin Kumar
    Taghia, Jalil
    Flierl, Markus
    Leijon, Arne
    [J]. PATTERN RECOGNITION, 2014, 47 (09) : 3143 - 3157
  • [4] ESTIMATION OF NAVIGATION PERFORMANCE AND OFFSET BY THE EM ALGORITHM AND THE VARIATIONAL BAYESIAN METHODS
    Fujita, Masato
    [J]. ADVANCES AND APPLICATIONS IN STATISTICS, 2013, 35 (01) : 1 - 27
  • [5] An EM algorithm for estimation in the mixture transition distribution model
    Lebre, Sophie
    Bourguignon, Pierre-Yves
    [J]. JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2008, 78 (08) : 713 - 729
  • [6] Bayesian estimation of generalized gamma shared frailty model
    Sukhmani Sidhu
    Kanchan Jain
    Suresh Kumar Sharma
    [J]. Computational Statistics, 2018, 33 : 277 - 297
  • [7] Bayesian estimation of generalized gamma shared frailty model
    Sidhu, Sukhmani
    Jain, Kanchan
    Sharma, Suresh Kumar
    [J]. COMPUTATIONAL STATISTICS, 2018, 33 (01) : 277 - 297
  • [8] MCMC ESTIMATION OF FINITE GENERALIZED GAMMA MIXTURE MODEL
    Zou, Yan-Hui
    Li, Heng-Chao
    [J]. 2012 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2012, : 5935 - 5938
  • [9] Improved Initialization of the EM Algorithm for Mixture Model Parameter Estimation
    Panic, Branislav
    Klemenc, Jernej
    Nagode, Marko
    [J]. MATHEMATICS, 2020, 8 (03)
  • [10] Factorized EM algorithm for mixture estimation
    Nagy, I
    Nedoma, P
    Kárny, M
    [J]. ARTIFICIAL NEURAL NETS AND GENETIC ALGORITHMS, 2001, : 402 - 405