A dynamic merge-or-split learning algorithm on Gaussian mixture for automated model selection

被引:0
|
作者
Ma, JW [1 ]
He, QC
机构
[1] Peking Univ, Sch Math Sci, Dept Informat Sci, Beijing 100871, Peoples R China
[2] Peking Univ, LMAM, Beijing 100871, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Gaussians in the mixture, i.e., the mixture model or scale selection, remains a difficult problem. In this paper, we propose a new kind of dynamic merge-or-split learning (DMOSL) algorithm on Gaussian mixture such that the number of Gaussians can be determined automatically with a dynamic merge-or-split operation among estimated Gaussians from the EM algorithm. It is demonstrated by the simulation experiments that the DMOSL algorithm can automatically determine the number of Gaussians in a sample data set, and also lead to a good estimation of the parameters in the original mixture. Moreover, the DMOSL algorithm is applied to the classification of Iris data.
引用
收藏
页码:203 / 210
页数:8
相关论文
共 50 条
  • [1] A BYY Split-and-Merge EM Algorithm for Gaussian Mixture Learning
    Li, Lei
    Ma, Jinwen
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2008, PT I, PROCEEDINGS, 2008, 5263 : 600 - 609
  • [2] A Greedy Merge Learning Algorithm for Gaussian Mixture Model
    Li, Yan
    Li, Lei
    [J]. 2009 THIRD INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION TECHNOLOGY APPLICATION, VOL 2, PROCEEDINGS, 2009, : 506 - +
  • [3] An iterative algorithm for BYY learning on Gaussian mixture with automated model selection
    Ma, JW
    Wang, TJ
    Xu, L
    [J]. PROCEEDINGS OF 2003 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS & SIGNAL PROCESSING, PROCEEDINGS, VOLS 1 AND 2, 2003, : 7 - 10
  • [4] The BYY annealing learning algorithm for Gaussian mixture with automated model selection
    Ma, Jinwen
    Liu, Jianfeng
    [J]. PATTERN RECOGNITION, 2007, 40 (07) : 2029 - 2037
  • [5] RENYI ENTROPY PENALIZED LEARNING ALGORITHM FOR GAUSSIAN MIXTURE WITH AUTOMATED MODEL SELECTION
    Wu, Jianwei
    Ma, Jinwen
    [J]. ICSP: 2008 9TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, VOLS 1-5, PROCEEDINGS, 2008, : 1562 - +
  • [6] Split-Merge Algorithm and Gaussian Mixture Models for AAL
    Yin, GuoQing
    Bruckner, Dietmar
    [J]. IEEE INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE 2010), 2010, : 2314 - 2318
  • [7] Split and Merge EM Algorithm for Improving Gaussian Mixture Density Estimates
    Naonori Ueda
    Ryohei Nakano
    Zoubin Ghahramani
    Geoffrey E. Hinton
    [J]. Journal of VLSI signal processing systems for signal, image and video technology, 2000, 26 : 133 - 140
  • [8] Split and merge EM algorithm for improving Gaussian mixture density estimates
    Ueda, N
    Nakano, R
    Ghahramani, Z
    Hinton, GE
    [J]. NEURAL NETWORKS FOR SIGNAL PROCESSING VIII, 1998, : 274 - 283
  • [9] The Split and Merge Unscented Gaussian Mixture Filter
    Faubel, Friedrich
    McDonough, John
    Klakow, Dietrich
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2009, 16 (09) : 786 - 789
  • [10] A novel split-and-merge algorithm for hierarchical clustering of Gaussian mixture models
    Branislav Popović
    Marko Janev
    Darko Pekar
    Nikša Jakovljević
    Milan Gnjatović
    Milan Sečujski
    Vlado Delić
    [J]. Applied Intelligence, 2012, 37 : 377 - 389