Speed-up for the expectation-maximization algorithm for clustering categorical data

被引:15
|
作者
Jollois, F. -X.
Nadif, M.
机构
[1] Univ Paris 05, CRIP5, F-75270 Paris 06, France
[2] Univ Paul Verlaine Metz, LITA, UFR MIM, F-57045 Metz 1, France
关键词
mixture model; expectation-maximization algorithm; clustering; acceleration; categorical data;
D O I
10.1007/s10898-006-9059-3
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In model-based cluster analysis, the expectation-maximization (EM) algorithm has a number of desirable properties, but in some situations, this algorithm can be slow to converge. Some variants are proposed to speed-up EM in reducing the time spent in the E-step, in the case of Gaussian mixture. The main aims of such methods is first to speed-up convergence of EM, and second to yield same results (or not so far) than EM itself. In this paper, we compare these methods from categorical data, with the latent class model, and we propose a new variant that sustains better results on synthetic and real data sets, in terms of convergence speed-up and number of misclassified objects.
引用
下载
收藏
页码:513 / 525
页数:13
相关论文
共 50 条
  • [41] Vehicle image classification via expectation-maximization algorithm
    Pumrin, S
    Dailey, DJ
    PROCEEDINGS OF THE 2003 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL II: COMMUNICATIONS-MULTIMEDIA SYSTEMS & APPLICATIONS, 2003, : 468 - 471
  • [42] A stochastic expectation-maximization algorithm for the analysis of system lifetime data with known signature
    Yandan Yang
    Hon Keung Tony Ng
    Narayanaswamy Balakrishnan
    Computational Statistics, 2016, 31 : 609 - 641
  • [43] Deep expectation-maximization network for unsupervised image segmentation and clustering
    Pu, Yannan
    Sun, Jian
    Tang, Niansheng
    Xu, Zongben
    IMAGE AND VISION COMPUTING, 2023, 135
  • [44] ITERATIVE RECONSTRUCTION-REPROJECTION AND THE EXPECTATION-MAXIMIZATION ALGORITHM
    OLLINGER, JM
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 1990, 9 (01) : 94 - 98
  • [45] The Noisy Expectation-Maximization Algorithm for Multiplicative Noise Injection
    Osoba, Osonde
    Kosko, Bart
    FLUCTUATION AND NOISE LETTERS, 2016, 15 (01):
  • [46] A recursive expectation-maximization algorithm for speaker tracking and separation
    Ofer Schwartz
    Sharon Gannot
    EURASIP Journal on Audio, Speech, and Music Processing, 2021
  • [47] SPACE-ALTERNATING GENERALIZED EXPECTATION-MAXIMIZATION ALGORITHM
    FESSLER, JA
    HERO, AO
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1994, 42 (10) : 2664 - 2677
  • [48] Unsupervised Image Segmentation Based on Expectation-Maximization Algorithm
    Guan, Ji-shi
    Shi, Yao-wu
    Qiu, Jian-wen
    Hou, Yi-min
    2015 INTERNATIONAL CONFERENCE ON APPLIED MECHANICS AND MECHATRONICS ENGINEERING (AMME 2015), 2015, : 506 - 510
  • [49] Expectation-Maximization Algorithm for Evaluation of Wind Direction Characteristics
    Marek, Jaroslav
    Heckenbergerova, Jana
    2015 IEEE 15TH INTERNATIONAL CONFERENCE ON ENVIRONMENT AND ELECTRICAL ENGINEERING (IEEE EEEIC 2015), 2015, : 1730 - 1735
  • [50] Expectation-Maximization algorithm for finite mixture of α-stable distributions
    Castillo-Barnes, D.
    Martinez-Murcia, F. J.
    Ramirez, J.
    Gorriz, J. M.
    Salas-Gonzalez, D.
    NEUROCOMPUTING, 2020, 413 : 210 - 216