An adaptive optimization method for estimating the number of components in a Gaussian mixture model

被引:1
|
作者
Sun, Shuping [1 ]
Tong, Yaonan [1 ]
Zhang, Biqiang [2 ]
Yang, Bowen [3 ]
He, Peiguang [2 ]
Song, Wei [1 ]
Yang, Wenbo [2 ]
Wu, Yilin [4 ]
Liu, Guangyu [2 ]
机构
[1] Hunan Inst Sci & Technol, Sch Informat Sci & Engn, Yueyang 414006, Peoples R China
[2] Nanyang Inst Technol, Dept Informat Engn, Nanyang 473004, Peoples R China
[3] Univ Chinese Acad Sci UCAS, Sch Integrated Circuits, Beijing 101400, Peoples R China
[4] Nanyang Inst Technol, Dept Intelligent Mfg, Nanyang 473004, Peoples R China
关键词
GMM; MIGMM; chi(2) distribution; Mahalanobis distance; Adaptive optimal number; Adaptive interval; IMPROVED EM ALGORITHM; INFORMATION CRITERION; ORDER SELECTION; CREDIT RISK; K-MEANS; IDENTIFICATION; PREDICTION; APPROXIMATION; SYSTEMS;
D O I
10.1016/j.jocs.2022.101874
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Regarding the determination of the number of components (M) in a Gaussian mixture model (GMM), this study proposes a novel method for adaptively locating an optimal value of M when using a GMM to fit a given dataset; this method avoids underfitting and overfitting due to an unreasonable manually specified interval. The major contributions of this study are highlighted: (1) An adaptive interval for M (denoted as M is an element of [M-Min(Ada), M-Max(Ada)]) based on two procedures of a novel method, the modified incremental Gaussian mixture model (MIGMM), is determined via an adjustable parameter beta. (2) Considering some typical criteria, the optimal number.. within the obtained adaptive interval [M-Min(Ada), M-Max(Ada)], M-Opt(Ada) , is ultimately determined. Regarding the adaptive interval, extensive experiments with typical synthetic datasets show that [M-Min(Ada) M-Max(Ada)], corresponding to the parameter [beta(Min) = 10(-11), beta(Max) = 10(-2)], is determined. The performance of the M-Opt(Ada) determination based on several typical criteria is evaluated on both synthetic and real-world datasets.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] On the number of components in a Gaussian mixture model
    McLachlan, Geoffrey J.
    Rathnayake, Suren
    WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2014, 4 (05) : 341 - 355
  • [2] AN ALGORITHM FOR ESTIMATING NUMBER OF COMPONENTS OF GAUSSIAN MIXTURE MODEL BASED ON PENALIZED DISTANCE
    Zhang, Daming
    Guo, Hui
    Luo, Bin
    2008 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS AND SIGNAL PROCESSING, VOLS 1 AND 2, 2007, : 482 - +
  • [3] Estimating number of components in Gaussian mixture model using combination of greedy and merging algorithm
    Karla Štepánová
    Michal Vavrečka
    Pattern Analysis and Applications, 2018, 21 : 181 - 192
  • [4] Estimating number of components in Gaussian mixture model using combination of greedy and merging algorithm
    Stepanova, Karla
    Vavrecka, Michal
    PATTERN ANALYSIS AND APPLICATIONS, 2018, 21 (01) : 181 - 192
  • [5] Estimating the number of components in Gaussian mixture models adaptively for medical image
    Xie, Cong-Hua
    Chang, Jin-Yi
    Liu, Yong-Jun
    OPTIK, 2013, 124 (23): : 6216 - 6221
  • [6] Number of components and initialization in Gaussian mixture model for pattern recognition
    Paclík, P
    Novovicová, J
    ARTIFICIAL NEURAL NETS AND GENETIC ALGORITHMS, 2001, : 406 - 409
  • [7] A method for estimating the number of components in a normal mixture density function
    Hoffbeck, JP
    Landgrebe, D
    IGARSS 2000: IEEE 2000 INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOL I - VI, PROCEEDINGS, 2000, : 1675 - 1677
  • [8] Estimating the number of components in a finite mixture model: the special case of homogeneity
    Schlattmann, P
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2003, 41 (3-4) : 441 - 451
  • [9] Estimating the number of components in a mixture of multilayer perceptrons
    Olteanu, M.
    Rynkiewicz, J.
    NEUROCOMPUTING, 2008, 71 (7-9) : 1321 - 1329
  • [10] MODIFIED AKAIKE INFORMATION CRITERION FOR ESTIMATING THE NUMBER OF COMPONENTS IN A PROBABILITY MIXTURE MODEL
    Elnakib, Ahmed
    Gimel'farb, Georgy
    Inanc, Tamer
    El-Baz, Ayman
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 2497 - 2500