Data Clustering using Online Variational Learning of Finite Scaled Dirichlet Mixture Models

被引:3
|
作者
Nguyen, Hieu [1 ]
Kalra, Meeta [1 ]
Azam, Muhammad [2 ]
Bouguila, Nizar [1 ]
机构
[1] Concordia Univ, Concordia Inst Informat Syst Engn, Montreal, PQ H3G 1M8, Canada
[2] Concordia Univ, Dept Elect & Comp Engn, Montreal, PQ H3G 1M8, Canada
关键词
Online learning; Variational inference; Finite mixture model; Scaled Dirichlet distribution; Unsupervised learning; Spam detection; Image clustering;
D O I
10.1109/IRI.2019.00050
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With a massive amount of data created on a daily basis, the ubiquitous demand for data analysis is obvious. Recent development of technology has made machine learning techniques applicable to various problems. In this paper, we emphasize on cluster analysis, an important aspect of data analysis. In other words, being able to automatically discover different groups containing similar data is crucial for further information retrieving and anomaly detection tasks. Thus, we propose an online variational inference framework for finite Scaled Dirichlet mixture models. By efficiently handling large scale data, online approach is capable of enhancing the scalability of finite mixture models for demanding applications in real time. The proposed method can simultaneously update the model's parameters and determine the optimal number of components without the complex computation of conventional Bayesian algorithm. The effectiveness of our model is affirmed with challenging problems including spam detection and image clustering.
引用
收藏
页码:267 / 274
页数:8
相关论文
共 50 条
  • [1] Data Clustering using Variational Learning of Finite Scaled Dirichlet Mixture Models
    Hieu Nguyen
    Azam, Muhammad
    Bouguila, Nizar
    [J]. 2019 IEEE 28TH INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2019, : 1391 - 1396
  • [2] Data Clustering Using Variational Learning of Finite Scaled Dirichlet Mixture Models with Component Splitting
    Hieu Nguyen
    Maanicshah, Kamal
    Azam, Muhammad
    Bouguila, Nizar
    [J]. IMAGE ANALYSIS AND RECOGNITION (ICIAR 2019), PT II, 2019, 11663 : 117 - 128
  • [3] Online variational learning of finite Dirichlet mixture models
    Fan, Wentao
    Bouguila, Nizar
    [J]. EVOLVING SYSTEMS, 2012, 3 (03) : 153 - 165
  • [4] Online variational learning of finite Dirichlet mixture models
    Wentao Fan
    Nizar Bouguila
    [J]. Evolving Systems, 2012, 3 (3) : 153 - 165
  • [5] Online Data Clustering Using Variational Learning of a Hierarchical Dirichlet Process Mixture of Dirichlet Distributions
    Fan, Wentao
    Bouguila, Nizar
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2014, 2014, 8505 : 18 - 32
  • [6] Online Variational Learning of Shifted Scaled Dirichlet Mixture
    Manouchehri, Narges
    Dalhoumi, Oumayma
    Amayri, Manar
    Bouguila, Nizar
    [J]. PROCEEDINGS OF 2021 IEEE 30TH INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2021,
  • [7] Variational learning of finite Dirichlet mixture models using component splitting
    Fan, Wentao
    Bouguila, Nizar
    Ziou, Djemel
    [J]. NEUROCOMPUTING, 2014, 129 : 3 - 16
  • [8] Variational Learning for Finite Dirichlet Mixture Models and Applications
    Fan, Wentao
    Bouguila, Nizar
    Ziou, Djemel
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (05) : 762 - 774
  • [9] Online variational learning of generalized Dirichlet mixture models with feature selection
    Fan, Wentao
    Bouguila, Nizar
    [J]. NEUROCOMPUTING, 2014, 126 : 166 - 179
  • [10] Online Variational Learning of Dirichlet Process Mixtures of Scaled Dirichlet Distributions
    Manouchehri, Narges
    Nguyen, Hieu
    Koochemeshkian, Pantea
    Bouguila, Nizar
    Fan, Wentao
    [J]. INFORMATION SYSTEMS FRONTIERS, 2020, 22 (05) : 1085 - 1093