Modeling and Clustering Positive Vectors via Nonparametric Mixture Models of Liouville Distributions

被引:27
|
作者
Fan, Wentao [1 ]
Bouguila, Nizar [2 ]
机构
[1] Huaqiao Univ, Dept Comp Sci & Technol, Xiamen 361021, Peoples R China
[2] Concordia Univ, Concordia Inst Informat Syst Engn CIISE, Montreal, PQ H3G 1T7, Canada
基金
中国国家自然科学基金;
关键词
Mixture models; Data models; Inference algorithms; Clustering algorithms; Fans; Bayes methods; Averaged collapsed variational Bayes (ACVB); clustering; Dirichlet process; inverted Beta-Liouville (IBL) distribution; mixture models; nonparametric Bayesian; positive vectors; SIMULTANEOUS FEATURE-SELECTION; VARIATIONAL INFERENCE; DIRICHLET;
D O I
10.1109/TNNLS.2019.2938830
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this article, we propose an effective mixture model-based approach to modeling and clustering positive data vectors. Our mixture model is based on the inverted Beta-Liouville (IBL) distribution which is extracted from the family of Liouville distributions. To cope with the problem of determining the appropriate number of clusters in our approach, a nonparametric Bayesian framework is used to extend the IBL mixture to an infinite mixture model in which the number of clusters is assumed to be infinite initially and will be inferred automatically during the learning process. To optimize the proposed model, we propose a convergence-guaranteed learning algorithm based on the averaged collapsed variational Bayes inference that can effectively learn model parameters with closed-form solutions. The effectiveness of the proposed infinite IBL mixture model for modeling and clustering positive vectors is validated through both synthetic and real-world data sets.
引用
收藏
页码:3193 / 3203
页数:11
相关论文
共 50 条
  • [1] Clustering via finite nonparametric ICA mixture models
    Xiaotian Zhu
    David R. Hunter
    [J]. Advances in Data Analysis and Classification, 2019, 13 : 65 - 87
  • [2] Clustering via finite nonparametric ICA mixture models
    Zhu, Xiaotian
    Hunter, David R.
    [J]. ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2019, 13 (01) : 65 - 87
  • [3] Positive vectors clustering using inverted Dirichlet finite mixture models
    Bdiri, Taoufik
    Bouguila, Nizar
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2012, 39 (02) : 1869 - 1882
  • [4] Multiple co-clustering based on nonparametric mixture models with heterogeneous marginal distributions
    Tokuda, Tomoki
    Yoshimoto, Junichiro
    Shimizu, Yu
    Okada, Go
    Takamura, Masahiro
    Okamoto, Yasumasa
    Yamawaki, Shigeto
    Doya, Kenji
    [J]. PLOS ONE, 2017, 12 (10):
  • [5] Simultaneous clustering and feature selection via nonparametric Pitman–Yor process mixture models
    Wentao Fan
    Nizar Bouguila
    [J]. International Journal of Machine Learning and Cybernetics, 2019, 10 : 2753 - 2766
  • [6] Unsupervised clustering using nonparametric finite mixture models
    Hunter, David R. R.
    [J]. WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2024, 16 (01)
  • [7] IDENTIFIABILITY OF NONPARAMETRIC MIXTURE MODELS AND BAYES OPTIMAL CLUSTERING
    Aragam, Bryon
    Dan, Chen
    Xing, Eric P.
    Ravikumar, Pradeep
    [J]. ANNALS OF STATISTICS, 2020, 48 (04): : 2277 - 2302
  • [8] Spherical data clustering and feature selection through nonparametric Bayesian mixture models with von Mises distributions
    Fan, Wentao
    Bouguila, Nizar
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2020, 94
  • [9] Spatiotemporal Clustering with Neyman-Scott Processes via Connections to Bayesian Nonparametric Mixture Models
    Wang, Yixin
    Degleris, Anthony
    Williams, Alex
    Linderman, Scott W.
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2023,
  • [10] Simultaneous clustering and feature selection via nonparametric Pitman-Yor process mixture models
    Fan, Wentao
    Bouguila, Nizar
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (10) : 2753 - 2766