Unsupervised learning of Dirichlet process mixture models with missing data

被引:0
|
作者
Xunan ZHANG [1 ]
Shiji SONG [1 ]
Lei ZHU [2 ]
Keyou YOU [1 ]
Cheng WU [1 ]
机构
[1] Department of Automation, Tsinghua University
[2] China Ocean Mineral Resources R&D Association
基金
中国国家自然科学基金;
关键词
Dirichlet processes; missing data; clustering; variational Bayesian; image analysis;
D O I
暂无
中图分类号
TP391.41 [];
学科分类号
080203 ;
摘要
This study presents a novel approach to unsupervised learning for clustering with missing data.We first extend a finite mixture model to the infinite case by considering Dirichlet process mixtures, which can automatically determine the number of mixture components or clusters. Furthermore, we view the missing features as latent variables and compute the posterior distributions using the variational Bayesian expectation maximization algorithm, which optimizes the evidence lower bound on the complete-data log marginal likelihood. We demonstrate the performance on several artificial data sets with missing values. The experimental results indicate that the proposed method outperforms some classic imputation methods. We finally present an application to seabed hydrothermal sulfide color images analysis problem.
引用
收藏
页码:161 / 174
页数:14
相关论文
共 50 条
  • [41] A Dirichlet Process Mixture Model for Spherical Data
    Straub, Julian
    Chang, Jason
    Freifeld, Oren
    Fisher, John W., III
    ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 38, 2015, 38 : 930 - 938
  • [42] Unsupervised Metric Learning in Presence of Missing Data
    Gilbert, Anna C.
    Sonthalia, Rishi
    2018 56TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2018, : 313 - 321
  • [43] Recursive unsupervised learning of finite mixture models
    Zivkovic, Z
    van der Heijden, F
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2004, 26 (05) : 651 - 656
  • [44] Unsupervised Greedy Learning of Finite Mixture Models
    Greggio, Nicola
    Bernardino, Alexandre
    Laschi, Cecilia
    Dario, Paolo
    Santos-Victor, Jose
    22ND INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2010), PROCEEDINGS, VOL 2, 2010, : 219 - 224
  • [45] Unsupervised Text Learning Based on Context Mixture Model with Dirichlet Prior
    Chen, Dongling
    Wang, Daling
    Yu, Ge
    ADVANCED WEB AND NETWORK TECHNOLOGIES, AND APPLICATIONS, 2008, 4977 : 172 - 181
  • [46] Estimation of Dirichlet process priors with monotone missing data
    Yang, Lei
    Wu, Xianyi
    JOURNAL OF NONPARAMETRIC STATISTICS, 2013, 25 (04) : 787 - 807
  • [47] A Dirichlet Process Mixture of Generalized Dirichlet Distributions for Proportional Data Modeling
    Bouguila, Nizar
    Ziou, Djemel
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (01): : 107 - 122
  • [48] Stylometric analyses using Dirichlet process mixture models
    Gill, Paramjit S.
    Swartz, Tim B.
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2011, 141 (11) : 3665 - 3674
  • [49] Dirichlet Process Mixture Models for Modeling and Generating Synthetic Versions of Nested Categorical Data
    Hu, Jingchen
    Reiter, Jerome P.
    Wang, Quanli
    BAYESIAN ANALYSIS, 2018, 13 (01): : 183 - 200
  • [50] High level group analysis of FMRI data based on dirichlet process mixture models
    Thirion, Bertrand
    Tucholka, Alan
    Keller, Merlin
    Pinel, Philippe
    Roche, Alexis
    Mangin, Jean-Framois
    Poline, Jean-Baptiste
    INFORMATION PROCESSING IN MEDICAL IMAGING, PROCEEDINGS, 2007, 4584 : 482 - +