Nonparametric Bayesian Nonnegative Matrix Factorization

被引:0
|
作者
Xie, Hong-Bo [1 ]
Li, Caoyuan [2 ,3 ]
Mengersen, Kerrie [1 ]
Wang, Shuliang [2 ]
Da Xu, Richard Yi [3 ]
机构
[1] Queensland Univ Technol, ARC Ctr Excellence Math & Stat Frontiers, Brisbane, Qld 4001, Australia
[2] Beijing Inst Technol BIT, Sch Comp Sci & Technol, Beijing 100081, Peoples R China
[3] Univ Technol Sydney UTS, Fac Engn & Informat Technol, Ultimo, NSW 2007, Australia
关键词
Dirichlet process; Nonnegative matrix factorization; Nonparametric Bayesian methods; Gaussian mixture model; Variational Bayes;
D O I
10.1007/978-3-030-57524-3_11
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nonnegative Matrix Factorization (NMF) is an important tool in machine learning for blind source separation and latent factor extraction. Most of existing NMF algorithms assume a specific noise kernel, which is insufficient to deal with complex noise in real scenarios. In this study, we present a hierarchical nonparametric nonnegative matrix factorization (NPNMF) model in which the Gaussian mixture model is used to approximate the complex noise distribution. The model is cast in the nonparametric Bayesian framework by using Dirichlet process mixture to infer the necessary number of Gaussian components. We derive a mean-field variational inference algorithm for the proposed nonparametric Bayesian model. Experimental results on both synthetic data and electroencephalogram (EEG) demonstrate that NPNMF performs better in extracting the latent nonnegative factors in comparison with state-of-the-art methods.
引用
收藏
页码:132 / 141
页数:10
相关论文
共 50 条
  • [1] Diversified Bayesian Nonnegative Matrix Factorization
    Qiao, Maoying
    Yu, Jun
    Liu, Tongliang
    Wang, Xinchao
    Tao, Dacheng
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 5420 - 5427
  • [2] NONPARAMETRIC BAYESIAN MATRIX FACTORIZATION FOR ASSORTATIVE NETWORKS
    Zhou, Mingyuan
    [J]. 2015 23RD EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2015, : 2776 - 2780
  • [3] Active Selection of Elements for Bayesian Nonnegative Matrix Factorization
    Suyunu, Burak
    Ayci, Gonul
    Cemgil, A. Taylan
    [J]. 2018 26TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2018,
  • [4] Bayesian Nonnegative Matrix Factorization With Dirichlet Process Mixtures
    Li, Caoyuan
    Xie, Hong-Bo
    Mengersen, Kerrie
    Fan, Xuhui
    Da Xu, Richard Yi
    Sisson, Scott A.
    Van Huffel, Sabine
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 : 3860 - 3870
  • [5] Bayesian Group Sparse Learning for Nonnegative Matrix Factorization
    Chien, Jen-Tzung
    Hsieh, Hsin-Lung
    [J]. 13TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2012 (INTERSPEECH 2012), VOLS 1-3, 2012, : 1550 - 1553
  • [6] Discriminant analysis using nonnegative matrix factorization for nonparametric multiclass classification
    Kim, Hyunsoo
    Park, Haesun
    [J]. 2006 IEEE INTERNATIONAL CONFERENCE ON GRANULAR COMPUTING, 2006, : 182 - +
  • [7] Phase Transition Structure of Variational Bayesian Nonnegative Matrix Factorization
    Kohjima, Masahiro
    Watanabe, Sumio
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, PT II, 2017, 10614 : 146 - 154
  • [8] Adaptive Overlapping Community Detection with Bayesian NonNegative Matrix Factorization
    Shi, Xiaohua
    Lu, Hongtao
    Jia, Guanbo
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2017), PT II, 2017, 10178 : 339 - 353
  • [9] Bayesian mean-parameterized nonnegative binary matrix factorization
    Alberto Lumbreras
    Louis Filstroff
    Cédric Févotte
    [J]. Data Mining and Knowledge Discovery, 2020, 34 : 1898 - 1935
  • [10] An oracle inequality for quasi-Bayesian nonnegative matrix factorization
    Alquier P.
    Guedj B.
    [J]. Mathematical Methods of Statistics, 2017, 26 (1) : 55 - 67