Bayesian Parameter Estimation in LDA

被引:0
|
作者
Liu, Z. Y. [1 ,2 ]
Wang, W. P. [2 ]
Wang, Y. [1 ]
Lu, W. Y. [1 ]
Ji, Z. Z. [3 ]
机构
[1] Beijing Inst Technol, Sch Software, Beijing, Peoples R China
[2] Chinese Acad Sci, Inst Informat Engn, Beijing 100864, Peoples R China
[3] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
关键词
bayesian; parameter estimation; LDA; topic model;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Latent Dirichlet Allocation (LDA) probabilistic topic model is widely used in text mining, natural language processing and so on. But LDA's mathematical theory is particularly complex, thus it is very difficult to understand LDA for a novice. In order to more quickly and easily learn LDA, and further promote its application, this paper will deeply analyze LDA from the perspective of Bayesian parameter estimation. At first we explain the advantage of Bayesian parameter estimation by an instance, and then introduce a simple Bayesian Unigram model. Next based on the simple Bayesian Unigram model and PLSA model, a full Bayesian probabilistic topic model-LDA is presented.
引用
收藏
页码:837 / 840
页数:4
相关论文
共 50 条
  • [1] Biased Parameter Estimation in LDA
    Yuan, Boqiu
    Zhou, Yiming
    Li, Lin
    [J]. FIFTH INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, VOL 2, PROCEEDINGS, 2008, : 116 - +
  • [2] A Supervised Parameter Estimation Method of LDA
    Liu Zhenyan
    Meng Dan
    Wang Weiping
    Zhang Chunxia
    [J]. WEB TECHNOLOGIES AND APPLICATIONS (APWEB 2015), 2015, 9313 : 401 - 410
  • [3] Bayesian Parameter Estimation
    Simoen, E.
    Lombaert, G.
    [J]. IDENTIFICATION METHODS FOR STRUCTURAL HEALTH MONITORING, 2016, 567 : 89 - 115
  • [4] BAYESIAN ESTIMATION OF BINOMIAL PARAMETER
    DRAPER, N
    GUTTMAN, I
    [J]. TECHNOMETRICS, 1971, 13 (03) : 667 - &
  • [5] BAYESIAN PARAMETER-ESTIMATION
    KRAMER, SC
    SORENSON, HW
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1988, 33 (02) : 217 - 222
  • [6] BAYESIAN ESTIMATION FOR THE MULTIFRACTALITY PARAMETER
    Wendt, Herwig
    Dobigeon, Nicolas
    Tourneret, Jean-Yves
    Abry, Patrice
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 6556 - 6560
  • [7] MANOVA, LDA, and FA criteria in clusters parameter estimation
    Lipovetsky, Stan
    [J]. COGENT MATHEMATICS, 2015, 2
  • [8] Fast Bayesian approach for parameter estimation
    Jin, Bangti
    [J]. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING, 2008, 76 (02) : 230 - 252
  • [9] CONSISTENCY OF BAYESIAN PARAMETER ESTIMATION.
    Yashin, A.I.
    [J]. Problems of information transmission, 1981, 17 (01) : 42 - 49
  • [10] BAYESIAN POINT ESTIMATION ON BERNOULLI PARAMETER
    BUNN, DW
    [J]. OMEGA-INTERNATIONAL JOURNAL OF MANAGEMENT SCIENCE, 1976, 4 (01): : 97 - 99