Topic Selection in Latent Dirichlet Allocation

被引:0
|
作者
Wang, Biao [1 ]
Liu, Zelong [2 ]
Li, Maozhen [2 ]
Liu, Yang [3 ]
Qi, Man [4 ]
机构
[1] State Grid Sichuan Elect Power Res Inst, Chengdu, Peoples R China
[2] Brunel Univ, Sch Engn & Design, Uxbridge UB8 3PH, Middx, England
[3] Sichuan Univ, Sch Elect Engn & Informat Syst, Chengdu 610065, Peoples R China
[4] Canterbury Christ Church Univ, Dept Comp, Canterbury CT1 1QU, Kent, England
关键词
MapReduce; job scheduling; data locality;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Latent Dirichlet Allocation (LDA) has been widely applied to text mining. LDA is a probabilistic topic model which processes documents as the probability distribution of topics. One challenging issue in application of LDA is to select the optimal number of topics in LDA model. This paper presents a topic selection method which considers the density of each topic and computes the most unstable topic structure through an iteration process. Evaluation results show that the proposed method can generate an optimal number of topics automatically with a small number of iterations.
引用
收藏
页码:756 / 760
页数:5
相关论文
共 50 条
  • [41] Sentiment Analysis Using Latent Dirichlet Allocation and Topic Polarity Wordcloud Visualization
    Bashri, Mohammad F. A.
    Kusumaningrum, Retno
    2017 5TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY (ICOIC7), 2017,
  • [42] Topic-Based User Segmentation for Online Advertising with Latent Dirichlet Allocation
    Tu, Songgao
    Lu, Chaojun
    ADVANCED DATA MINING AND APPLICATIONS (ADMA 2010), PT II, 2010, 6441 : 259 - 269
  • [43] HDPauthor: A New Hybrid Author-Topic Model using Latent Dirichlet Allocation and Hierarchical Dirichlet Processes
    Yang, Ming
    Hsu, Willian H.
    PROCEEDINGS OF THE 25TH INTERNATIONAL CONFERENCE ON WORLD WIDE WEB (WWW'16 COMPANION), 2016, : 619 - 624
  • [44] Language Model Adaptation Using Latent Dirichlet Allocation and an Efficient Topic Inference Algorithm
    Heidel, Aaron
    Chang, Hung-an
    Lee, Lin-shan
    INTERSPEECH 2007: 8TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION, VOLS 1-4, 2007, : 1145 - +
  • [45] Generating and Visualizing Topic Hierarchies from Microblogs : An Iterative Latent Dirichlet Allocation Approach
    Anoop, V. S.
    Sankar, Prem C.
    Asharaf, S.
    Alessandro, Zonin
    2015 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2015, : 824 - 828
  • [46] Topic Model Tutorial A basic introduction on latent Dirichlet allocation and extensions for web scientists
    Kling, Christoph Carl
    Posch, Lisa
    Bleier, Arnim
    Dietz, Laura
    PROCEEDINGS OF THE 2016 ACM WEB SCIENCE CONFERENCE (WEBSCI'16), 2016, : 10 - 10
  • [47] Public perceptions of digital fashion: An analysis of sentiment and Latent Dirichlet Allocation topic modeling
    Zou, Yixin
    Luh, Ding-Bang
    Lu, Shizhu
    FRONTIERS IN PSYCHOLOGY, 2022, 13
  • [48] Topic Modeling of the Pakistani Economy in English Newspapers via Latent Dirichlet Allocation (LDA)
    Ahmed, Fasih
    Nawaz, Muhammad
    Jadoon, Aisha
    SAGE OPEN, 2022, 12 (01):
  • [49] Local-class-shared-topic latent Dirichlet allocation based scene classification
    Huang, Chao
    Luo, Wang
    Xie, Yurui
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (14) : 15661 - 15679
  • [50] Topic detection and tracking for conversational content by using conceptual dynamic latent Dirichlet allocation
    Yeh, Jui-Feng
    Tan, Yi-Shan
    Lee, Chen-Hsien
    NEUROCOMPUTING, 2016, 216 : 310 - 318