Topic Extraction: BERTopic's Insight into the 117th Congress's Twitterverse

被引:1
|
作者
Mendonca, Margarida [1 ,3 ]
Figueira, Alvaro [1 ,2 ,3 ]
机构
[1] Univ Porto, Fac Sci, P-4169007 Porto, Portugal
[2] Univ Porto, CRACS INESCTEC, P-4169007 Porto, Portugal
[3] DCC FCUP, Rua Campo Alegre S-N, P-4169007 Porto, Portugal
来源
INFORMATICS-BASEL | 2024年 / 11卷 / 01期
关键词
Topic Mining; BERTopic; 117th Congress; Twitter; short-text data; LATENT SEMANTIC ANALYSIS;
D O I
10.3390/informatics11010008
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
As social media (SM) becomes increasingly prevalent, its impact on society is expected to grow accordingly. While SM has brought positive transformations, it has also amplified pre-existing issues such as misinformation, echo chambers, manipulation, and propaganda. A thorough comprehension of this impact, aided by state-of-the-art analytical tools and by an awareness of societal biases and complexities, enables us to anticipate and mitigate the potential negative effects. One such tool is BERTopic, a novel deep-learning algorithm developed for Topic Mining, which has been shown to offer significant advantages over traditional methods like Latent Dirichlet Allocation (LDA), particularly in terms of its high modularity, which allows for extensive personalization at each stage of the topic modeling process. In this study, we hypothesize that BERTopic, when optimized for Twitter data, can provide a more coherent and stable topic modeling. We began by conducting a review of the literature on topic-mining approaches for short-text data. Using this knowledge, we explored the potential for optimizing BERTopic and analyzed its effectiveness. Our focus was on Twitter data spanning the two years of the 117th US Congress. We evaluated BERTopic's performance using coherence, perplexity, diversity, and stability scores, finding significant improvements over traditional methods and the default parameters for this tool. We discovered that improvements are possible in BERTopic's coherence and stability. We also identified the major topics of this Congress, which include abortion, student debt, and Judge Ketanji Brown Jackson. Additionally, we describe a simple application we developed for a better visualization of Congress topics.
引用
收藏
页数:34
相关论文
共 50 条