Towards COVID-19 fake news detection using transformer-based models

被引:14
|
作者
Alghamdi, Jawaher [1 ,2 ]
Lin, Yuqing [1 ]
Luo, Suhuai [1 ]
机构
[1] Univ Newcastle, Sch Informat & Phys Sci, Newcastle, Australia
[2] King Khalid Univ, Dept Comp Sci, Abha, Saudi Arabia
关键词
COVID-19; Fake news; Misinformation; Pre-trained transformer models; Social media;
D O I
10.1016/j.knosys.2023.110642
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The COVID-19 pandemic has resulted in a surge of fake news, creating public health risks. However, developing an effective way to detect such news is challenging, especially when published news involves mixing true and false information. Detecting COVID-19 fake news has become a critical task in the field of natural language processing (NLP). This paper explores the effectiveness of several machine learning algorithms and fine-tuning pre-trained transformer-based models, including Bidirectional Encoder Representations from Transformers (BERT) and COVID-Twitter-BERT (CT-BERT), for COVID-19 fake news detection. We evaluate the performance of different downstream neural network structures, such as CNN and BiGRU layers, added on top of BERT and CT-BERT with frozen or unfrozen parameters. Our experiments on a real-world COVID-19 fake news dataset demonstrate that incorporating BiGRU on top of the CT-BERT model achieves outstanding performance, with a state-of-the-art F1 score of 98%. These results have significant implications for mitigating the spread of COVID-19 misinformation and highlight the potential of advanced machine learning models for fake news detection.& COPY; 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Performance Evaluation of Transformer-based NLP Models on Fake News Detection Datasets
    Babu, Raveen Narendra
    Lung, Chung-Horng
    Zaman, Marzia
    [J]. 2023 IEEE 47TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE, COMPSAC, 2023, : 316 - 321
  • [2] Multimodal Fake News Detection on Fakeddit Dataset Using Transformer-Based Architectures
    Kalra, Sakshi
    Kumar, Chitneedi Hemanth Sai
    Sharma, Yashvardhan
    Chauhan, Gajendra Singh
    [J]. MACHINE LEARNING, IMAGE PROCESSING, NETWORK SECURITY AND DATA SCIENCES, MIND 2022, PT II, 2022, 1763 : 281 - 292
  • [3] Multimodal Fake News Detection on Fakeddit Dataset Using Transformer-Based Architectures
    Kalra, Sakshi
    Kumar, Chitneedi Hemanth Sai
    Sharma, Yashvardhan
    Chauhan, Gajendra Singh
    [J]. Communications in Computer and Information Science, 2022, 1763 CCIS : 281 - 292
  • [4] A Hybrid Transformer-Based Model for Optimizing Fake News Detection
    Al-Quayed, Fatima
    Javed, Danish
    Jhanjhi, N.Z.
    Humayun, Mamoona
    Alnusairi, Thanaa S.
    [J]. IEEE Access, 2024, 12 : 160822 - 160834
  • [5] Bilingual COVID-19 Fake News Detection Based on LDA Topic Modeling and BERT Transformer
    Omrani, Pouria
    Ebrahimian, Zahra
    Toosi, Ramin
    Akhaee, Mohammad Ali
    [J]. 2023 6TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND IMAGE ANALYSIS, IPRIA, 2023,
  • [6] Fake news detection based on news content and social contexts: a transformer-based approach
    Shaina Raza
    Chen Ding
    [J]. International Journal of Data Science and Analytics, 2022, 13 : 335 - 362
  • [7] Fake news detection based on news content and social contexts: a transformer-based approach
    Raza, Shaina
    Ding, Chen
    [J]. INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2022, 13 (04) : 335 - 362
  • [8] Enhancing Fake News Detection in Romanian Using Transformer-Based Back Translation Augmentation
    Bucos, Marian
    Dragulescu, Bogdan
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (24):
  • [9] Covid-19 Fake News Detection: A Survey
    Shushkevich, Elena
    Alexandrov, Mikhail
    Cardiff, John
    [J]. COMPUTACION Y SISTEMAS, 2021, 25 (04): : 783 - 792
  • [10] A transformer-based architecture for fake news classification
    Divyam Mehta
    Aniket Dwivedi
    Arunabha Patra
    M. Anand Kumar
    [J]. Social Network Analysis and Mining, 2021, 11