Towards COVID-19 fake news detection using transformer-based models

被引:14
|
作者
Alghamdi, Jawaher [1 ,2 ]
Lin, Yuqing [1 ]
Luo, Suhuai [1 ]
机构
[1] Univ Newcastle, Sch Informat & Phys Sci, Newcastle, Australia
[2] King Khalid Univ, Dept Comp Sci, Abha, Saudi Arabia
关键词
COVID-19; Fake news; Misinformation; Pre-trained transformer models; Social media;
D O I
10.1016/j.knosys.2023.110642
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The COVID-19 pandemic has resulted in a surge of fake news, creating public health risks. However, developing an effective way to detect such news is challenging, especially when published news involves mixing true and false information. Detecting COVID-19 fake news has become a critical task in the field of natural language processing (NLP). This paper explores the effectiveness of several machine learning algorithms and fine-tuning pre-trained transformer-based models, including Bidirectional Encoder Representations from Transformers (BERT) and COVID-Twitter-BERT (CT-BERT), for COVID-19 fake news detection. We evaluate the performance of different downstream neural network structures, such as CNN and BiGRU layers, added on top of BERT and CT-BERT with frozen or unfrozen parameters. Our experiments on a real-world COVID-19 fake news dataset demonstrate that incorporating BiGRU on top of the CT-BERT model achieves outstanding performance, with a state-of-the-art F1 score of 98%. These results have significant implications for mitigating the spread of COVID-19 misinformation and highlight the potential of advanced machine learning models for fake news detection.& COPY; 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Arabic Fake News Detection: Comparative Study of Neural Networks and Transformer-Based Approaches
    Al-Yahya, Maha
    Al-Khalifa, Hend
    Al-Baity, Heyam
    AlSaeed, Duaa
    Essam, Amr
    [J]. COMPLEXITY, 2021, 2021
  • [22] Generating Fake Cyber Threat Intelligence Using Transformer-Based Models
    Ranade, Priyanka
    Piplai, Aritran
    Mittal, Sudip
    Joshi, Anupam
    Finin, Tim
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [23] Detection of Fake News on COVID-19 on Web Search Engines
    Mazzeo, Valeria
    Rapisarda, Andrea
    Giuffrida, Giovanni
    [J]. FRONTIERS IN PHYSICS, 2021, 9
  • [24] COVID-19 Infodemic in Malaysia: Conceptualizing Fake News for Detection
    Lim, Chee Kuan
    Zainol, Zurinahni
    Omar, Bahiyah
    Ibrahim, Noor Farizah
    [J]. ADVANCES IN MULTIMEDIA, 2023, 2023
  • [25] Detection of fake news on COVID-19 on web search engines
    Mazzeo, Valeria
    Rapisarda, A.
    Giuffrida, G.
    [J]. arXiv, 2021,
  • [26] Cross-lingual COVID-19 Fake News Detection
    Du, Jiangshu
    Dou, Yingtong
    Xia, Congying
    Cui, Limeng
    Ma, Jing
    Yu, Philip S.
    [J]. 21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS ICDMW 2021, 2021, : 859 - 862
  • [27] Comparison of pretrained transformer-based models for influenza and COVID-19 detection using social media text data in Saskatchewan, Canada
    Tian, Yuan
    Zhang, Wenjing
    Duan, Lujie
    McDonald, Wade
    Osgood, Nathaniel
    [J]. FRONTIERS IN DIGITAL HEALTH, 2023, 5
  • [28] Fake news in COVID-19: A perspective
    Carrion-Alvarez, Diego
    Tijerina-Salina, Perla X.
    [J]. HEALTH PROMOTION PERSPECTIVES, 2020, 10 (04): : 290 - 291
  • [29] COVID-19 Fake News Detector
    Liu, Junjie
    Chen, Min
    [J]. 2023 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS, ICNC, 2023, : 463 - 467
  • [30] Fake review detection using transformer-based enhanced LSTM and RoBERTa
    Mohawesh, Rami
    Bany Salameh, Haythem
    Jararweh, Yaser
    Alkhalaileh, Mohannad
    Maqsood, Sumbal
    [J]. International Journal of Cognitive Computing in Engineering, 2024, 5 : 250 - 258