MVAE: Multimodal Variational Autoencoder for Fake News Detection

被引:319
|
作者
Khattar, Dhruv [1 ]
Goud, Jaipal Singh [1 ]
Gupta, Manish [1 ,2 ]
Varma, Vasudeva [1 ]
机构
[1] Int Inst Informat Technol, Hyderabad, Telangana, India
[2] Microsoft, Redmond, WA USA
关键词
Fake news detection; multimodal fusion; variational autoencoders; microblogs;
D O I
10.1145/3308558.3313552
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In recent times, fake news and misinformation have had a disruptive and adverse impact on our lives. Given the prominence of microblogging networks as a source of news for most individuals, fake news now spreads at a faster pace and has a more profound impact than ever before. This makes detection of fake news an extremely important challenge. Fake news articles, just like genuine news articles, leverage multimedia content to manipulate user opinions but spread misinformation. A shortcoming of the current approaches for the detection of fake news is their inability to learn a shared representation of multimodal (textual + visual) information. We propose an end-to-end network, Multimodal Variational Autoencoder (MVAE), which uses a bimodal variational autoencoder coupled with a binary classifier for the task of fake news detection. The model consists of three main components, an encoder, a decoder and a fake news detector module. The variational autoencoder is capable of learning probabilistic latent variable models by optimizing a bound on the marginal likelihood of the observed data. The fake news detector then utilizes the multimodal representations obtained from the bimodal variational autoencoder to classify posts as fake or not. We conduct extensive experiments on two standard fake news datasets collected from popular microblogging websites: Weibo and Twitter. The experimental results show that across the two datasets, on average our model outperforms state-of-the-art methods by margins as large as similar to 6% in accuracy and similar to 5% in F-1 scores.
引用
收藏
页码:2915 / 2921
页数:7
相关论文
共 50 条
  • [1] GatedVAE: Detecting Multimodal Fake News with Gated Variational AutoEncoder
    Gu, Yimeng
    Castro, Ignacio
    Tyson, Gareth
    [J]. 16TH ACM WEB SCIENCE CONFERENCE, WEBSCIENCE 2024, 2024, : 129 - 138
  • [2] Multimodal Fake News Detection
    Segura-Bedmar, Isabel
    Alonso-Bartolome, Santiago
    [J]. INFORMATION, 2022, 13 (06)
  • [3] Unsupervised Fake News Detection Based on Autoencoder
    Li, Dun
    Guo, Haimei
    Wang, Zhenfei
    Zheng, Zhiyun
    [J]. IEEE ACCESS, 2021, 9 : 29356 - 29365
  • [4] One-class learning for fake news detection through multimodal variational autoencoders
    Golo, Marcos Paulo Silva
    de Souza, Mariana Caravanti
    Rossi, Rafael Geraldeli
    Rezende, Solange Oliveira
    Nogueira, Bruno Magalhaes
    Marcacini, Ricardo Marcondes
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 122
  • [5] A Multimodal Hierarchical Variational Autoencoder for Saliency Detection
    Yu, Zhengyang
    Zhang, Jing
    Barnes, Nick
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [6] Fake News Detection Based on Multimodal Inputs
    Liang, Zhiping
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (02): : 4519 - 4534
  • [7] Improving Generalization for Multimodal Fake News Detection
    Tahmasebi, Sahar
    Hakimov, Sherzod
    Ewerth, Ralph
    Mueller-Budack, Eric
    [J]. PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023, 2023, : 581 - 585
  • [8] Multimodal Multi-image Fake News Detection
    Giachanou, Anastasia
    Zhang, Guobiao
    Rosso, Paolo
    [J]. 2020 IEEE 7TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA 2020), 2020, : 647 - 654
  • [9] Dataset for multimodal fake news detection and verification tasks
    Bondielli, Alessandro
    Dell'Oglio, Pietro
    Lenci, Alessandro
    Marcelloni, Francesco
    Passaro, Lucia
    [J]. DATA IN BRIEF, 2024, 54
  • [10] Multimodal Data Fusion Framework For Fake News Detection
    Athira, A. B.
    Tiwari, Abhishek
    Kumar, S. D. Madhu
    Chacko, Anu Mary
    [J]. 2022 IEEE 19TH INDIA COUNCIL INTERNATIONAL CONFERENCE, INDICON, 2022,