MVAE: Multimodal Variational Autoencoder for Fake News Detection

被引:319
|
作者
Khattar, Dhruv [1 ]
Goud, Jaipal Singh [1 ]
Gupta, Manish [1 ,2 ]
Varma, Vasudeva [1 ]
机构
[1] Int Inst Informat Technol, Hyderabad, Telangana, India
[2] Microsoft, Redmond, WA USA
关键词
Fake news detection; multimodal fusion; variational autoencoders; microblogs;
D O I
10.1145/3308558.3313552
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In recent times, fake news and misinformation have had a disruptive and adverse impact on our lives. Given the prominence of microblogging networks as a source of news for most individuals, fake news now spreads at a faster pace and has a more profound impact than ever before. This makes detection of fake news an extremely important challenge. Fake news articles, just like genuine news articles, leverage multimedia content to manipulate user opinions but spread misinformation. A shortcoming of the current approaches for the detection of fake news is their inability to learn a shared representation of multimodal (textual + visual) information. We propose an end-to-end network, Multimodal Variational Autoencoder (MVAE), which uses a bimodal variational autoencoder coupled with a binary classifier for the task of fake news detection. The model consists of three main components, an encoder, a decoder and a fake news detector module. The variational autoencoder is capable of learning probabilistic latent variable models by optimizing a bound on the marginal likelihood of the observed data. The fake news detector then utilizes the multimodal representations obtained from the bimodal variational autoencoder to classify posts as fake or not. We conduct extensive experiments on two standard fake news datasets collected from popular microblogging websites: Weibo and Twitter. The experimental results show that across the two datasets, on average our model outperforms state-of-the-art methods by margins as large as similar to 6% in accuracy and similar to 5% in F-1 scores.
引用
收藏
页码:2915 / 2921
页数:7
相关论文
共 50 条
  • [31] Multimodal Relationship-aware Attention Network for Fake News Detection
    Yang, Hongyu
    Zhang, Jinjiao
    Hu, Ze
    Zhang, Liang
    Cheng, Xiang
    [J]. 2023 INTERNATIONAL CONFERENCE ON DATA SECURITY AND PRIVACY PROTECTION, DSPP, 2023, : 143 - 149
  • [32] OVERVIEW OF MULTIMODAL DATA AND ITS APPLICATION TO FAKE- NEWS DETECTION
    Boyko, Nataliya
    [J]. JORDANIAN JOURNAL OF COMPUTERS AND INFORMATION TECHNOLOGY, 2024, 10 (03): : 281 - 293
  • [33] Multimodal Fake News Detection Based on Contrastive Learning and Similarity Fusion
    Li, Yan
    Jia, Kaidi
    Wang, Qiyuan
    [J]. IEEE Access, 2024, 12 : 155351 - 155364
  • [34] Multimodal Fake News Detection via CLIP-Guided Learning
    Zhou, Yangming
    Yang, Yuzhou
    Ying, Qichao
    Qian, Zhenxing
    Zhang, Xinpeng
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2825 - 2830
  • [35] High Dimensional Latent Space Variational AutoEncoders for Fake News Detection
    Sadiq, Saad
    Wagner, Nicolas
    Shyu, Mei-Ling
    Feaster, Daniel
    [J]. 2019 2ND IEEE CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2019), 2019, : 437 - 442
  • [36] Multimodal Fusion with Co-Attention Networks for Fake News Detection
    Wu, Yang
    Zhan, Pengwei
    Zhang, Yunjian
    Wang, Liming
    Xu, Zhen
    [J]. FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 2560 - 2569
  • [37] MFIR: Multimodal fusion and inconsistency reasoning for explainable fake news detection
    Wu, Lianwei
    Long, Yuzhou
    Gao, Chao
    Wang, Zhen
    Zhang, Yanning
    [J]. INFORMATION FUSION, 2023, 100
  • [38] Temporal Enhanced Multimodal Graph Neural Networks for Fake News Detection
    Qu, Zhibo
    Zhou, Fuhui
    Song, Xi
    Ding, Rui
    Yuan, Lu
    Wu, Qihui
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024,
  • [39] Similarity-Aware Multimodal Prompt Learning for fake news detection
    Jiang, Ye
    Yu, Xiaomin
    Wang, Yimin
    Xu, Xiaoman
    Song, Xingyi
    Maynard, Diana
    [J]. INFORMATION SCIENCES, 2023, 647
  • [40] SceneFND: Multimodal fake news detection by modelling scene context information
    Zhang, Guobiao
    Giachanou, Anastasia
    Rosso, Paolo
    [J]. JOURNAL OF INFORMATION SCIENCE, 2024, 50 (02) : 355 - 367