MVAE: Multimodal Variational Autoencoder for Fake News Detection

被引:319
|
作者
Khattar, Dhruv [1 ]
Goud, Jaipal Singh [1 ]
Gupta, Manish [1 ,2 ]
Varma, Vasudeva [1 ]
机构
[1] Int Inst Informat Technol, Hyderabad, Telangana, India
[2] Microsoft, Redmond, WA USA
关键词
Fake news detection; multimodal fusion; variational autoencoders; microblogs;
D O I
10.1145/3308558.3313552
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In recent times, fake news and misinformation have had a disruptive and adverse impact on our lives. Given the prominence of microblogging networks as a source of news for most individuals, fake news now spreads at a faster pace and has a more profound impact than ever before. This makes detection of fake news an extremely important challenge. Fake news articles, just like genuine news articles, leverage multimedia content to manipulate user opinions but spread misinformation. A shortcoming of the current approaches for the detection of fake news is their inability to learn a shared representation of multimodal (textual + visual) information. We propose an end-to-end network, Multimodal Variational Autoencoder (MVAE), which uses a bimodal variational autoencoder coupled with a binary classifier for the task of fake news detection. The model consists of three main components, an encoder, a decoder and a fake news detector module. The variational autoencoder is capable of learning probabilistic latent variable models by optimizing a bound on the marginal likelihood of the observed data. The fake news detector then utilizes the multimodal representations obtained from the bimodal variational autoencoder to classify posts as fake or not. We conduct extensive experiments on two standard fake news datasets collected from popular microblogging websites: Weibo and Twitter. The experimental results show that across the two datasets, on average our model outperforms state-of-the-art methods by margins as large as similar to 6% in accuracy and similar to 5% in F-1 scores.
引用
收藏
页码:2915 / 2921
页数:7
相关论文
共 50 条
  • [41] Multimodal Fusion with Co-Attention Networks for Fake News Detection
    Wu, Yang
    Zhan, Pengwei
    Zhang, Yunjian
    Wang, Liming
    Xu, Zhen
    [J]. FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 2560 - 2569
  • [42] High Dimensional Latent Space Variational AutoEncoders for Fake News Detection
    Sadiq, Saad
    Wagner, Nicolas
    Shyu, Mei-Ling
    Feaster, Daniel
    [J]. 2019 2ND IEEE CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2019), 2019, : 437 - 442
  • [43] A mutual attention based multimodal fusion for fake news detection on social network
    Guo, Ying
    [J]. APPLIED INTELLIGENCE, 2023, 53 (12) : 15311 - 15320
  • [44] SCATE: Shared Cross Attention Transformer Encoders for Multimodal Fake News Detection
    Sachan, Tanmay
    Pinnaparaju, Nikhil
    Gupta, Manish
    Varma, Vasudeva
    [J]. PROCEEDINGS OF THE 2021 IEEE/ACM INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING, ASONAM 2021, 2021, : 399 - 406
  • [45] Escaping the neutralization effect of modality features fusion in multimodal Fake News Detection
    Wang, Bing
    Li, Ximing
    Li, Changchun
    Wang, Shengsheng
    Gao, Wanfu
    [J]. INFORMATION FUSION, 2024, 111
  • [46] MIGCL: Fake news detection with multimodal interaction and graph contrastive learning networks
    Cui, Wei
    Shang, Mingsheng
    [J]. Applied Intelligence, 2025, 55 (01)
  • [47] A Review of Deep Learning Techniques for Multimodal Fake News and Harmful Languages Detection
    Festus Ayetiran, Eniafe
    Ozgobek, Ozlem
    [J]. IEEE ACCESS, 2024, 12 : 76133 - 76153
  • [48] A comprehensive survey of multimodal fake news detection techniques: advances, challenges, and opportunities
    Shivani Tufchi
    Ashima Yadav
    Tanveer Ahmed
    [J]. International Journal of Multimedia Information Retrieval, 2023, 12
  • [49] A comprehensive survey of multimodal fake news detection techniques: advances, challenges, and opportunities
    Tufchi, Shivani
    Yadav, Ashima
    Ahmed, Tanveer
    [J]. INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2023, 12 (02)
  • [50] EXMULF: An Explainable Multimodal Content-Based Fake News Detection System
    Amri, Sabrine
    Sallami, Dorsaf
    Aimeur, Esma
    [J]. FOUNDATIONS AND PRACTICE OF SECURITY, FPS 2021, 2022, 13291 : 177 - 187