One-class learning for fake news detection through multimodal variational autoencoders

被引:2
|
作者
Golo, Marcos Paulo Silva [1 ]
de Souza, Mariana Caravanti [1 ]
Rossi, Rafael Geraldeli [3 ]
Rezende, Solange Oliveira [1 ]
Nogueira, Bruno Magalhaes [2 ]
Marcacini, Ricardo Marcondes [1 ]
机构
[1] Univ Sao Paulo, Inst Math & Comp Sci, POB 668, BR-13560970 Sao Carlos, SP, Brazil
[2] FACOM Fed Univ Mato Grosso Do Sul, BR-79070900 Campo Grande, MS, Brazil
[3] Univ Fed Mato Grosso do Sul, Campus Tres Lagoas, BR-79613000 Tres Lagoas, MS, Brazil
基金
巴西圣保罗研究基金会;
关键词
Multimodal representation learning; Multimodal variational autoencoder; One-class fake news classification; One-class classification; Fake news classification;
D O I
10.1016/j.engappai.2023.106088
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Machine learning methods to detect fake news typically use textual features and Binary or Multi-class classification. However, accurately labeling a large news set is still a very costly process. On the other hand, one of the prominent approaches is One-Class Learning (OCL). OCL requires only the labeling of fake news, minimizing data labeling efforts. Although we eliminate the need to label non-interest news, the efficiency of OCL algorithms depends directly on the data representation model adopted. Most existing methods in the OCL literature explore representations based on one modality to detect fake news. However, different text features can be the reason for the news to be fake, such as topic or linguistic features. We model this behavior as different modalities for news to represent different textual feature sets. Thus, we present the MVAE-FakeNews, a multimodal method to represent the texts in the fake news detection through OCL that learns a new representation from the combination of promising modalities for news data: text embeddings, topic, and linguistic information. We used real-world fake news datasets in Portuguese and English in the experimental evaluation. Results show that MVAE-FakeNews obtained a better F1-Score and AUC-ROC, outperforming another fourteen methods in three datasets and getting competitive results on the other three. Moreover, our MVAE-FakeNews, with only 3% of labeled fake news, obtained comparable or higher results than other methods. To improve the experimental evaluation, we also propose the Multimodal LIME for OCL to identify how each modality is associated with the fake news class.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] Learning Textual Representations from Multiple Modalities to Detect Fake News Through One-Class Learning
    Golo, Marcos
    Caravanti, Mariana
    Rossi, Rafael
    Rezende, Solange
    Nogueira, Bruno
    Marcacini, Ricardo
    [J]. PROCEEDINGS OF THE 27TH BRAZILIAN SYMPOSIUM ON MULTIMEDIA AND THE WEB (WEBMEDIA '21), 2021, : 197 - 204
  • [2] MVAE: Multimodal Variational Autoencoder for Fake News Detection
    Khattar, Dhruv
    Goud, Jaipal Singh
    Gupta, Manish
    Varma, Vasudeva
    [J]. WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 2915 - 2921
  • [3] High Dimensional Latent Space Variational AutoEncoders for Fake News Detection
    Sadiq, Saad
    Wagner, Nicolas
    Shyu, Mei-Ling
    Feaster, Daniel
    [J]. 2019 2ND IEEE CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2019), 2019, : 437 - 442
  • [4] Multimodal Fake News Detection
    Segura-Bedmar, Isabel
    Alonso-Bartolome, Santiago
    [J]. INFORMATION, 2022, 13 (06)
  • [5] Multimodal fake news detection through data augmentation-based contrastive learning
    Hua, Jiaheng
    Cui, Xiaodong
    Li, Xianghua
    Tang, Keke
    Zhu, Peican
    [J]. APPLIED SOFT COMPUTING, 2023, 136
  • [6] Attentive Autoencoders for Multifaceted Preference Learning in One-class Collaborative Filtering
    Mai, Zheda
    Wu, Ga
    Luo, Kai
    Sanner, Scott
    [J]. 20TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW 2020), 2020, : 165 - 172
  • [7] Deep Learning Based One-Class Detection System for Fake Faces Generated by GAN Network
    Li, Shengyin
    Dutta, Vibekananda
    He, Xin
    Matsumaru, Takafumi
    [J]. SENSORS, 2022, 22 (20)
  • [8] Reinforced Adaptive Knowledge Learning for Multimodal Fake News Detection
    Zhang, Litian
    Zhang, Xiaoming
    Zhou, Ziyi
    Huang, Feiran
    Li, Chaozhuo
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16777 - 16785
  • [9] Not all fake news is semantically similar: Contextual semantic representation learning for multimodal fake news detection
    Peng, Liwen
    Jian, Songlei
    Kan, Zhigang
    Qiao, Linbo
    Li, Dongsheng
    [J]. INFORMATION PROCESSING & MANAGEMENT, 2024, 61 (01)
  • [10] Deep learning model based on cascaded autoencoders and one-class learning for detection and localization of anomalies from surveillance videos
    Pawar, Karishma
    Attar, Vahida
    [J]. IET BIOMETRICS, 2022, 11 (04) : 289 - 303