Multimodal Emergent Fake News Detection via Meta Neural Process Networks

被引:26
|
作者
Wang, Yaqing [1 ]
Ma, Fenglong [2 ]
Wang, Haoyu [1 ]
Jha, Kishlay [3 ]
Gao, Jing [1 ]
机构
[1] Purdue Univ, W Lafayette, IN 47907 USA
[2] Penn State Univ, University Pk, PA 16802 USA
[3] Univ Virginia, Charlottesville, VA USA
基金
美国国家科学基金会;
关键词
meta-learning; fake news detection; natural language processing;
D O I
10.1145/3447548.3467153
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Fake news travels at unprecedented speeds, reaches global audiences and puts users and communities at great risk via social media platforms. Deep learning based models show good performance when trained on large amounts of labeled data on events of interest, whereas the performance of models tends to degrade on other events due to domain shift. Therefore, significant challenges are posed for existing detection approaches to detect fake news on emergent events, where large-scale labeled datasets are difficult to obtain. Moreover, adding the knowledge from newly emergent events requires to build a new model from scratch or continue to fine-tune the model, which can be challenging, expensive, and unrealistic for real-world settings. In order to address those challenges, we propose an end-to-end fake news detection framework named MetaFEND, which is able to learn quickly to detect fake news on emergent events with a few verified posts. Specifically, the proposed model integrates meta-learning and neural process methods together to enjoy the benefits of these approaches. In particular, a label embedding module and a hard attention mechanism are proposed to enhance the effectiveness by handling categorical information and trimming irrelevant posts. Extensive experiments are conducted on multimedia datasets collected from Twitter and Weibo. The experimental results show our proposed MetaFEND model can detect fake news on never-seen events effectively and outperform the state-of-the-art methods.
引用
收藏
页码:3708 / 3716
页数:9
相关论文
共 50 条
  • [41] SpotFake plus : A Multimodal Framework for Fake News Detection via Transfer Learning (Student Abstract)
    Singhal, Shivangi
    Kabra, Anubha
    Sharma, Mohit
    Shah, Rajiv Ratn
    Chakraborty, Tanmoy
    Kumaraguru, Ponnurangam
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 13915 - 13916
  • [42] Inter-modality Discordance for Multimodal Fake News Detection
    Singhal, Shivangi
    Dhawan, Mudit
    Shah, Rajiv Ratn
    Kumaraguru, Ponnurangam
    [J]. ACM International Conference Proceeding Series, 2021,
  • [43] CB-Fake: A multimodal deep learning framework for automatic fake news detection using capsule neural network and BERT
    Balasubramanian Palani
    Sivasankar Elango
    Vignesh Viswanathan K
    [J]. Multimedia Tools and Applications, 2022, 81 : 5587 - 5620
  • [44] Research on fake news detection based on CLIP multimodal mechanism
    Xu, Jinzhong
    Zhang, Yujie
    Liu, Weiguang
    [J]. PROCEEDINGS OF 2024 3RD INTERNATIONAL CONFERENCE ON CYBER SECURITY, ARTIFICIAL INTELLIGENCE AND DIGITAL ECONOMY, CSAIDE 2024, 2024, : 72 - 79
  • [45] Multimodal Fake News Detection with Textual, Visual and Semantic Information
    Giachanou, Anastasia
    Zhang, Guobiao
    Rosso, Paolo
    [J]. TEXT, SPEECH, AND DIALOGUE (TSD 2020), 2020, 12284 : 30 - 38
  • [46] Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection
    Nguyen Manh Duc Tuan
    Pham Quang Nhat Minh
    [J]. 2021 RIVF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION TECHNOLOGIES (RIVF 2021), 2021, : 43 - 48
  • [47] Fake News Detection Based on the Correlation Extension of Multimodal Information
    Li, Yanqiang
    Ji, Ke
    Ma, Kun
    Chen, Zhenxiang
    Zhou, Jin
    Wu, Jun
    [J]. WEB AND BIG DATA, PT I, APWEB-WAIM 2022, 2023, 13421 : 443 - 450
  • [48] Hierarchical Semantic Enhancement Network for Multimodal Fake News Detection
    Zhang, Qiang
    Liu, Jiawei
    Zhang, Fanrui
    Xie, Jingyi
    Zha, Zheng-Jun
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3424 - 3433
  • [49] Reinforced Adaptive Knowledge Learning for Multimodal Fake News Detection
    Zhang, Litian
    Zhang, Xiaoming
    Zhou, Ziyi
    Huang, Feiran
    Li, Chaozhuo
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16777 - 16785
  • [50] CB-Fake: A multimodal deep learning framework for automatic fake news detection using capsule neural network and BERT
    Palani, Balasubramanian
    Elango, Sivasankar
    Viswanathan, Vignesh K.
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (04) : 5587 - 5620