Effective fake news video detection using domain knowledge and multimodal data fusion on youtube

被引:17
|
作者
Choi, Hyewon [1 ]
Ko, Youngjoong [1 ]
机构
[1] Sungkyunkwan Univ, Dept Comp Sci & Engn, 2066 Seobu Ro, Suwon, Gyeonggi Do, South Korea
基金
新加坡国家研究基金会;
关键词
Fake news video detection; Domain knowledge; Multimodal data; Deep neural networks;
D O I
10.1016/j.patrec.2022.01.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the digital age, numerous videos are being actively produced and uploaded online. Simultaneously, fake news videos to attract public attention are also on the rise. Therefore, intensive research is being conducted to detect them. Validating video content is critical for all users as the public is exposed to various fake news videos. This study proposes ways to detect fake news videos effectively using domain knowledge and multimodal data fusion. We use domain knowledge to perform learning by reflecting the potential meaning of comments, helping us detecting fake news videos. We also use the linear combination to efficiently adjust the encoding rate for each characteristic of the video and effectively detect fake news videos. In particular, the domain knowledge improves the model performance by approximately 3% for all test datasets. Consequently, we achieve an F1-score of 0.93, which is higher than those of other comparison models in all the test datasets.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:44 / 52
页数:9
相关论文
共 50 条
  • [1] Multimodal Data Fusion Framework For Fake News Detection
    Athira, A. B.
    Tiwari, Abhishek
    Kumar, S. D. Madhu
    Chacko, Anu Mary
    [J]. 2022 IEEE 19TH INDIA COUNCIL INTERNATIONAL CONFERENCE, INDICON, 2022,
  • [2] Improving Data Fusion for Fake News Detection: A Hybrid Fusion Approach for Unimodal and Multimodal Data
    Hamed, Suhaib Kh.
    Ab Aziz, Mohd Juzaiddin
    Yaakub, Mohd Ridzwan
    [J]. IEEE ACCESS, 2024, 12 : 112412 - 112425
  • [3] A Multimodal Knowledge Representation Method for Fake News Detection
    Zeng, Fanhao
    Yao, Jiaxin
    Xu, Yijie
    Liu, Yanhua
    [J]. 2024 4TH INTERNATIONAL CONFERENCE ON COMPUTER, CONTROL AND ROBOTICS, ICCCR 2024, 2024, : 360 - 364
  • [4] Multimodal fake news detection using a Cultural Algorithm with situational and normative knowledge
    Shah, Priyanshi
    Kobti, Ziad
    [J]. 2020 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2020,
  • [5] Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection
    Nguyen Manh Duc Tuan
    Pham Quang Nhat Minh
    [J]. 2021 RIVF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION TECHNOLOGIES (RIVF 2021), 2021, : 43 - 48
  • [6] Multimodal fake news detection via progressive fusion networks
    Jing, Jing
    Wu, Hongchen
    Sun, Jie
    Fang, Xiaochang
    Zhang, Huaxiang
    [J]. INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (01)
  • [7] Multimodal Fake News Detection
    Segura-Bedmar, Isabel
    Alonso-Bartolome, Santiago
    [J]. INFORMATION, 2022, 13 (06)
  • [8] Reinforced Adaptive Knowledge Learning for Multimodal Fake News Detection
    Zhang, Litian
    Zhang, Xiaoming
    Zhou, Ziyi
    Huang, Feiran
    Li, Chaozhuo
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16777 - 16785
  • [9] Embracing Domain Differences in Fake News: Cross-domain Fake News Detection using Multi-modal Data
    Silva, Amila
    Luo, Ling
    Karunasekera, Shanika
    Leckie, Christopher
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 557 - 565
  • [10] Multimodal Fusion with Co-Attention Networks for Fake News Detection
    Wu, Yang
    Zhan, Pengwei
    Zhang, Yunjian
    Wang, Liming
    Xu, Zhen
    [J]. FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 2560 - 2569