Multimodal Approach for DeepFake Detection

被引:8
|
作者
Lomnitz, Michael [1 ]
Hampel-Arias, Zigfried [1 ]
Sandesara, Vishal [1 ]
Hu, Simon [1 ]
机构
[1] In Q Tel Inc, IQTLabs, Menlo Pk, CA 94025 USA
关键词
deep learning; deep fakes; generative adversarial networks;
D O I
10.1109/AIPR50011.2020.9425192
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Generative Adversarial Networks (GANs) have become increasingly popular in machine learning because of their ability to mimic any distribution of data. Though GANs can be leveraged for legitimate purposes, they have increasingly been used to create manipulative and misleading synthetic media, known as deepfakes, intended for nefarious purposes. In this submission we discuss a multimodal deepfake detection solution submitted against the Facebook DeepFake Detection Challenge, a state of the art benchmark dataset and competition released at the end of 2019. Our solution incorporates information from single images and series of images, and also incorporates temporal information from audio and video data, and was ultimately ranked among the top 25% of teams.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] A Robust Approach to Multimodal Deepfake Detection
    Salvi, Davide
    Liu, Honggu
    Mandelli, Sara
    Bestagini, Paolo
    Zhou, Wenbo
    Zhang, Weiming
    Tubaro, Stefano
    [J]. JOURNAL OF IMAGING, 2023, 9 (06)
  • [2] A Survey on Multimodal Deepfake and Detection Techniques
    Li, Zeyu
    Zhang, Xuhong
    Pu, Yuwen
    Wu, Yiming
    Ji, Shouling
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2023, 60 (06): : 1396 - 1416
  • [3] MCL: Multimodal Contrastive Learning for Deepfake Detection
    Liu, Xiaolong
    Yu, Yang
    Li, Xiaolong
    Zhao, Yao
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (04) : 2803 - 2813
  • [4] Magnifying multimodal forgery clues for Deepfake detection
    Liu, Xiaolong
    Yu, Yang
    Li, Xiaolong
    Zhao, Yao
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 118
  • [5] A Novel Deep Learning Approach for Deepfake Image Detection
    Raza, Ali
    Munir, Kashif
    Almutairi, Mubarak
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (19):
  • [6] A New Approach for Deepfake Detection with the Choquet Fuzzy Integral
    Karakose, Mehmet
    Ilhan, Ismail
    Yetis, Hasan
    Atas, Serhat
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (16):
  • [7] ADD: Attention-Based DeepFake Detection Approach
    Khormali, Aminollah
    Yuan, Jiann-Shiun
    [J]. BIG DATA AND COGNITIVE COMPUTING, 2021, 5 (04)
  • [8] Deepfake detection by exploiting surface anomalies: the SurFake approach
    Ciamarra, Andrea
    Caldelli, Roberto
    Becattini, Federico
    Seidenari, Lorenzo
    Del Bimbo, Alberto
    [J]. 2024 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS, WACVW 2024, 2024, : 1024 - 1033
  • [9] DeepFake Video Detection: A Time-Distributed Approach
    Singh A.
    Saimbhi A.S.
    Singh N.
    Mittal M.
    [J]. SN Computer Science, 2020, 1 (4)
  • [10] A New Approach for Effective Medical Deepfake Detection in Medical Images
    Karakose, Mehmet
    Yetis, Hasan
    Cecen, Mert
    [J]. IEEE ACCESS, 2024, 12 : 52205 - 52214