Multimodal Approach for DeepFake Detection

被引:8
|
作者
Lomnitz, Michael [1 ]
Hampel-Arias, Zigfried [1 ]
Sandesara, Vishal [1 ]
Hu, Simon [1 ]
机构
[1] In Q Tel Inc, IQTLabs, Menlo Pk, CA 94025 USA
关键词
deep learning; deep fakes; generative adversarial networks;
D O I
10.1109/AIPR50011.2020.9425192
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Generative Adversarial Networks (GANs) have become increasingly popular in machine learning because of their ability to mimic any distribution of data. Though GANs can be leveraged for legitimate purposes, they have increasingly been used to create manipulative and misleading synthetic media, known as deepfakes, intended for nefarious purposes. In this submission we discuss a multimodal deepfake detection solution submitted against the Facebook DeepFake Detection Challenge, a state of the art benchmark dataset and competition released at the end of 2019. Our solution incorporates information from single images and series of images, and also incorporates temporal information from audio and video data, and was ultimately ranked among the top 25% of teams.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Deepfake generation and detection, a survey
    Zhang, Tao
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (05) : 6259 - 6276
  • [32] Aggregating Layers for Deepfake Detection
    Jevnisek, Amir
    Avidan, Shai
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2027 - 2033
  • [33] The Face Deepfake Detection Challenge
    Guarnera, Luca
    Giudice, Oliver
    Guarnera, Francesco
    Ortis, Alessandro
    Puglisi, Giovanni
    Paratore, Antonino
    Bui, Linh M. Q.
    Fontani, Marco
    Coccomini, Davide Alessandro
    Caldelli, Roberto
    Falchi, Fabrizio
    Gennaro, Claudio
    Messina, Nicola
    Amato, Giuseppe
    Perelli, Gianpaolo
    Concas, Sara
    Cuccu, Carlo
    Orru, Giulia
    Marcialis, Gian Luca
    Battiato, Sebastiano
    [J]. JOURNAL OF IMAGING, 2022, 8 (10)
  • [34] ResViT: A Framework for Deepfake Videos Detection
    Ahmad, Wasim
    Ali, Imad
    Shahzad, Sahibzada Adil
    Hashmi, Ammarah
    Ghaffar, Faisal
    [J]. INTERNATIONAL JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING SYSTEMS, 2022, 13 (09) : 807 - 813
  • [35] DeepFake Detection by Analyzing Convolutional Traces
    Guarnera, Luca
    Giudice, Oliver
    Battiato, Sebastiano
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2841 - 2850
  • [36] Multimodal Evolution Approach to Multidimensional Intrusion Detection
    翁广安
    余胜生
    周敬利
    [J]. Railway Engineering Science, 2006, (03) : 212 - 217
  • [37] Multimodal Sarcasm Detection: A Deep Learning Approach
    Bharti, Santosh Kumar
    Gupta, Rajeev Kumar
    Shukla, Prashant Kumar
    Hatamleh, Wesam Atef
    Tarazi, Hussam
    Nuagah, Stephen Jeswinde
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [38] Multi-attention-based approach for deepfake face and expression swap detection and localization
    Saima Waseem
    Syed Abdul Rahman Syed Abu-Bakar
    Zaid Omar
    Bilal Ashfaq Ahmed
    Saba Baloch
    Adel Hafeezallah
    [J]. EURASIP Journal on Image and Video Processing, 2023
  • [39] A Multimodal Approach for Protein Remote Homology Detection
    Lovato, Pietro
    Giorgetti, Alejandro
    Bicego, Manuele
    [J]. IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2015, 12 (05) : 1193 - 1198
  • [40] Cooperative Multimodal Approach to Depression Detection in Twitter
    Gui, Tao
    Zhu, Liang
    Zhang, Qi
    Peng, Minlong
    Zhou, Xu
    Ding, Keyu
    Chen, Zhigang
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 110 - 117