Multimodal Approach for DeepFake Detection

被引:8
|
作者
Lomnitz, Michael [1 ]
Hampel-Arias, Zigfried [1 ]
Sandesara, Vishal [1 ]
Hu, Simon [1 ]
机构
[1] In Q Tel Inc, IQTLabs, Menlo Pk, CA 94025 USA
关键词
deep learning; deep fakes; generative adversarial networks;
D O I
10.1109/AIPR50011.2020.9425192
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Generative Adversarial Networks (GANs) have become increasingly popular in machine learning because of their ability to mimic any distribution of data. Though GANs can be leveraged for legitimate purposes, they have increasingly been used to create manipulative and misleading synthetic media, known as deepfakes, intended for nefarious purposes. In this submission we discuss a multimodal deepfake detection solution submitted against the Facebook DeepFake Detection Challenge, a state of the art benchmark dataset and competition released at the end of 2019. Our solution incorporates information from single images and series of images, and also incorporates temporal information from audio and video data, and was ultimately ranked among the top 25% of teams.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Deepfake Detection: A Systematic Literature Review
    Rana, Md Shohel
    Nobi, Mohammad Nur
    Murali, Beddhu
    Sung, Andrew H.
    [J]. IEEE ACCESS, 2022, 10 : 25494 - 25513
  • [42] Deepfake Detection with Data Privacy Protection
    Wu, Mingkan
    Wang, Fei
    Wu, Xiaohan
    Yu, Fei
    Wang, Bo
    Song, Zengren
    [J]. 2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [43] Capturing the Lighting Inconsistency for Deepfake Detection
    Wu, Wenxuan
    Zhou, Wenbo
    Zhang, Weiming
    Fang, Han
    Yu, Nenghai
    [J]. ARTIFICIAL INTELLIGENCE AND SECURITY, ICAIS 2022, PT II, 2022, 13339 : 637 - 647
  • [44] Adversarially Robust Deepfake Video Detection
    Devasthale, Aditya
    Sural, Shamik
    [J]. 2022 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2022, : 396 - 403
  • [45] Deepfake Detection through Deep Learning
    Pan, Deng
    Sun, Lixian
    Wang, Rui
    Zhang, Xingjian
    Sinnott, Richard O.
    [J]. 2020 IEEE/ACM INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING, APPLICATIONS AND TECHNOLOGIES (BDCAT 2020), 2020, : 134 - 143
  • [46] Deepfake Text Detection: Limitations and Opportunities
    Pu, Jiameng
    Sarwar, Zain
    Abdullah, Sifat Muhammad
    Rehman, Abdullah
    Kim, Yoonjin
    Bhattacharya, Parantapa
    Javed, Mobin
    Viswanath, Bimal
    [J]. 2023 IEEE SYMPOSIUM ON SECURITY AND PRIVACY, SP, 2023, : 1613 - 1630
  • [47] Hybrid Transformer Network for Deepfake Detection
    Khan, Sohail Ahmed
    Dang-Nguyen, Duc-Tien
    [J]. 19TH INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING, CBMI 2022, 2022, : 8 - 14
  • [48] Deepfake detection based on remote photoplethysmography
    Qingzhen Xu
    Han Qiao
    Shuang Liu
    Shouqiang Liu
    [J]. Multimedia Tools and Applications, 2023, 82 : 35439 - 35456
  • [49] Masked Relation Learning for DeepFake Detection
    Yang, Ziming
    Liang, Jian
    Xu, Yuting
    Zhang, Xiao-Yu
    He, Ran
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 : 1696 - 1708
  • [50] A Survey on Face Forgery Detection of Deepfake
    Zhang, Ying
    Gao, Feng
    Zhou, Zichen
    Guo, Hong
    [J]. THIRTEENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2021), 2021, 11878