Low-Quality Deepfake Detection via Unseen Artifacts

被引:0
|
作者
Chhabra S. [1 ,2 ]
Thakral K. [1 ]
Mittal S. [1 ]
Vatsa M. [1 ]
Singh R. [1 ]
机构
[1] Indian Institute of Technology Jodhpur, Jodhpur
[2] Indraprastha Institute of Information Technology Delhi, New Delhi
来源
关键词
Artifacts; compression; deepfake;
D O I
10.1109/TAI.2023.3299894
中图分类号
学科分类号
摘要
The proliferation of manipulated media over the Internet has become a major source of concern in recent times. With the wide variety of techniques being used to create fake media, it has become increasingly difficult to identify such occurrences. While existing algorithms perform well on the detection of such media, limited algorithms take the impact of compression into account. Different social media platforms use different compression factors and algorithms before sharing such images and videos, which amplifies the issues in their identification. Therefore, it has become imperative that fake media detection algorithms work well for data compressed at different factors. To this end, the focus of this article is detecting low-quality fake videos in the compressed domain. The proposed algorithm distinguishes real images and videos from altered ones by using a learned visibility matrix, which enforces the model to see unseen imperceptible artifacts in the data. As a result, the learned model is robust to loss of information due to data compression. The performance is evaluated on three publicly available datasets, namely Celeb-DF, FaceForensics, and FaceForensics++, with three manipulation techniques, viz., Deepfakes, Face2Face, and FaceSwap. Experimental results show that the proposed approach is robust under different compression factors and yields state-of-the-art performance on the FaceForensics++ and Celeb-DF datasets with 97.14% classification accuracy and 74.45% area under the curve, respectively. © 2020 IEEE.
引用
收藏
页码:1573 / 1585
页数:12
相关论文
共 50 条
  • [1] Employing Super Resolution to Improve Low-Quality Deepfake Detection
    Perera, Anjana Samindra
    Atukorale, Ajantha S.
    Kumarasinghe, Prabhash
    2022 22ND INTERNATIONAL CONFERENCE ON ADVANCES IN ICT FOR EMERGING REGIONS (ICTER), 2022,
  • [2] Low-Quality Deepfake Video Detection Model Targeting Compression-Degraded Spatiotemporal Inconsistencies
    Mi, Zhongjie
    Jiang, Xinghao
    Sun, Tanfeng
    Xu, Ke
    Xu, Qiang
    Meng, Laijin
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT IX, ICIC 2024, 2024, 14870 : 267 - 280
  • [3] FTDKD: Frequency-Time Domain Knowledge Distillation for Low-Quality Compressed Audio Deepfake Detection
    Wang, Bo
    Tang, Yeling
    Wei, Fei
    Ba, Zhongjie
    Ren, Kui
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 4905 - 4918
  • [4] Exposing low-quality deepfake videos of Social Network Service using Spatial Restored Detection Framework
    Li, Ying
    Bian, Shan
    Wang, Chuntao
    Polat, Kemal
    Alhudhaif, Adi
    Alenezi, Fayadh
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 231
  • [5] Low-Quality DanMu Detection via Eye-Tracking Patterns
    Liu, Xiangyang
    He, Weidong
    Xu, Tong
    Chen, Enhong
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, KSEM 2022, PT III, 2022, 13370 : 247 - 259
  • [6] FORGERY DETECTION OF LOW QUALITY DEEPFAKE VIDEOS
    Sohaib, M.
    Tehseen, S.
    NEURAL NETWORK WORLD, 2023, 33 (02) : 85 - 99
  • [7] Gesture detection in low-quality video
    Roh, Myung-Cheol
    Lee, Seong-Whan
    18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 4, PROCEEDINGS, 2006, : 791 - +
  • [8] Object Detection on Underground Low-quality Images
    Mu, Qi
    He, Zhiqiang
    Liu, Yankui
    Sun, Yu
    2018 INTERNATIONAL SYMPOSIUM ON POWER ELECTRONICS AND CONTROL ENGINEERING (ISPECE 2018), 2019, 1187
  • [9] Survey of Face Detection on Low-quality Images
    Zhou, Yuqian
    Liu, Ding
    Huang, Thomas
    PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, : 769 - 773
  • [10] Ship Detection in Low-Quality SAR Images via an Unsupervised Domain Adaption Method
    Pu, Xinyang
    Jia, Hecheng
    Xin, Yu
    Wang, Feng
    Wang, Haipeng
    REMOTE SENSING, 2023, 15 (13)