MDCF-Net: Multi-Scale Dual-Branch Network for Compressed Face Forgery Detection

被引:0
|
作者
Zhou, Jiting [1 ]
Zhao, Xinrui [1 ]
Xu, Qian [1 ]
Zhang, Pu [1 ]
Zhou, Zhihao [1 ]
机构
[1] Shanghai Univ, Shanghai Film Acad, Shanghai 200072, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Feature extraction; Frequency-domain analysis; Face recognition; Forgery; Transformers; Deepfakes; Image coding; Face forgery; deepfake detection; transformers; frequency domain; two-branch; feature fusion; FEATURE FUSION;
D O I
10.1109/ACCESS.2024.3390217
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Face forgery detection aims to identify manipulated or altered facial images or videos created using artificial intelligence. Existing detection methods exhibit favorable performance on high-quality videos, but the videos in daily applications are commonly compressed into low-quality formats via social media. The detection difficulty is increased by the poor quality, indistinct detail features, and noises such as artifacts in these images or videos. To address this challenge, we propose a multi-scale dual-branch network for compressed face forgery, called MDCF-Net, effectively capturing cross-domain forgery features at various scales in compressed facial images. The MDCF-Net comprises two branches: an RGB domain branch utilizing Transformers to extract multi-scale fine-texture features from the original RGB images; a frequency domain branch designed to capture artifacts in low-quality videos by extracting global spectral features as a supplementary measure. Then, we introduce a feature fusion module (FFM) based on multi-head attention to merge diverse feature representations in a spatial-frequency complementary manner. Extensive comparative experiments on public datasets such as FaceForensics++, Celeb-DF, and WildDeepfake demonstrate the significant advantage of MDCF-Net in detecting highly compressed and low-quality forged images or videos, especially in achieving state-of-the-art performance on the FaceForensics++ low-quality dataset. Our approach presents a new perspective and technology for low-quality face forgery detection.
引用
收藏
页码:58740 / 58749
页数:10
相关论文
共 50 条
  • [1] Inconsistency-Aware Wavelet Dual-Branch Network for Face Forgery Detection
    Jia, Gengyun
    Zheng, Meisong
    Hu, Chuanrui
    Ma, Xin
    Xu, Yuting
    Liu, Luoqi
    Deng, Yafeng
    He, Ran
    [J]. IEEE Transactions on Biometrics, Behavior, and Identity Science, 2021, 3 (03): : 308 - 319
  • [2] Dual-branch multi-scale densely connected network for image splicing detection and localization
    Zhang, Jingyuan
    Wang, Hongxia
    He, Peisong
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 119
  • [3] A Medical Image Segmentation Network with Multi-Scale and Dual-Branch Attention
    Zhu, Cancan
    Cheng, Ke
    Hua, Xuecheng
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (14):
  • [4] MMDN: Arrhythmia detection using multi-scale multi-view dual-branch fusion network
    Zhu, Yelong
    Jiang, Mingfeng
    He, Xiaoyu
    Li, Yang
    Li, Juan
    Mao, Jiangdong
    Ke, Wei
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 96
  • [5] Joint Segmentation and Quantification of Main Coronary Vessels Using Dual-Branch Multi-scale Attention Network
    Zhang, Hongwei
    Zhang, Dong
    Gao, Zhifan
    Zhang, Heye
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT I, 2021, 12901 : 369 - 378
  • [6] FB-Net: Dual-Branch Foreground-Background Fusion Network With Multi-Scale Semantic Scanning for Image-Text Retrieval
    Xu, Junhao
    Liu, Zheng
    Pei, Xinlei
    Wang, Shuhuai
    Gao, Shanshan
    [J]. IEEE ACCESS, 2023, 11 : 36516 - 36537
  • [7] MCDC-Net: Multi-scale forgery image detection network based on central difference convolution
    He, Defen
    Jiang, Qian
    Jin, Xin
    Cheng, Zien
    Liu, Shuai
    Yao, Shaowen
    Zhou, Wei
    [J]. IET IMAGE PROCESSING, 2024, 18 (01) : 1 - 12
  • [8] Dual-Branch Enhanced Network for Change Detection
    Zhang, Hongrui
    Qu, Shaocheng
    Li, Huan
    [J]. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2022, 47 (03) : 3459 - 3471
  • [9] MRS-Net: Multi-Scale Recurrent Scalable Network for Face Quality Enhancement of Compressed Videos
    Liu, Tie
    Xu, Mai
    Li, Shengxi
    Ding, Rui
    Liu, Huaida
    [J]. MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 3292 - 3301
  • [10] Dual-Branch Enhanced Network for Change Detection
    Hongrui Zhang
    Shaocheng Qu
    Huan Li
    [J]. Arabian Journal for Science and Engineering, 2022, 47 : 3459 - 3471