MDCF-Net: Multi-Scale Dual-Branch Network for Compressed Face Forgery Detection

被引:0
|
作者
Zhou, Jiting [1 ]
Zhao, Xinrui [1 ]
Xu, Qian [1 ]
Zhang, Pu [1 ]
Zhou, Zhihao [1 ]
机构
[1] Shanghai Univ, Shanghai Film Acad, Shanghai 200072, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Feature extraction; Frequency-domain analysis; Face recognition; Forgery; Transformers; Deepfakes; Image coding; Face forgery; deepfake detection; transformers; frequency domain; two-branch; feature fusion; FEATURE FUSION;
D O I
10.1109/ACCESS.2024.3390217
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Face forgery detection aims to identify manipulated or altered facial images or videos created using artificial intelligence. Existing detection methods exhibit favorable performance on high-quality videos, but the videos in daily applications are commonly compressed into low-quality formats via social media. The detection difficulty is increased by the poor quality, indistinct detail features, and noises such as artifacts in these images or videos. To address this challenge, we propose a multi-scale dual-branch network for compressed face forgery, called MDCF-Net, effectively capturing cross-domain forgery features at various scales in compressed facial images. The MDCF-Net comprises two branches: an RGB domain branch utilizing Transformers to extract multi-scale fine-texture features from the original RGB images; a frequency domain branch designed to capture artifacts in low-quality videos by extracting global spectral features as a supplementary measure. Then, we introduce a feature fusion module (FFM) based on multi-head attention to merge diverse feature representations in a spatial-frequency complementary manner. Extensive comparative experiments on public datasets such as FaceForensics++, Celeb-DF, and WildDeepfake demonstrate the significant advantage of MDCF-Net in detecting highly compressed and low-quality forged images or videos, especially in achieving state-of-the-art performance on the FaceForensics++ low-quality dataset. Our approach presents a new perspective and technology for low-quality face forgery detection.
引用
下载
收藏
页码:58740 / 58749
页数:10
相关论文
共 50 条
  • [21] Anchor Free Network for Multi-Scale Face Detection
    Wang, Chengji
    Luo, Zhiming
    Lian, Sheng
    Li, Shaozi
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 1554 - 1559
  • [22] Double-branch forgery image detection based on multi-scale feature fusion
    ZHANG Hongying
    GUO Chunxing
    WANG Xuyong
    Optoelectronics Letters, 2024, 20 (05) : 307 - 312
  • [23] Dual-branch network with memory for video anomaly detection
    Dicong Wang
    Qinghua Hu
    Kaijun Wu
    Multimedia Systems, 2023, 29 : 247 - 259
  • [24] Dual-branch network with memory for video anomaly detection
    Wang, Dicong
    Hu, Qinghua
    Wu, Kaijun
    MULTIMEDIA SYSTEMS, 2023, 29 (01) : 247 - 259
  • [25] Dual-Branch Multi-Scale Relation Networks with Tutorial Learning for Few-Shot Learning
    Xu, Chuanyun
    Wang, Hang
    Zhang, Yang
    Zhou, Zheng
    Li, Gang
    APPLIED SCIENCES-BASEL, 2024, 14 (04):
  • [26] DRA-Net: A Dual-Branch Residual Attention Network for Pixelwise Power Line Detection
    Yang, Lei
    Kong, Shuyi
    Deng, Jiahui
    Li, Heng
    Liu, Yanhong
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [27] DBMA-Net: A Dual-Branch Multiattention Network for Polyp Segmentation
    Zhai, Chenxu
    Yang, Lei
    Liu, Yanhong
    Yu, Hongnian
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 16
  • [28] MDTrans: Multi-scale and dual-branch feature fusion network based on Swin Transformer for building extraction in remote sensing images
    Diao, Kuo
    Zhu, Jinlong
    Liu, Guangjie
    Li, Meng
    IET IMAGE PROCESSING, 2024, 18 (11) : 2930 - 2942
  • [29] DBMA-Net: A Dual-Branch Multiattention Network for Polyp Segmentation
    Zhai, Chenxu
    Yang, Lei
    Liu, Yanhong
    Yu, Hongnian
    IEEE Transactions on Instrumentation and Measurement, 2024, 73 : 1 - 16
  • [30] Y-Net: Dual-branch Joint Network for Semantic Segmentation
    Chen, Yizhen
    Hu, Haifeng
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2021, 17 (04)