MDCF-Net: Multi-Scale Dual-Branch Network for Compressed Face Forgery Detection

被引:0
|
作者
Zhou, Jiting [1 ]
Zhao, Xinrui [1 ]
Xu, Qian [1 ]
Zhang, Pu [1 ]
Zhou, Zhihao [1 ]
机构
[1] Shanghai Univ, Shanghai Film Acad, Shanghai 200072, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Feature extraction; Frequency-domain analysis; Face recognition; Forgery; Transformers; Deepfakes; Image coding; Face forgery; deepfake detection; transformers; frequency domain; two-branch; feature fusion; FEATURE FUSION;
D O I
10.1109/ACCESS.2024.3390217
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Face forgery detection aims to identify manipulated or altered facial images or videos created using artificial intelligence. Existing detection methods exhibit favorable performance on high-quality videos, but the videos in daily applications are commonly compressed into low-quality formats via social media. The detection difficulty is increased by the poor quality, indistinct detail features, and noises such as artifacts in these images or videos. To address this challenge, we propose a multi-scale dual-branch network for compressed face forgery, called MDCF-Net, effectively capturing cross-domain forgery features at various scales in compressed facial images. The MDCF-Net comprises two branches: an RGB domain branch utilizing Transformers to extract multi-scale fine-texture features from the original RGB images; a frequency domain branch designed to capture artifacts in low-quality videos by extracting global spectral features as a supplementary measure. Then, we introduce a feature fusion module (FFM) based on multi-head attention to merge diverse feature representations in a spatial-frequency complementary manner. Extensive comparative experiments on public datasets such as FaceForensics++, Celeb-DF, and WildDeepfake demonstrate the significant advantage of MDCF-Net in detecting highly compressed and low-quality forged images or videos, especially in achieving state-of-the-art performance on the FaceForensics++ low-quality dataset. Our approach presents a new perspective and technology for low-quality face forgery detection.
引用
下载
收藏
页码:58740 / 58749
页数:10
相关论文
共 50 条
  • [31] A Multi-Scale Fusion Convolutional Neural Network for Face Detection
    Chen, Qiaosong
    Meng, Xiaomin
    Li, Wen
    Fu, Xingyu
    Deng, Xin
    Wang, Jin
    2017 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2017, : 1013 - 1018
  • [32] Multi-scale Face Detection Based on Single Neural Network
    Liu Hongzhe
    Yang Shaopeng
    Yuan Jiazheng
    Wang Xuecliao
    Xue Jianming
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2018, 40 (11) : 2598 - 2605
  • [33] Multi-Scale Fully Convolutional Network for Face Detection in the Wild
    Bai, Yancheng
    Ghanem, Bernard
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 2078 - 2087
  • [34] Multi-scale face detection based on convolutional neural network
    Luo, Mingzhu
    Xiao, Yewei
    Zhou, Yan
    2018 CHINESE AUTOMATION CONGRESS (CAC), 2018, : 1752 - 1757
  • [35] Dual-branch Pattern and Multi-scale Context Facilitate Cross-view Geo-localization
    Zhang, Bing
    Sun, Jing
    Yan, Rui
    Sun, Fuming
    Wang, Fasheng
    PROCEEDINGS OF THE 2023 WORKSHOP ON UAVS IN MULTIMEDIA: CAPTURING THE WORLD FROM A NEW PERSPECTIVE, UAVM 2023, 2023, : 25 - 29
  • [36] A dual-branch joint learning network for underwater object detection
    Wang, Bowen
    Wang, Zhi
    Guo, Wenhui
    Wang, Yanjiang
    KNOWLEDGE-BASED SYSTEMS, 2024, 293
  • [37] Dual-branch network for change detection of remote sensing image
    Ma, Chong
    Weng, Liguo
    Xia, Min
    Lin, Haifeng
    Qian, Ming
    Zhang, Yonghong
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [38] A multimodal dual-branch fusion network for fetal hypoxia detection
    Liu, Mujun
    Xiao, Yahui
    Zeng, Rongdan
    Wu, Zhe
    Liu, Yu
    Li, Hongfei
    Expert Systems with Applications, 2025, 259
  • [39] Color-Guided Depth Map Super-Resolution Using a Dual-Branch Multi-Scale Residual Network with Channel Interaction
    Chen, Ruijin
    Gao, Wei
    SENSORS, 2020, 20 (06)
  • [40] Dual-branch mutual assistance network for salient object detection
    Yao, Zhaojian
    Wang, Luping
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (01) : 972 - 990