DeepFake detection method based on multi-scale interactive dual-stream network

被引:0
|
作者
Cheng, Ziyuan [1 ]
Wang, Yiyang [1 ]
Wan, Yongjing [1 ]
Jiang, Cuiling [1 ]
机构
[1] East China Univ Sci & Technol, Sch Informat Sci & Engn, Shanghai 200237, Peoples R China
关键词
DeepFake detection; Multi-scale fusion; Interactive dual-stream; High-frequency noise; MANIPULATION;
D O I
10.1016/j.jvcir.2024.104263
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
DeepFake face forgery has a serious negative impact on both society and individuals. Therefore, research on DeepFake detection technologies is necessary. At present, DeepFake detection technology based on deep learning has achieved acceptable results on high-quality datasets; however, its detection performance on low-quality datasets and cross-datasets remains poor. To address this problem, this paper presents a multi-scale interactive dual-stream network (MSIDSnet). The network is divided into spatial- and frequency-domain streams and uses a multi-scale fusion module to capture both the facial features of images that have been manipulated in the spatial domain under different circumstances and the fine-grained high-frequency noise information of forged images. The network fully integrates the features of the spatial- and frequency-domain streams through an interactive dual-stream module and uses vision transformer (ViT) to further learn the global information of the forged facial features for classification. Experimental results confirm that the accuracy of this method reached 99.30 % on the high-quality dataset Celeb-DF-v2, and 95.51 % on the low-quality dataset FaceForensics++. Moreover, the results of the cross-dataset experiments were superior to those of the other comparison methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] DIRECT MULTI-SCALE DUAL-STREAM NETWORK FOR PEDESTRIAN DETECTION
    Jung, Sang-Il
    Hong, Ki-Sang
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 156 - 160
  • [2] A New Deepfake Detection Method Based on Compound Scaling Dual-Stream Attention Network
    Wang, Shuya
    Du, Chenjun
    Chen, Yunfang
    EAI Endorsed Transactions on Pervasive Health and Technology, 2024, 10
  • [3] MFDANet: Multi-Scale Feature Dual-Stream Aggregation Network for Salient Object Detection
    Ge, Bin
    Pei, Jiajia
    Xia, Chenxing
    Wu, Taolin
    ELECTRONICS, 2023, 12 (13)
  • [4] Face spoofing detection based on multi-scale color inversion dual-stream convolutional neural network
    Shu, Xin
    Li, Xiaojie
    Zuo, Xin
    Xu, Dan
    Shi, Jinlong
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 224
  • [5] Multi-Scale Enhanced Dual-Stream Network for Facial Attribute Editing Localization
    Huang, Jinkun
    Luo, Weiqi
    Huang, Wenmin
    Xi, Ziyi
    Wei, Kangkang
    Huang, Jiwu
    DIGITAL FORENSICS AND WATERMARKING, IWDW 2023, 2024, 14511 : 151 - 165
  • [6] Joint dual-stream interaction and multi-scale feature extraction network for multi-spectral pedestrian detection
    Hu, Wenjun
    Fu, Chenglong
    Cao, Runlong
    Zang, Ying
    Wu, Xiao-Jun
    Shen, Shigen
    Gao, Xiao-Zhi
    APPLIED SOFT COMPUTING, 2023, 147
  • [7] Dual-Stream Fusion and Multi-scale Analysis: Introducing the Synergistic Dual-Stream Network (SDS-Net) for Image Manipulation Segmentation
    Song, Huaqing
    Lin, Baichuan
    Xie, Lanchi
    ADVANCED INTELLIGENT SYSTEMS, 2024, 6 (04)
  • [8] Hyperspectral unmixing algorithm based on channel multi-scale dual-stream autoencode
    Gan, Yuquan
    Wang, Yong
    Yi, Chen
    Wang, Quan
    Zhang, Ji
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2025,
  • [9] Spatial-Frequency Dual-Stream Reconstruction for Deepfake Detection
    Peng, Chunlei
    Chen, Tao
    Liu, Decheng
    Zheng, Yu
    Wang, Nannan
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT XI, 2025, 15041 : 473 - 487
  • [10] Fire detection method based on spatio-temporal dual-stream network
    Fang, Qiansheng
    Zhang, Liang
    Yan, Pu
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (01)