DeepFake detection method based on multi-scale interactive dual-stream network

被引:0
|
作者
Cheng, Ziyuan [1 ]
Wang, Yiyang [1 ]
Wan, Yongjing [1 ]
Jiang, Cuiling [1 ]
机构
[1] East China Univ Sci & Technol, Sch Informat Sci & Engn, Shanghai 200237, Peoples R China
关键词
DeepFake detection; Multi-scale fusion; Interactive dual-stream; High-frequency noise; MANIPULATION;
D O I
10.1016/j.jvcir.2024.104263
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
DeepFake face forgery has a serious negative impact on both society and individuals. Therefore, research on DeepFake detection technologies is necessary. At present, DeepFake detection technology based on deep learning has achieved acceptable results on high-quality datasets; however, its detection performance on low-quality datasets and cross-datasets remains poor. To address this problem, this paper presents a multi-scale interactive dual-stream network (MSIDSnet). The network is divided into spatial- and frequency-domain streams and uses a multi-scale fusion module to capture both the facial features of images that have been manipulated in the spatial domain under different circumstances and the fine-grained high-frequency noise information of forged images. The network fully integrates the features of the spatial- and frequency-domain streams through an interactive dual-stream module and uses vision transformer (ViT) to further learn the global information of the forged facial features for classification. Experimental results confirm that the accuracy of this method reached 99.30 % on the high-quality dataset Celeb-DF-v2, and 95.51 % on the low-quality dataset FaceForensics++. Moreover, the results of the cross-dataset experiments were superior to those of the other comparison methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] ConTrans-Detect: A Multi-Scale Convolution-Transformer Network for DeepFake Video Detection
    Sun, Weirong
    Ma, Yujun
    Zhang, Hong
    Wang, Ruili
    2023 29TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE, M2VIP 2023, 2023,
  • [42] Dual-stream pyramid registration network
    Kang, Miao
    Hu, Xiaojun
    Huang, Weilin
    Scott, Matthew R.
    Reyes, Mauricio
    MEDICAL IMAGE ANALYSIS, 2022, 78
  • [43] Forgery Detection Scheme of Deep Video Frame-rate Up-conversion Based on Dual-stream Multi-scale Spatial-temporal Representation
    Gu, Qing
    Ding, Xiangling
    Zhang, Dengyong
    Yang, Ce
    2022 IEEE INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS, TRUSTCOM, 2022, : 733 - 738
  • [44] Dual-Stream Pyramid Registration Network
    Hu, Xiaojun
    Kang, Miao
    Huang, Weilin
    Scott, Matthew R.
    Wiest, Roland
    Reyes, Mauricio
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 : 382 - 390
  • [45] Forgery Detection Scheme of Deep Video Frame-rate Up-conversion Based on Dual-stream Multi-scale Spatial-temporal Representation
    Gu, Qing
    Ding, Xiangling
    Zhang, Dengyong
    Yang, Ce
    Proceedings - 2022 IEEE 21st International Conference on Trust, Security and Privacy in Computing and Communications, TrustCom 2022, 2022, : 733 - 738
  • [46] Micro-Expression Recognition Method Based on Dual-Stream Network and Fused Differential
    Lu, Shicheng
    Huang, Runcai
    2024 9TH INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING, ICSIP, 2024, : 549 - 553
  • [47] Dual Multi-Scale Dehazing Network
    Zhang, Shengdong
    Zhang, Xiaoqin
    Shen, Linlin
    IEEE ACCESS, 2023, 11 : 84699 - 84708
  • [48] DMU-Net: A Dual-Stream Multi-Scale U-Net Network Using Multi-Dimensional Spatial Information for Urban Building Extraction
    Li, Peihang
    Sun, Zhenhui
    Duan, Guangyao
    Wang, Dongchuan
    Meng, Qingyan
    Sun, Yunxiao
    SENSORS, 2023, 23 (04)
  • [49] Vehicle detection method based on adaptive multi-scale feature fusion network
    Shen, Xuanjing
    Li, Hanyu
    Huang, Yongping
    Wang, Yu
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (04)
  • [50] Network Intrusion Detection Method Based on Multi-Scale CNN in Internet of Things
    Yin, Xiuye
    Chen, Liyong
    MOBILE INFORMATION SYSTEMS, 2022, 2022