DeepFake detection method based on multi-scale interactive dual-stream network

被引:0
|
作者
Cheng, Ziyuan [1 ]
Wang, Yiyang [1 ]
Wan, Yongjing [1 ]
Jiang, Cuiling [1 ]
机构
[1] East China Univ Sci & Technol, Sch Informat Sci & Engn, Shanghai 200237, Peoples R China
关键词
DeepFake detection; Multi-scale fusion; Interactive dual-stream; High-frequency noise; MANIPULATION;
D O I
10.1016/j.jvcir.2024.104263
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
DeepFake face forgery has a serious negative impact on both society and individuals. Therefore, research on DeepFake detection technologies is necessary. At present, DeepFake detection technology based on deep learning has achieved acceptable results on high-quality datasets; however, its detection performance on low-quality datasets and cross-datasets remains poor. To address this problem, this paper presents a multi-scale interactive dual-stream network (MSIDSnet). The network is divided into spatial- and frequency-domain streams and uses a multi-scale fusion module to capture both the facial features of images that have been manipulated in the spatial domain under different circumstances and the fine-grained high-frequency noise information of forged images. The network fully integrates the features of the spatial- and frequency-domain streams through an interactive dual-stream module and uses vision transformer (ViT) to further learn the global information of the forged facial features for classification. Experimental results confirm that the accuracy of this method reached 99.30 % on the high-quality dataset Celeb-DF-v2, and 95.51 % on the low-quality dataset FaceForensics++. Moreover, the results of the cross-dataset experiments were superior to those of the other comparison methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Network traffic anomaly detection method based on multi-scale characteristic
    Duan, Xueyuan
    Fu, Yu
    Wang, Kun
    Liu, Taotao
    Li, Bin
    Tongxin Xuebao/Journal on Communications, 2022, 43 (10): : 65 - 76
  • [32] Construction Vehicle Detection Method Based on Multi-Scale Residual Network
    Liu, Liangshuai
    Chen, Ze
    She, Kai
    Ji, Yanpeng
    Feng, Haiyan
    Ni, Yong
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 1399 - 1405
  • [33] Enhanced salient object detection in remote sensing images via dual-stream semantic interactive network
    Ge, Yanliang
    Liang, Taichuan
    Ren, Junchao
    Chen, Jiaxue
    Bi, Hongbo
    Visual Computer, 2024,
  • [34] Semantic Compensation Based Dual-Stream Feature Interaction Network for Multi-oriented Scene Text Detection
    Wang, Siyan
    Li, Sumei
    2022 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2022,
  • [35] Noise-aware progressive multi-scale deepfake detection
    Ding X.
    Pang S.
    Guo W.
    Multimedia Tools and Applications, 2024, 83 (36) : 83677 - 83693
  • [36] A dual-stream fused neural network for fall detection in multi-camera and 360° videos
    Saurav, Sumeet
    Saini, Ravi
    Singh, Sanjay
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (02): : 1455 - 1482
  • [37] Dual-stream Network for Visual Recognition
    Mao, Mingyuan
    Gao, Peng
    Zhang, Renrui
    Zheng, Honghui
    Ma, Teli
    Peng, Yan
    Ding, Errui
    Zhang, Baochang
    Han, Shumin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [38] Building Change Detection Based on Dual-Stream Parallel Omnidirectional Scan Mamba Network
    Li, Fangting
    Zhang, Guo
    Zhou, Fangdong
    Wang, Shang
    Liang, Si
    Li, Zhiwei
    Wuhan Daxue Xuebao (Xinxi Kexue Ban)/Geomatics and Information Science of Wuhan University, 2024, 49 (09): : 1574 - 1585
  • [39] A Network Intrusion Detection Method Based on Deep Multi-scale Convolutional Neural Network
    Wang, Xiaowei
    Yin, Shoulin
    Li, Hang
    Wang, Jiachi
    Teng, Lin
    INTERNATIONAL JOURNAL OF WIRELESS INFORMATION NETWORKS, 2020, 27 (04) : 503 - 517
  • [40] A Network Intrusion Detection Method Based on Deep Multi-scale Convolutional Neural Network
    Xiaowei Wang
    Shoulin Yin
    Hang Li
    Jiachi Wang
    Lin Teng
    International Journal of Wireless Information Networks, 2020, 27 : 503 - 517