Learning spatial-frequency interaction for generalizable deepfake detection

被引:0
|
作者
Zhai, Tianbo [1 ]
Lu, Kaiyin [1 ]
Li, Jiajun [1 ]
Wang, Yukai [1 ]
Zhang, Wenjie [2 ]
Yu, Peipeng [1 ]
Xia, Zhihua [1 ]
机构
[1] Jinan Univ, Coll Cyber Secur, Engn Res Ctr Trustworthy AI, Minist Educ, Guangzhou 510632, Peoples R China
[2] Ningbo Univ, Coll Informat Sci & Engn, Ningbo, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
face recognition; image classification; image forensics; image processing; IMAGE FORGERY LOCALIZATION;
D O I
10.1049/ipr2.13276
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, face forgery detection has gained significant attention, resulting in considerable advancements. However, most existing methods rely on CNNs to extract artefacts from the spatial domain, overlooking the pervasive frequency-domain artefacts present in deepfake content, which poses challenges in achieving robust and generalized detection. To address these issues, we propose the dual-stream frequency-spatial fusion network is proposed for deepfake detection. The dual-stream frequency-spatial fusion network consists of three components: the spatial forgery feature extraction module, the frequency forgery feature extraction module, and the spatial-frequency feature fusion module. The spatial forgery feature extraction module employs spatial-channel attention to extract spatial domain features, targeting artefacts in the spatial domain. The frequency forgery feature extraction module leverages the focused linear attention to detect frequency domain anomalies in internal regions, enabling the identification of generated content. The spatial-frequency feature fusion module then fuses forgery features extracted from both the spatial and frequency domains, facilitating accurate detection of splicing artefacts and internally generated forgeries. This approach enhances the model's ability to more accurately capture forgery characteristics. Extensive experiments on several widely-used benchmarks demonstrate that our carefully designed network exhibits superior generalization and robustness, significantly improving deepfake detection performance.
引用
收藏
页码:4666 / 4679
页数:14
相关论文
共 50 条
  • [1] Learning Pairwise Interaction for Generalizable DeepFake Detection
    Xu, Ying
    Raja, Kiran
    Verdoliva, Luisa
    Pedersen, Marius
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW), 2023, : 672 - 682
  • [2] Deepfake Detection Based on the Adaptive Fusion of Spatial-Frequency Features
    Wang, Fei
    Chen, Qile
    Jing, Botao
    Tang, Yeling
    Song, Zengren
    Wang, Bo
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2024, 2024
  • [3] Spatial-Frequency Dual-Stream Reconstruction for Deepfake Detection
    Peng, Chunlei
    Chen, Tao
    Liu, Decheng
    Zheng, Yu
    Wang, Nannan
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT XI, 2025, 15041 : 473 - 487
  • [4] Dynamic Graph Learning with Content-guided Spatial-Frequency Relation Reasoning for Deepfake Detection
    Wang, Yuan
    Yu, Kun
    Chen, Chen
    Hu, Xiyuan
    Peng, Silong
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 7278 - 7287
  • [5] Spatial-frequency feature fusion based deepfake detection through knowledge distillation
    Wang, Bo
    Wu, Xiaohan
    Wang, Fei
    Zhang, Yushu
    Wei, Fei
    Song, Zengren
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
  • [6] MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning
    Guan, Lei
    Liu, Fan
    Zhang, Ru
    Liu, Jianyi
    Tang, Yifan
    SENSORS, 2023, 23 (21)
  • [7] SUPRATHRESHOLD SPATIAL-FREQUENCY DETECTION AND BINOCULAR INTERACTION IN STRABISMIC AND ANISOMETROPIC AMBLYOPIA
    LEVI, DM
    HARWERTH, RS
    MANNY, RE
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 1979, 18 (07) : 714 - 725
  • [8] Refining Localized Attention Features with Multi-Scale Relationships for Enhanced Deepfake Detection in Spatial-Frequency Domain
    Gao, Yuan
    Zhang, Yu
    Zeng, Ping
    Ma, Yingjie
    ELECTRONICS, 2024, 13 (09)
  • [9] SPATIAL-FREQUENCY SELECTIVITY IN CONTRAST DETECTION
    QUICK, RF
    REICHERT, TA
    VISION RESEARCH, 1975, 15 (06) : 637 - 643
  • [10] Test-time Forgery Detection with Spatial-Frequency Prompt Learning
    Duan, Junxian
    Ai, Yuang
    Liu, Jipeng
    Huang, Shenyuan
    Huang, Huaibo
    Cao, Jie
    He, Ran
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025, 133 (02) : 672 - 687