Towards generalized face forgery detection with domain-robust representation learning

被引:0
|
作者
Li, Caiyu [1 ]
Wo, Yan [1 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Peoples R China
关键词
Generalized face forgery detection; Domain-robust; Style augmentation; Feature disentanglement; NETWORKS;
D O I
10.1016/j.dsp.2024.104792
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Face forgery detection is crucial for the security of digital identities. However, existing methods often struggle to generalize effectively to unseen domains due to the domain shift between training and testing data. We propose a Domain-robust Representation Learning (DRRL) method for generalized face forgery detection. Specifically, we observe that domain shifts in face forgery detection tasks are often caused by forgery differences and content differences between domain data, while the limitations of training data lead the model to overfit to these feature expressions in the seen domain. Therefore, DRRL enhances the model's generalization to unseen domains by first adding representative data representations to mitigate overfitting to seen data and then removing the features of expressed domain information to learn a robust, discriminative representation of domain variation. Data augmentation is achieved by stylizing sample representations and exploring representative new styles to generate rich data variants, with the Content-style Augmentation (CSA) module and Forgery-style Augmentation (FSA) module implemented for content and forgery expression, respectively. Based on this, the Content Decorrelation (CTD) module and Sensitive Channels Drop (SCD) module are used to remove content features irrelevant to forgery and domain-sensitive forgery features, encouraging the model to focus on clean and robust forgery features, thereby achieving the goal of learning domain-robust representations. Extensive experiments on five large-scale datasets demonstrate that our method exhibits advanced and stable generalization performance in practical scenarios.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Modal-Guided Multi-Domain Inconsistency Learning for Face Forgery Detection
    Guo, Zishuo
    Zhang, Baopeng
    Fan, Jack
    Teng, Zhu
    Fan, Jianping
    APPLIED SCIENCES-BASEL, 2025, 15 (01):
  • [22] Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain
    Liu, Honggu
    Li, Xiaodan
    Zhou, Wenbo
    Chen, Yuefeng
    He, Yuan
    Xue, Hui
    Zhang, Weiming
    Yu, Nenghai
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 772 - 781
  • [23] Hybrid Domain Meta-Learning Network for Face Forgery Detection and Localization in Deepfakes
    Zhao, Hongjie
    Liu, Beibei
    Hu, Yongjian
    Li, Jicheng
    Li, Chang-Tsun
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [24] Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detection
    Liu, Decheng
    Chen, Tao
    Peng, Chunlei
    Wang, Nannan
    Hu, Ruimin
    Gao, Xinbo
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2025, 20 : 504 - 515
  • [25] Attention-guided Fine-grained Feature Learning For Robust Face Forgery Detection
    Zhu, Yizhe
    Gao, Jialin
    Liu, Qiong
    Zhou, Xi
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 1222 - 1228
  • [26] A dual descriptor combined with frequency domain reconstruction learning for face forgery detection in deepfake videos
    Jin, Xin
    Wu, Nan
    Jiang, Qian
    Kou, Yuru
    Duan, Hanxian
    Wang, Puming
    Yao, Shaowen
    FORENSIC SCIENCE INTERNATIONAL-DIGITAL INVESTIGATION, 2024, 49
  • [27] Deep learning technology for face forgery detection: A survey
    Ma, Lixia
    Yang, Puning
    Xu, Yuting
    Yang, Ziming
    Li, Peipei
    Huang, Huaibo
    NEUROCOMPUTING, 2025, 618
  • [28] Improving Generalization by Commonality Learning in Face Forgery Detection
    Yu, Peipeng
    Fei, Jianwei
    Xia, Zhihua
    Zhou, Zhili
    Weng, Jian
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 547 - 558
  • [29] A Temporal Consistency Learning Framework for Face Forgery Detection
    Wang, Xiaopeng
    Zhu, Feng
    Li, Lei
    Tan, Xiaoyang
    ADVANCES IN NEURAL NETWORKS-ISNN 2024, 2024, 14827 : 225 - 234
  • [30] Unknown Aware Feature Learning for Face Forgery Detection
    Shi, Liang
    Zhang, Jie
    Liang, Chenyue
    Shan, Shiguang
    2021 16TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2021), 2021,