Towards generalized face forgery detection with domain-robust representation learning

被引:0
|
作者
Li, Caiyu [1 ]
Wo, Yan [1 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Peoples R China
关键词
Generalized face forgery detection; Domain-robust; Style augmentation; Feature disentanglement; NETWORKS;
D O I
10.1016/j.dsp.2024.104792
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Face forgery detection is crucial for the security of digital identities. However, existing methods often struggle to generalize effectively to unseen domains due to the domain shift between training and testing data. We propose a Domain-robust Representation Learning (DRRL) method for generalized face forgery detection. Specifically, we observe that domain shifts in face forgery detection tasks are often caused by forgery differences and content differences between domain data, while the limitations of training data lead the model to overfit to these feature expressions in the seen domain. Therefore, DRRL enhances the model's generalization to unseen domains by first adding representative data representations to mitigate overfitting to seen data and then removing the features of expressed domain information to learn a robust, discriminative representation of domain variation. Data augmentation is achieved by stylizing sample representations and exploring representative new styles to generate rich data variants, with the Content-style Augmentation (CSA) module and Forgery-style Augmentation (FSA) module implemented for content and forgery expression, respectively. Based on this, the Content Decorrelation (CTD) module and Sensitive Channels Drop (SCD) module are used to remove content features irrelevant to forgery and domain-sensitive forgery features, encouraging the model to focus on clean and robust forgery features, thereby achieving the goal of learning domain-robust representations. Extensive experiments on five large-scale datasets demonstrate that our method exhibits advanced and stable generalization performance in practical scenarios.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Attentional Local Contrastive Learning for Face Forgery Detection
    Dai, Yunshu
    Fei, Jianwei
    Wang, Huaming
    Xia, Zhihua
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT I, 2022, 13529 : 709 - 721
  • [32] Learning dual aggregate features for face forgery detection
    Yuru Kou
    Qian Jiang
    Jun Zhang
    Xin Jin
    Ping Wei
    Shengfa Miao
    Xing Chu
    Neural Computing and Applications, 2025, 37 (4) : 1783 - 1795
  • [33] Generalizing Face Forgery Detection via Uncertainty Learning
    Wu, Yanqi
    Song, Xue
    Chen, Jingjing
    Jiang, Yu-Gang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1759 - 1767
  • [34] Dual Contrastive Learning for General Face Forgery Detection
    Sun, Ke
    Yao, Taiping
    Chen, Shen
    Ding, Shouhong
    Li, Jilin
    Ji, Rongrong
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 2316 - 2324
  • [35] Learning Local Reconstruction Errors for Face Forgery Detection
    Wu, Haoyu
    Leng, Lingyun
    Yu, Peipeng
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (11) : 1220 - 1227
  • [36] TOWARDS GENERALIZABLE DEEPFAKE FACE FORGERY DETECTION WITH SEMI-SUPERVISED LEARNING AND KNOWLEDGE DISTILLATION
    Lin, Yuzhen
    Chen, Han
    Li, Bin
    Wu, Junqiang
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 576 - 580
  • [37] Exploiting optimized forgery representation space for general fake face detection
    Yang, Gaoming
    Zuo, Bang
    Fang, Xianjin
    Zhang, Ji
    PATTERN ANALYSIS AND APPLICATIONS, 2025, 28 (01)
  • [38] Exploring Frequency Attention Learning and Contrastive Learning for Face Forgery Detection
    Fang, Neng
    Xiao, Bo
    Wang, Bo
    Li, Chong
    Zhou, Lanxiang
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT V, 2024, 14429 : 238 - 251
  • [39] Towards generalizable detection of face forgery via self-guided model-agnostic learning
    Yang, Xiao
    Liu, Shilong
    Dong, Yinpeng
    Su, Hang
    Zhang, Lei
    Zhu, Jun
    PATTERN RECOGNITION LETTERS, 2022, 160 : 98 - 104
  • [40] Improving the generalization of face forgery detection via single domain augmentation
    Li, Wenlong
    Feng, Chunhui
    Wei, Lifang
    Wu, Dawei
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (23) : 63975 - 63992