Towards generalized face forgery detection with domain-robust representation learning

被引:0
|
作者
Li, Caiyu [1 ]
Wo, Yan [1 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Peoples R China
关键词
Generalized face forgery detection; Domain-robust; Style augmentation; Feature disentanglement; NETWORKS;
D O I
10.1016/j.dsp.2024.104792
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Face forgery detection is crucial for the security of digital identities. However, existing methods often struggle to generalize effectively to unseen domains due to the domain shift between training and testing data. We propose a Domain-robust Representation Learning (DRRL) method for generalized face forgery detection. Specifically, we observe that domain shifts in face forgery detection tasks are often caused by forgery differences and content differences between domain data, while the limitations of training data lead the model to overfit to these feature expressions in the seen domain. Therefore, DRRL enhances the model's generalization to unseen domains by first adding representative data representations to mitigate overfitting to seen data and then removing the features of expressed domain information to learn a robust, discriminative representation of domain variation. Data augmentation is achieved by stylizing sample representations and exploring representative new styles to generate rich data variants, with the Content-style Augmentation (CSA) module and Forgery-style Augmentation (FSA) module implemented for content and forgery expression, respectively. Based on this, the Content Decorrelation (CTD) module and Sensitive Channels Drop (SCD) module are used to remove content features irrelevant to forgery and domain-sensitive forgery features, encouraging the model to focus on clean and robust forgery features, thereby achieving the goal of learning domain-robust representations. Extensive experiments on five large-scale datasets demonstrate that our method exhibits advanced and stable generalization performance in practical scenarios.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Learning domain-invariant representation for generalizing face forgery detection
    Wu, Yuanlu
    Wo, Yan
    Li, Caiyu
    Han, Guoqiang
    COMPUTERS & SECURITY, 2023, 130
  • [2] Learning Convolutional Domain-Robust Representations for Cross-View Face Recognition
    Chen, Xue
    Wang, Chunheng
    Xiao, Baihua
    Gao, Song
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2014, E97D (12): : 3239 - 3243
  • [3] CORE: Consistent Representation Learning for Face Forgery Detection
    Ni, Yunsheng
    Meng, Depu
    Yu, Changqian
    Quan, Chengbin
    Ren, Dongchun
    Zhao, Youjian
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 12 - 21
  • [4] On the Generalization of Face Forgery Detection with Domain Adversarial Learning
    Weng Z.
    Chen J.
    Jiang Y.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (07): : 1476 - 1489
  • [5] Domain General Face Forgery Detection by Learning to Weight
    Sun, Ke
    Liu, Hong
    Ye, Qixiang
    Gao, Yue
    Liu, Jianzhuang
    Shao, Ling
    Ji, Rongrong
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2638 - 2646
  • [6] Domain General Face Forgery Detection by Learning to Weight
    Sun, Ke
    Liu, Hong
    Ye, Qixiang
    Gao, Yue
    Liu, Jianzhuang
    Shao, Ling
    Ji, Rongrong
    35th AAAI Conference on Artificial Intelligence, AAAI 2021, 2021, 3B : 2638 - 2646
  • [7] Learning Natural Consistency Representation for Face Forgery Video Detection
    Zhang, Daichi
    Xiao, Zihao
    Li, Shikun
    Lin, Fanzhao
    Li, Jianmin
    Ge, Shiming
    COMPUTER VISION - ECCV 2024, PT LXXXIII, 2025, 15141 : 407 - 424
  • [8] FedForgery: Generalized Face Forgery Detection With Residual Federated Learning
    Liu, Decheng
    Dang, Zhan
    Peng, Chunlei
    Zheng, Yu
    Li, Shuang
    Wang, Nannan
    Gao, Xinbo
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 : 4272 - 4284
  • [9] Narrowing Domain Gaps With Bridging Samples for Generalized Face Forgery Detection
    Yu, Yang
    Ni, Rongrong
    Yang, Siyuan
    Zhao, Yao
    Kot, Alex C.
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 3405 - 3417
  • [10] Domain-Robust Mitotic Figure Detection with Style Transfer
    Chung, Youjin
    Cho, Jihoon
    Park, Jinah
    BIOMEDICAL IMAGE REGISTRATION, DOMAIN GENERALISATION AND OUT-OF-DISTRIBUTION ANALYSIS, 2022, 13166 : 23 - 31