Revisiting face forgery detection towards generalization

被引:0
|
作者
Peng, Chunlei [1 ]
Chen, Tao [1 ]
Liu, Decheng [1 ]
Guo, Huiqing [1 ]
Wang, Nannan [1 ]
Gao, Xinbo [2 ]
机构
[1] Xidian Univ, Xian 710071, Shaanxi, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Chongqing 400065, Peoples R China
基金
中国国家自然科学基金;
关键词
Face forgery detection; Generalization ability; Cross dataset evaluation; Damaged image; Literature survey;
D O I
10.1016/j.neunet.2025.107310
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face forgery detection aims to distinguish AI generated fake faces with real faces. With the rapid development of face forgery creation algorithms, a large number of generative models have been proposed, which gradually reduce the local distortion phenomenon or the specific frequency traces in these models. At the same time, in the process of face data compression and transmission, distortion phenomenon and specific frequency cues could be eliminated, which brings severe challenges to the performance and generalization ability of face forgery detection. To promote the progress on face forgery detection research towards generalization, we present the first comprehensive overview and in-depth analysis of the generalizable face forgery detection methods. We categorize the target of generalizable face forgery detection into the robustness on novel and unknown forged images, and robustness on damaged low-quality images. We discuss representative generalization strategies including the aspects of data augmentation, multi-source learning, fingerprints detection, feature enhancement, temporal analysis, vision-language detection. We summarize the widely used datasets and the generalization performance of state-of-the-art methods in terms of robustness to novel unknown forgery as well as damaged quality forgery types. Finally, we discuss under-investigated open issues on face forgery detection towards generalization in six directions, including building a new generation of datasets, extracting strong forgery cues, considering identity features in face forgery detection, security and fairness of forgery detectors, the potential of large models in forgery detection and test-time adaptation. Our revisit of face forgery detection towards generalization will help promote the research and application of face forgery detection on real-world unconstrained conditions in the future.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] On the Generalization of Face Forgery Detection with Domain Adversarial Learning
    Weng Z.
    Chen J.
    Jiang Y.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (07): : 1476 - 1489
  • [2] Improving Generalization by Commonality Learning in Face Forgery Detection
    Yu, Peipeng
    Fei, Jianwei
    Xia, Zhihua
    Zhou, Zhili
    Weng, Jian
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 547 - 558
  • [3] Improving the generalization of face forgery detection via single domain augmentation
    Li, Wenlong
    Feng, Chunhui
    Wei, Lifang
    Wu, Dawei
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (23) : 63975 - 63992
  • [4] Learning Face Forgery Detection in Unseen Domain with Generalization Deepfake Detector
    Tran, Van-Nhan
    Lee, Suk-Hwan
    Le, Hoanh-Su
    Kim, Bo-Sung
    Kwon, Ki-Ryong
    2023 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, ICCE, 2023,
  • [5] Towards generalizable face forgery detection via mitigating spurious correlation
    Bai, Ningning
    Wang, Xiaofeng
    Han, Ruidong
    Hou, Jianpeng
    Wang, Qin
    Pang, Shanmin
    NEURAL NETWORKS, 2025, 182
  • [6] Learning to Discover Forgery Cues for Face Forgery Detection
    Tian, Jiahe
    Chen, Peng
    Yu, Cai
    Fu, Xiaomeng
    Wang, Xi
    Dai, Jiao
    Han, Jizhong
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 3814 - 3828
  • [7] Generalization of Forgery Detection With Meta Deepfake Detection Model
    Tran, Van-Nhan
    Kwon, Seong-Geun
    Lee, Suk-Hwan
    Le, Hoanh-Su
    Kwon, Ki-Ryong
    IEEE ACCESS, 2023, 11 : 535 - 546
  • [8] Towards generalized face forgery detection with domain-robust representation learning
    Li, Caiyu
    Wo, Yan
    DIGITAL SIGNAL PROCESSING, 2025, 156
  • [9] Face Forgery Detection Combined with Deep Forgery Features Comparison
    Li, Zhaowei
    Gao, Xinjian
    Da, Zikai
    Gao, Jun
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2024, 37 (09): : 786 - 797
  • [10] Self-Information Forgery Mining for Face Forgery Detection
    Wang X.
    Wei J.
    Applied Mathematics and Nonlinear Sciences, 2024, 9 (01)