Revisiting face forgery detection towards generalization

被引:0
|
作者
Peng, Chunlei [1 ]
Chen, Tao [1 ]
Liu, Decheng [1 ]
Guo, Huiqing [1 ]
Wang, Nannan [1 ]
Gao, Xinbo [2 ]
机构
[1] Xidian Univ, Xian 710071, Shaanxi, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Chongqing 400065, Peoples R China
基金
中国国家自然科学基金;
关键词
Face forgery detection; Generalization ability; Cross dataset evaluation; Damaged image; Literature survey;
D O I
10.1016/j.neunet.2025.107310
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face forgery detection aims to distinguish AI generated fake faces with real faces. With the rapid development of face forgery creation algorithms, a large number of generative models have been proposed, which gradually reduce the local distortion phenomenon or the specific frequency traces in these models. At the same time, in the process of face data compression and transmission, distortion phenomenon and specific frequency cues could be eliminated, which brings severe challenges to the performance and generalization ability of face forgery detection. To promote the progress on face forgery detection research towards generalization, we present the first comprehensive overview and in-depth analysis of the generalizable face forgery detection methods. We categorize the target of generalizable face forgery detection into the robustness on novel and unknown forged images, and robustness on damaged low-quality images. We discuss representative generalization strategies including the aspects of data augmentation, multi-source learning, fingerprints detection, feature enhancement, temporal analysis, vision-language detection. We summarize the widely used datasets and the generalization performance of state-of-the-art methods in terms of robustness to novel unknown forgery as well as damaged quality forgery types. Finally, we discuss under-investigated open issues on face forgery detection towards generalization in six directions, including building a new generation of datasets, extracting strong forgery cues, considering identity features in face forgery detection, security and fairness of forgery detectors, the potential of large models in forgery detection and test-time adaptation. Our revisit of face forgery detection towards generalization will help promote the research and application of face forgery detection on real-world unconstrained conditions in the future.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detection
    Liu, Decheng
    Chen, Tao
    Peng, Chunlei
    Wang, Nannan
    Hu, Ruimin
    Gao, Xinbo
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2025, 20 : 504 - 515
  • [32] Attentional Local Contrastive Learning for Face Forgery Detection
    Dai, Yunshu
    Fei, Jianwei
    Wang, Huaming
    Xia, Zhihua
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT I, 2022, 13529 : 709 - 721
  • [33] Learning dual aggregate features for face forgery detection
    Yuru Kou
    Qian Jiang
    Jun Zhang
    Xin Jin
    Ping Wei
    Shengfa Miao
    Xing Chu
    Neural Computing and Applications, 2025, 37 (4) : 1783 - 1795
  • [34] Exploring Frequency Adversarial Attacks for Face Forgery Detection
    Jia, Shuai
    Ma, Chao
    Yao, Taiping
    Yin, Bangjie
    Ding, Shouhong
    Yang, Xiaokang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 4093 - 4102
  • [35] Face forgery detection with cross-level attention
    Liu, Yaju
    Fei, Jianwei
    Yu, Peipeng
    Yuan, Chengsheng
    Liang, Haopeng
    INTERNATIONAL JOURNAL OF AUTONOMOUS AND ADAPTIVE COMMUNICATIONS SYSTEMS, 2024, 17 (03) : 233 - 246
  • [36] Exploring Disentangled Content Information for Face Forgery Detection
    Liang, Jiahao
    Shi, Huafeng
    Deng, Weihong
    COMPUTER VISION - ECCV 2022, PT XIV, 2022, 13674 : 128 - 145
  • [37] Generalizing Face Forgery Detection via Uncertainty Learning
    Wu, Yanqi
    Song, Xue
    Chen, Jingjing
    Jiang, Yu-Gang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1759 - 1767
  • [38] Domain General Face Forgery Detection by Learning to Weight
    Sun, Ke
    Liu, Hong
    Ye, Qixiang
    Gao, Yue
    Liu, Jianzhuang
    Shao, Ling
    Ji, Rongrong
    35th AAAI Conference on Artificial Intelligence, AAAI 2021, 2021, 3B : 2638 - 2646
  • [39] A Dual Domain Attention Mechanism for Face Forgery Detection
    Suo, Yucong
    Zhao, Xiaohan
    Guo, Yuanfang
    Li, Yangxi
    Wang, Yunhong
    2023 IEEE INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS, IJCB, 2023,
  • [40] Dual Contrastive Learning for General Face Forgery Detection
    Sun, Ke
    Yao, Taiping
    Chen, Shen
    Ding, Shouhong
    Li, Jilin
    Ji, Rongrong
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 2316 - 2324