Revisiting face forgery detection towards generalization

被引:0
|
作者
Peng, Chunlei [1 ]
Chen, Tao [1 ]
Liu, Decheng [1 ]
Guo, Huiqing [1 ]
Wang, Nannan [1 ]
Gao, Xinbo [2 ]
机构
[1] Xidian Univ, Xian 710071, Shaanxi, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Chongqing 400065, Peoples R China
基金
中国国家自然科学基金;
关键词
Face forgery detection; Generalization ability; Cross dataset evaluation; Damaged image; Literature survey;
D O I
10.1016/j.neunet.2025.107310
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face forgery detection aims to distinguish AI generated fake faces with real faces. With the rapid development of face forgery creation algorithms, a large number of generative models have been proposed, which gradually reduce the local distortion phenomenon or the specific frequency traces in these models. At the same time, in the process of face data compression and transmission, distortion phenomenon and specific frequency cues could be eliminated, which brings severe challenges to the performance and generalization ability of face forgery detection. To promote the progress on face forgery detection research towards generalization, we present the first comprehensive overview and in-depth analysis of the generalizable face forgery detection methods. We categorize the target of generalizable face forgery detection into the robustness on novel and unknown forged images, and robustness on damaged low-quality images. We discuss representative generalization strategies including the aspects of data augmentation, multi-source learning, fingerprints detection, feature enhancement, temporal analysis, vision-language detection. We summarize the widely used datasets and the generalization performance of state-of-the-art methods in terms of robustness to novel unknown forgery as well as damaged quality forgery types. Finally, we discuss under-investigated open issues on face forgery detection towards generalization in six directions, including building a new generation of datasets, extracting strong forgery cues, considering identity features in face forgery detection, security and fairness of forgery detectors, the potential of large models in forgery detection and test-time adaptation. Our revisit of face forgery detection towards generalization will help promote the research and application of face forgery detection on real-world unconstrained conditions in the future.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Face Forgery Detection Based on the Improved Siamese Network
    Wang, Bo
    Li, Yucai
    Wu, Xiaohan
    Ma, Yanyan
    Song, Zengren
    Wu, Mingkan
    SECURITY AND COMMUNICATION NETWORKS, 2022, 2022
  • [22] Towards generalizable detection of face forgery via self-guided model-agnostic learning
    Yang, Xiao
    Liu, Shilong
    Dong, Yinpeng
    Su, Hang
    Zhang, Lei
    Zhu, Jun
    PATTERN RECOGNITION LETTERS, 2022, 160 : 98 - 104
  • [23] Deep learning technology for face forgery detection: A survey
    Ma, Lixia
    Yang, Puning
    Xu, Yuting
    Yang, Ziming
    Li, Peipei
    Huang, Huaibo
    NEUROCOMPUTING, 2025, 618
  • [24] Face Forgery Detection by 3D Decomposition
    Zhu, Xiangyu
    Wang, Hao
    Fei, Hongyan
    Lei, Zhen
    Li, Stan Z.
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 2928 - 2938
  • [25] Learnable Local Similarity for Face Forgery Detection and Localization
    Leng, Lingyun
    Fei, Jianwei
    Dai, Yunshu
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (12) : 996 - 1003
  • [26] A Temporal Consistency Learning Framework for Face Forgery Detection
    Wang, Xiaopeng
    Zhu, Feng
    Li, Lei
    Tan, Xiaoyang
    ADVANCES IN NEURAL NETWORKS-ISNN 2024, 2024, 14827 : 225 - 234
  • [27] Unknown Aware Feature Learning for Face Forgery Detection
    Shi, Liang
    Zhang, Jie
    Liang, Chenyue
    Shan, Shiguang
    2021 16TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2021), 2021,
  • [28] Domain General Face Forgery Detection by Learning to Weight
    Sun, Ke
    Liu, Hong
    Ye, Qixiang
    Gao, Yue
    Liu, Jianzhuang
    Shao, Ling
    Ji, Rongrong
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2638 - 2646
  • [29] Common Forgery Artifact Driven Deepfake Face Detection
    Wu, Haotian
    Wang, Xin
    Wang, Ruobing
    Xiang, Ji
    Ren, Liyue
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 1585 - 1590
  • [30] Visual-Semantic Transformer for Face Forgery Detection
    Xu, Yuting
    Jia, Gengyun
    Huang, Huaibo
    Duan, Junxian
    He, Ran
    2021 INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS (IJCB 2021), 2021,