Revisiting face forgery detection towards generalization

被引:0
|
作者
Peng, Chunlei [1 ]
Chen, Tao [1 ]
Liu, Decheng [1 ]
Guo, Huiqing [1 ]
Wang, Nannan [1 ]
Gao, Xinbo [2 ]
机构
[1] Xidian Univ, Xian 710071, Shaanxi, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Chongqing 400065, Peoples R China
基金
中国国家自然科学基金;
关键词
Face forgery detection; Generalization ability; Cross dataset evaluation; Damaged image; Literature survey;
D O I
10.1016/j.neunet.2025.107310
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face forgery detection aims to distinguish AI generated fake faces with real faces. With the rapid development of face forgery creation algorithms, a large number of generative models have been proposed, which gradually reduce the local distortion phenomenon or the specific frequency traces in these models. At the same time, in the process of face data compression and transmission, distortion phenomenon and specific frequency cues could be eliminated, which brings severe challenges to the performance and generalization ability of face forgery detection. To promote the progress on face forgery detection research towards generalization, we present the first comprehensive overview and in-depth analysis of the generalizable face forgery detection methods. We categorize the target of generalizable face forgery detection into the robustness on novel and unknown forged images, and robustness on damaged low-quality images. We discuss representative generalization strategies including the aspects of data augmentation, multi-source learning, fingerprints detection, feature enhancement, temporal analysis, vision-language detection. We summarize the widely used datasets and the generalization performance of state-of-the-art methods in terms of robustness to novel unknown forgery as well as damaged quality forgery types. Finally, we discuss under-investigated open issues on face forgery detection towards generalization in six directions, including building a new generation of datasets, extracting strong forgery cues, considering identity features in face forgery detection, security and fairness of forgery detectors, the potential of large models in forgery detection and test-time adaptation. Our revisit of face forgery detection towards generalization will help promote the research and application of face forgery detection on real-world unconstrained conditions in the future.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] CORE: Consistent Representation Learning for Face Forgery Detection
    Ni, Yunsheng
    Meng, Depu
    Yu, Changqian
    Quan, Chengbin
    Ren, Dongchun
    Zhao, Youjian
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 12 - 21
  • [42] AltFreezing for More General Video Face Forgery Detection
    Wang, Zhendong
    Bao, Jianmin
    Zhou, Wengang
    Wangi, Weilun
    Li, Hougiang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 4129 - 4138
  • [43] Learning Local Reconstruction Errors for Face Forgery Detection
    Wu, Haoyu
    Leng, Lingyun
    Yu, Peipeng
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (11) : 1220 - 1227
  • [44] Identifying Rhythmic Patterns for Face Forgery Detection and Categorization
    Liang, Jiahao
    Deng, Weihong
    2021 INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS (IJCB 2021), 2021,
  • [45] Towards Generalization in Deepfake Detection
    Verdoliva, Luisa
    PROCEEDINGS OF THE 2022 ACM WORKSHOP ON INFORMATION HIDING AND MULTIMEDIA SECURITY, IH-MMSEC 2022, 2022, : 1 - 1
  • [46] Towards Generalization in Deepfake Detection
    Verdoliva, Luisa
    1ST ACM INTERNATIONAL WORKSHOP ON MULTIMEDIA AI AGAINST DISINFORMATION, MAD 2022, 2022, : 1 - 1
  • [47] MCS-GAN: A Different Understanding for Generalization of Deep Forgery Detection
    Xiao, Shuai
    Lan, Guipeng
    Yang, Jiachen
    Lu, Wen
    Meng, Qinggang
    Gao, Xinbo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 1333 - 1345
  • [48] Constructing Spatio-Temporal Graphs for Face Forgery Detection
    Shang, Zhihua
    Xie, Hongtao
    Yu, Lingyun
    Zha, Zhengjun
    Zhang, Yongdong
    ACM TRANSACTIONS ON THE WEB, 2023, 17 (03)
  • [49] Controllable Guide-Space for Generalizable Face Forgery Detection
    Guo, Ying
    Zhen, Cheng
    Yan, Pengfei
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 20761 - 20770
  • [50] A Face Forgery Video Detection Model Based on Knowledge Distillation
    Liang, Haobo
    Leng, Yingxiong
    Luo, Jinman
    Chen, Jie
    Guo, Xiaoji
    27TH IEEE/ACIS INTERNATIONAL SUMMER CONFERENCE ON SOFTWARE ENGINEERING ARTIFICIAL INTELLIGENCE NETWORKING AND PARALLEL/DISTRIBUTED COMPUTING, SNPD 2024-SUMMER, 2024, : 50 - 55