Implicit Identity Driven Deepfake Face Swapping Detection

被引:46
|
作者
Huang, Baojin [1 ]
Wang, Zhongyuan [1 ]
Yang, Jifan [1 ]
Ai, Jiaxin [1 ]
Zou, Qin [1 ]
Wang, Qian [2 ]
Ye, Dengpan [2 ]
机构
[1] Wuhan Univ, Sch Comp Sci, NERCMS, Wuhan, Peoples R China
[2] Wuhan Univ, Sch Cyber Sci & Engn, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52729.2023.00436
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we consider the face swapping detection from the perspective of face identity. Face swapping aims to replace the target face with the source face and generate the fake face that the human cannot distinguish between real and fake. We argue that the fake face contains the explicit identity and implicit identity, which respectively corresponds to the identity of the source face and target face during face swapping. Note that the explicit identities of faces can be extracted by regular face recognizers. Particularly, the implicit identity of real face is consistent with the its explicit identity. Thus the difference between explicit and implicit identity of face facilitates face swapping detection. Following this idea, we propose a novel implicit identity driven framework for face swapping detection. Specifically, we design an explicit identity contrast (EIC) loss and an implicit identity exploration (IIE) loss, which supervises a CNN backbone to embed face images into the implicit identity space. Under the guidance of EIC, real samples are pulled closer to their explicit identities, while fake samples are pushed away from their explicit identities. Moreover, IIE is derived from the margin-based classification loss function, which encourages the fake faces with known target identities to enjoy intra-class compactness and interclass diversity. Extensive experiments and visualizations on several datasets demonstrate the generalization of our method against the state-of-the-art counterparts.
引用
收藏
页码:4490 / 4499
页数:10
相关论文
共 50 条
  • [1] Common Forgery Artifact Driven Deepfake Face Detection
    Wu, Haotian
    Wang, Xin
    Wang, Ruobing
    Xiang, Ji
    Ren, Liyue
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 1585 - 1590
  • [2] Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalization
    Dong, Shichao
    Wang, Jin
    Ji, Renhe
    Liang, Jiajun
    Fan, Haoqing
    He, Zheng
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 3994 - 4004
  • [3] Practical Face Swapping Detection Based on Identity Spatial Constraints
    Jiang, Jun
    Wang, Bo
    Li, Bing
    Hu, Weiming
    2021 INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS (IJCB 2021), 2021,
  • [4] The Face Deepfake Detection Challenge
    Guarnera, Luca
    Giudice, Oliver
    Guarnera, Francesco
    Ortis, Alessandro
    Puglisi, Giovanni
    Paratore, Antonino
    Bui, Linh M. Q.
    Fontani, Marco
    Coccomini, Davide Alessandro
    Caldelli, Roberto
    Falchi, Fabrizio
    Gennaro, Claudio
    Messina, Nicola
    Amato, Giuseppe
    Perelli, Gianpaolo
    Concas, Sara
    Cuccu, Carlo
    Orru, Giulia
    Marcialis, Gian Luca
    Battiato, Sebastiano
    JOURNAL OF IMAGING, 2022, 8 (10)
  • [5] Face swapping detection based on identity spatial constraints with weighted frequency division
    Zupeng Ai
    Chengwei Peng
    Jun Jiang
    Zekun Li
    Bing Li
    Multimedia Systems, 2023, 29 : 627 - 640
  • [6] Face swapping detection based on identity spatial constraints with weighted frequency division
    Ai, Zupeng
    Peng, Chengwei
    Jiang, Jun
    Li, Zekun
    Li, Bing
    MULTIMEDIA SYSTEMS, 2023, 29 (02) : 627 - 640
  • [7] A Survey on Face Forgery Detection of Deepfake
    Zhang, Ying
    Gao, Feng
    Zhou, Zichen
    Guo, Hong
    THIRTEENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2021), 2021, 11878
  • [8] Swapping Face Images with Generative Neural Networks for Deepfake Technology - Experimental Study
    Zendran, Michal
    Rusiecki, Andrzej
    KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS (KSE 2021), 2021, 192 : 834 - 843
  • [9] Sugar-coated poison defense on deepfake face-swapping attacks
    Guo, Cheng-Yao
    Yu, Fang
    PROCEEDINGS OF THE 2024 IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATION OF SOFTWARE TEST, AST 2024, 2024, : 78 - 87
  • [10] Restricted Black-Box Adversarial Attack Against DeepFake Face Swapping
    Dong, Junhao
    Wang, Yuan
    Lai, Jianhuang
    Xie, Xiaohua
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 : 2596 - 2608