Implicit Identity Driven Deepfake Face Swapping Detection

被引:46
|
作者
Huang, Baojin [1 ]
Wang, Zhongyuan [1 ]
Yang, Jifan [1 ]
Ai, Jiaxin [1 ]
Zou, Qin [1 ]
Wang, Qian [2 ]
Ye, Dengpan [2 ]
机构
[1] Wuhan Univ, Sch Comp Sci, NERCMS, Wuhan, Peoples R China
[2] Wuhan Univ, Sch Cyber Sci & Engn, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52729.2023.00436
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we consider the face swapping detection from the perspective of face identity. Face swapping aims to replace the target face with the source face and generate the fake face that the human cannot distinguish between real and fake. We argue that the fake face contains the explicit identity and implicit identity, which respectively corresponds to the identity of the source face and target face during face swapping. Note that the explicit identities of faces can be extracted by regular face recognizers. Particularly, the implicit identity of real face is consistent with the its explicit identity. Thus the difference between explicit and implicit identity of face facilitates face swapping detection. Following this idea, we propose a novel implicit identity driven framework for face swapping detection. Specifically, we design an explicit identity contrast (EIC) loss and an implicit identity exploration (IIE) loss, which supervises a CNN backbone to embed face images into the implicit identity space. Under the guidance of EIC, real samples are pulled closer to their explicit identities, while fake samples are pushed away from their explicit identities. Moreover, IIE is derived from the margin-based classification loss function, which encourages the fake faces with known target identities to enjoy intra-class compactness and interclass diversity. Extensive experiments and visualizations on several datasets demonstrate the generalization of our method against the state-of-the-art counterparts.
引用
收藏
页码:4490 / 4499
页数:10
相关论文
共 50 条
  • [41] The deepfake threat to face biometrics
    Wojewidka J.
    Biometric Technology Today, 2020, 2020 (02) : 5 - 7
  • [42] GCS-YOLOv8: A Lightweight Face Extractor to Assist Deepfake Detection
    Zhang, Ruifang
    Deng, Bohan
    Cheng, Xiaohui
    Zhao, Hong
    SENSORS, 2024, 24 (21)
  • [43] Communal detection of implicit personal identity streams
    Phua, Clifton
    Gayler, Ross
    Smith-Miles, Kate
    Lee, Vincent
    ICDM 2006: Sixth IEEE International Conference on Data Mining, Workshops, 2006, : 620 - 625
  • [44] SAFE: Sequential Attentive Face Embedding with Contrastive Learning for Deepfake Video Detection
    Jung, Juho
    Kang, Chaewon
    Yoon, Jeewoo
    Woo, Simon S.
    Han, Jinyoung
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 3993 - 3997
  • [45] Face Swapping via Reverse Contrastive Learning and Explicit Identity-Attribute Disentanglement
    Wang, Tao
    Zheng, Chunhou
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT XII, ICIC 2024, 2024, 14873 : 216 - 227
  • [46] FSNet: An Identity-Aware Generative Model for Image-Based Face Swapping
    Natsume, Ryota
    Yatagawa, Tatsuya
    Morishima, Shigeo
    COMPUTER VISION - ACCV 2018, PT VI, 2019, 11366 : 117 - 132
  • [47] A High-fidelity Partial Face Manipulation Dataset for Enhanced Deepfake Detection
    Tong, Kaitai
    Zhang, Junbin
    Wang, Yixiao
    Tohidypour, Hamidreza
    Nasiopoulos, Panos
    2024 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS, ICNC, 2024, : 16 - 20
  • [48] StyleIPSB: Identity-Preserving Semantic Basis of StyleGAN for High Fidelity Face Swapping
    Jiang, Diqiong
    Song, Dan
    Tong, Ruofeng
    Tang, Min
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 352 - 361
  • [49] TI2Net: Temporal Identity Inconsistency Network for Deepfake Detection
    Liu, Baoping
    Liu, Bo
    Ding, Ming
    Zhu, Tianqing
    Yu, Xin
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 4680 - 4689
  • [50] DeepFake Face Image Detection based on Improved VGG Convolutional Neural Network
    Chang, Xu
    Wu, Jian
    Yang, Tongfeng
    Feng, Guorui
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 7252 - 7256