Implicit Identity Driven Deepfake Face Swapping Detection

被引:46
|
作者
Huang, Baojin [1 ]
Wang, Zhongyuan [1 ]
Yang, Jifan [1 ]
Ai, Jiaxin [1 ]
Zou, Qin [1 ]
Wang, Qian [2 ]
Ye, Dengpan [2 ]
机构
[1] Wuhan Univ, Sch Comp Sci, NERCMS, Wuhan, Peoples R China
[2] Wuhan Univ, Sch Cyber Sci & Engn, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52729.2023.00436
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we consider the face swapping detection from the perspective of face identity. Face swapping aims to replace the target face with the source face and generate the fake face that the human cannot distinguish between real and fake. We argue that the fake face contains the explicit identity and implicit identity, which respectively corresponds to the identity of the source face and target face during face swapping. Note that the explicit identities of faces can be extracted by regular face recognizers. Particularly, the implicit identity of real face is consistent with the its explicit identity. Thus the difference between explicit and implicit identity of face facilitates face swapping detection. Following this idea, we propose a novel implicit identity driven framework for face swapping detection. Specifically, we design an explicit identity contrast (EIC) loss and an implicit identity exploration (IIE) loss, which supervises a CNN backbone to embed face images into the implicit identity space. Under the guidance of EIC, real samples are pulled closer to their explicit identities, while fake samples are pushed away from their explicit identities. Moreover, IIE is derived from the margin-based classification loss function, which encourages the fake faces with known target identities to enjoy intra-class compactness and interclass diversity. Extensive experiments and visualizations on several datasets demonstrate the generalization of our method against the state-of-the-art counterparts.
引用
收藏
页码:4490 / 4499
页数:10
相关论文
共 50 条
  • [21] Towards Solving the DeepFake Problem : An Analysis on Improving DeepFake Detection using Dynamic Face Augmentation
    Das, Sowmen
    Seferbekov, Selim
    Datta, Arup
    Islam, Md Saiful
    Amin, Md Ruhul
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 3769 - 3778
  • [22] Depth map guided triplet network for deepfake face detection
    Liang, Buyun
    Wang, Zhongyuan
    Huang, Baojin
    Zou, Qin
    Wang, Qian
    Liang, Jingjing
    NEURAL NETWORKS, 2023, 159 : 34 - 42
  • [23] An Experimental Evaluation of Recent Face Recognition Losses for Deepfake Detection
    Liu, Yu-Cheng
    Chang, Chia-Ming
    Chen, I-Hsuan
    Ku, Yu-Ru
    Chen, Jun-Cheng
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 9827 - 9834
  • [24] Towards Generalized Detection of Face-Swap Deepfake Images
    Ghasemzadeh, Faraz
    Moghaddam, Tina
    Dai, Jingming
    Yun, Joobeom
    Kim, Dan Dongseong
    PROCEEDINGS OF THE 3RD ACM WORKSHOP ON SECURITY IMPLICATIONS OF DEEPFAKES AND CHEAPFAKES, ACM WDC 2024, 2024, : 8 - 13
  • [25] Real face foundation representation learning for generalized deepfake detection
    Shi, Liang
    Zhang, Jie
    Ji, Zhilong
    Bai, Jinfeng
    Shan, Shiguang
    PATTERN RECOGNITION, 2025, 161
  • [26] An Experimental Evaluation on Deepfake Detection using Deep Face Recognition
    Ramachandran, Sreeraj
    Nadimpalli, Aakash Varma
    Rattani, Ajita
    2021 INTERNATIONAL CARNAHAN CONFERENCE ON SECURITY TECHNOLOGY (ICCST), 2021,
  • [27] A Deepfake Face Image Detection Model Supporting Privacy Protection
    Wu W.
    Zhu J.
    Zhang Y.
    Zhang L.
    Chen B.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2023, 35 (10): : 1510 - 1520
  • [28] BlendFace: Re-designing Identity Encoders for Face-Swapping
    Shiohara, Kaede
    Yang, Xingchao
    Taketomi, Takafumi
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 7600 - 7610
  • [29] Paste You Into Game: Towards Expression and Identity Consistency Face Swapping
    Zeng, Hao
    Zhang, Wei
    Chen, Keyu
    Zhang, Zhimeng
    Li, Lincheng
    Ding, Yu
    2022 IEEE CONFERENCE ON GAMES, COG, 2022, : 1 - 8
  • [30] Advancing High Fidelity Identity Swapping for Forgery Detection
    Li, Lingzhi
    Bao, Jianmin
    Yang, Hao
    Chen, Dong
    Wen, Fang
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5073 - 5082