Implicit Identity Driven Deepfake Face Swapping Detection

被引:46
|
作者
Huang, Baojin [1 ]
Wang, Zhongyuan [1 ]
Yang, Jifan [1 ]
Ai, Jiaxin [1 ]
Zou, Qin [1 ]
Wang, Qian [2 ]
Ye, Dengpan [2 ]
机构
[1] Wuhan Univ, Sch Comp Sci, NERCMS, Wuhan, Peoples R China
[2] Wuhan Univ, Sch Cyber Sci & Engn, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52729.2023.00436
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we consider the face swapping detection from the perspective of face identity. Face swapping aims to replace the target face with the source face and generate the fake face that the human cannot distinguish between real and fake. We argue that the fake face contains the explicit identity and implicit identity, which respectively corresponds to the identity of the source face and target face during face swapping. Note that the explicit identities of faces can be extracted by regular face recognizers. Particularly, the implicit identity of real face is consistent with the its explicit identity. Thus the difference between explicit and implicit identity of face facilitates face swapping detection. Following this idea, we propose a novel implicit identity driven framework for face swapping detection. Specifically, we design an explicit identity contrast (EIC) loss and an implicit identity exploration (IIE) loss, which supervises a CNN backbone to embed face images into the implicit identity space. Under the guidance of EIC, real samples are pulled closer to their explicit identities, while fake samples are pushed away from their explicit identities. Moreover, IIE is derived from the margin-based classification loss function, which encourages the fake faces with known target identities to enjoy intra-class compactness and interclass diversity. Extensive experiments and visualizations on several datasets demonstrate the generalization of our method against the state-of-the-art counterparts.
引用
收藏
页码:4490 / 4499
页数:10
相关论文
共 50 条
  • [31] Dodging DeepFake Detection via Implicit Spatial-Domain Notch Filtering
    Huang, Yihao
    Juefei-Xu, Felix
    Guo, Qing
    Liu, Yang
    Pu, Geguang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 6949 - 6962
  • [32] Deepfake video detection: YOLO-Face convolution recurrent approach
    Ismail, Aya
    Elpeltagy, Marwa
    Zaki, Mervat
    ElDahshan, Kamal A.
    PEERJ COMPUTER SCIENCE, 2021, 7
  • [33] Learning Face Forgery Detection in Unseen Domain with Generalization Deepfake Detector
    Tran, Van-Nhan
    Lee, Suk-Hwan
    Le, Hoanh-Su
    Kim, Bo-Sung
    Kwon, Ki-Ryong
    2023 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, ICCE, 2023,
  • [34] Preserving manipulated and synthetic Deepfake detection through face texture naturalness
    Chew, Chit-Jie
    Lin, Yu-Cheng
    Chen, Ying-Chin
    Fan, Yun-Yi
    Lee, Jung-San
    JOURNAL OF INFORMATION SECURITY AND APPLICATIONS, 2024, 83
  • [35] ID-Reveal: Identity-aware DeepFake Video Detection
    Cozzolino, Davide
    Roessler, Andreas
    Thies, Justus
    Niessner, Matthias
    Verdoliva, Luisa
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 15088 - 15097
  • [36] Identity-Preserving Face Swapping via Dual Surrogate Generative Models
    Huang, Ziyao
    Tang, Fan
    Zhang, Yong
    Cao, Juan
    Li, Chengyu
    Tang, Sheng
    Li, Jintao
    Lee, Tong-yee
    ACM TRANSACTIONS ON GRAPHICS, 2024, 43 (05):
  • [37] DEEPFAKE IN FACE PERCEPTION RESEARCH
    Barabanschikov, Vladimir A.
    Marinova, Maria M.
    EKSPERIMENTALNAYA PSIKHOLOGIYA, 2021, 14 (01): : 4 - 19
  • [38] On Face Segmentation, Face Swapping, and Face Perception
    Nirkin, Yuval
    Masi, Iacopo
    Anh Tuan Tran
    Hassner, Tal
    Medioni, Gerard
    PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, : 98 - 105
  • [39] Learning Spatiotemporal Inconsistency via Thumbnail Layout for Face Deepfake Detection
    Xu, Yuting
    Liang, Jian
    Sheng, Lijun
    Zhang, Xiao-Yu
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (12) : 5663 - 5680
  • [40] Challenges and Applications of Face Deepfake
    Laishram, Lamyanba
    Rahman, Md Maklachur
    Jung, Soon Ki
    FRONTIERS OF COMPUTER VISION, IW-FCV 2021, 2021, 1405 : 131 - 156