DepthFake: Spoofing 3D Face Authentication with a 2D Photo

被引:2
|
作者
Wu, Zhihao [1 ]
Cheng, Yushi [2 ]
Yang, Jiahui [1 ]
Ji, Xiaoyu [1 ]
Xu, Wenyuan [1 ]
机构
[1] Zhejiang Univ, Ubiquitous Syst Secur Lab USSLAB, Hangzhou, Peoples R China
[2] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol BNRis, Beijing, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
ADVERSARIAL ATTACK; RECOGNITION;
D O I
10.1109/SP46215.2023.10179429
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Face authentication has been widely used in access control, and the latest 3D face authentication systems employ 3D liveness detection techniques to cope with the photo replay attacks, whereby an attacker uses a 2D photo to bypass the authentication. In this paper, we analyze the security of 3D liveness detection systems that utilize structured light depth cameras and discover a new attack surface against 3D face authentication systems. We propose DepthFake attacks that can spoof a 3D face authentication using only one single 2D photo. To achieve this goal, DepthFake first estimates the 3D depth information of a target victim's face from his 2D photo. Then, DepthFake projects the carefully-crafted scatter patterns embedded with the face depth information, in order to empower the 2D photo with 3D authentication properties. We overcome a collection of practical challenges, e.g., depth estimation errors from 2D photos, depth images forgery based on structured light, the alignment of the RGB image and depth images for a face, and implemented DepthFake in laboratory setups. We validated DepthFake on 3 commercial face authentication systems (i.e., Tencent Cloud, Baidu Cloud, and 3DiVi) and one commercial access control device. The results over 50 users demonstrate that DepthFake achieves an overall Depth attack success rate of 79:4% and RGB-D attack success rate of 59:4% in the real world.
引用
收藏
页码:917 / 933
页数:17
相关论文
共 50 条
  • [21] Face recognition based on 2D and 3D features
    Arca, Stefano
    Lanzarotti, Raffaella
    Lipori, Giuseppe
    KNOWLEDGE-BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS: KES 2007 - WIRN 2007, PT I, PROCEEDINGS, 2007, 4692 : 455 - +
  • [22] A Taxonomy of 2D and 3D Face Recognition Methods
    Shyam, Radhey
    Singh, Yogendra Narain
    2014 INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INTEGRATED NETWORKS (SPIN), 2014, : 749 - 754
  • [23] 2D and 3D multimodal hybrid face recognition
    Mian, Ajmal
    Bennamoun, Mohammed
    Owens, Robyn
    COMPUTER VISION - ECCV 2006, PT 3, PROCEEDINGS, 2006, 3953 : 344 - 355
  • [24] Photorealistic Face Transfer in 2D and 3D Video
    Merget, Daniel
    Tiefenbacher, Philipp
    Babaee, Mohammadreza
    Mitov, Nikola
    Rigoll, Gerhard
    PATTERN RECOGNITION, GCPR 2015, 2015, 9358 : 400 - 411
  • [25] From 2D images to 3D face geometry
    Lengagne, R
    Tarel, JP
    Monga, O
    PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, 1996, : 301 - 306
  • [26] 3D Face Reconstruction from a Single 2D Face Image
    Park, Sung Won
    Heo, Jingu
    Savvides, Marios
    2008 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, VOLS 1-3, 2008, : 1280 - 1287
  • [27] 2D Face Database Diversification Based on 3D Face Modeling
    Wang, Qun
    Li, Jiang
    Asari, Vijayan K.
    Karim, Mohammad A.
    INTERNATIONAL CONFERENCE ON APPLICATIONS OF OPTICS AND PHOTONICS, 2011, 8001
  • [28] Multimodal 2D, 2.5D & 3D face verification
    Conde, Cristina
    Serrano, Angel
    Cabello, Enrique
    2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS, 2006, : 2061 - +
  • [29] Automated 3D face authentication & recognition
    Bae, M.
    Razdan, A.
    Farin, G. E.
    2007 IEEE CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE, 2007, : 45 - +
  • [30] Face recognition method combining 3D face model with 2D recognition
    Zhao, Minghua
    You, Zhisheng
    Zhao, Yonggang
    Liu, Zhifang
    PROCEEDINGS OF THE FOURTH INTERNATIONAL CONFERENCE ON IMAGE AND GRAPHICS, 2007, : 655 - +