DepthFake: Spoofing 3D Face Authentication with a 2D Photo

被引:2
|
作者
Wu, Zhihao [1 ]
Cheng, Yushi [2 ]
Yang, Jiahui [1 ]
Ji, Xiaoyu [1 ]
Xu, Wenyuan [1 ]
机构
[1] Zhejiang Univ, Ubiquitous Syst Secur Lab USSLAB, Hangzhou, Peoples R China
[2] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol BNRis, Beijing, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
ADVERSARIAL ATTACK; RECOGNITION;
D O I
10.1109/SP46215.2023.10179429
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Face authentication has been widely used in access control, and the latest 3D face authentication systems employ 3D liveness detection techniques to cope with the photo replay attacks, whereby an attacker uses a 2D photo to bypass the authentication. In this paper, we analyze the security of 3D liveness detection systems that utilize structured light depth cameras and discover a new attack surface against 3D face authentication systems. We propose DepthFake attacks that can spoof a 3D face authentication using only one single 2D photo. To achieve this goal, DepthFake first estimates the 3D depth information of a target victim's face from his 2D photo. Then, DepthFake projects the carefully-crafted scatter patterns embedded with the face depth information, in order to empower the 2D photo with 3D authentication properties. We overcome a collection of practical challenges, e.g., depth estimation errors from 2D photos, depth images forgery based on structured light, the alignment of the RGB image and depth images for a face, and implemented DepthFake in laboratory setups. We validated DepthFake on 3 commercial face authentication systems (i.e., Tencent Cloud, Baidu Cloud, and 3DiVi) and one commercial access control device. The results over 50 users demonstrate that DepthFake achieves an overall Depth attack success rate of 79:4% and RGB-D attack success rate of 59:4% in the real world.
引用
收藏
页码:917 / 933
页数:17
相关论文
共 50 条
  • [41] From 2D to 3D: Using illumination cones to build 3d face model
    Xiao, S. S.
    Jin, M.
    4TH INTERNATIONAL SYMPOSIUM ON INSTRUMENTATION SCIENCE AND TECHNOLOGY (ISIST' 2006), 2006, 48 : 318 - 323
  • [42] 2D or 3D?
    Mills, R
    COMPUTER-AIDED ENGINEERING, 1996, 15 (08): : 4 - 4
  • [43] Using photo-consistency to register 2D optical images of the human face to a 3D surface model
    Clarkson, MJ
    Rueckert, D
    Hill, DLG
    Hawkes, DJ
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (11) : 1266 - 1280
  • [44] Face 2D to 3D Reconstruction Network Based on Head Pose and 3D Facial Landmarks
    Xu, Yuanquan
    Jung, Cheolkon
    2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [45] Effective 3D Face Depth Estimation from a Single 2D Face Image
    Kong, Dezhi
    Yang, Yang
    Liu, Yun-Xia
    Li, Min
    Jia, Hongying
    2016 16TH INTERNATIONAL SYMPOSIUM ON COMMUNICATIONS AND INFORMATION TECHNOLOGIES (ISCIT), 2016, : 221 - 224
  • [46] 2D or not 2D That is the Question, but 3D is the, answer
    Cronin, Paul
    ACADEMIC RADIOLOGY, 2007, 14 (07) : 769 - 771
  • [47] 2D and 3D Face Recognition Using Convolutional Neural Network
    Hu, Huiying
    Shah, Syed Afaq Ali
    Bennamoun, Mohammed
    Molton, Michael
    TENCON 2017 - 2017 IEEE REGION 10 CONFERENCE, 2017, : 133 - 138
  • [48] Realistic 3D face modeling by fusing multiple 2D images
    Wang, CH
    Yan, SC
    Zhang, HJ
    Ma, WY
    11TH INTERNATIONAL MULTIMEDIA MODELLING CONFERENCE, PROCEEDINGS, 2005, : 139 - 146
  • [49] Multi-modal 2D and 3D biometrics for face recognition
    Chang, KI
    Bowyer, KW
    Flynn, PJ
    IEEE INTERNATIONAL WORKSHOP ON ANALYSIS AND MODELING OF FACE AND GESTURES, 2003, : 187 - 194
  • [50] Face Pose Estimation with Combined 2D and 3D HOG Features
    Yang, Jiaolong
    Liang, Wei
    Jia, Yunde
    2012 21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012), 2012, : 2492 - 2495