Deep Spatial Gradient and Temporal Depth Learning for Face Anti-spoofing

被引:139
|
作者
Wang, Zezheng [1 ]
Yu, Zitong [2 ]
Zhao, Chenxu [3 ]
Zhu, Xiangyu [4 ,5 ]
Qin, Yunxiao [6 ]
Zhou, Qiusheng [7 ]
Zhou, Feng [1 ]
Lei, Zhen [4 ,5 ]
机构
[1] AIBEE, Beijing, Peoples R China
[2] Univ Oulu, CMVS, Oulu, Finland
[3] Mininglamp Technol, Acad Sci, Beijing, Peoples R China
[4] CASIA, CBSR, Beijing, Peoples R China
[5] CASIA, NLPR, Beijing, Peoples R China
[6] Northwestern Polytech Univ, Xian, Shaanxi, Peoples R China
[7] JD Digits, Beijing, Peoples R China
关键词
IMAGE;
D O I
10.1109/CVPR42600.2020.00509
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face anti-spoofing is critical to the security of face recognition systems. Depth supervised learning has been proven as one of the most effective methods for face anti-spoofing. Despite the great success, most previous works still formulate the problem as a single frame multi-task one by simply augmenting the loss with depth, while neglecting the detailed fine-grained information and the interplay between facial depths and moving patterns. In contrast, we design a new approach to detect presentation attacks from multiple frames based on two insights: 1) detailed discriminative clues (e.g., spatial gradient magnitude) between living and spoofing face may be discarded through stacked vanilla convolutions, and 2) the dynamics of 3D moving faces provide important clues in detecting the spoofing faces. The proposed method is able to capture discriminative details via Residual Spatial Gradient Block (RSGB) and encode spatio-temporal information from Spatio-Temporal Propagation Module (STPM) efficiently. Moreover, a novel Contrastive Depth Loss is presented for more accurate depth supervision. To assess the efficacy of our method, we also collect a Double-modal Anti-spoofing Dataset (DMAD) which provides actual depth for each sample. The experiments demonstrate that the proposed approach achieves state-of-the-art results on five benchmark datasets including OULU-NPU, SiW, CASIA-MFSD, Replay-Attack, and the new DMAD. Codes will be available at https://github.com/c1ks-wzz/FAS-SGTD.
引用
收藏
页码:5041 / 5050
页数:10
相关论文
共 50 条
  • [1] Deep Learning for Face Anti-Spoofing: A Survey
    Yu, Zitong
    Qin, Yunxiao
    Li, Xiaobai
    Zhao, Chenxu
    Lei, Zhen
    Zhao, Guoying
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 5609 - 5631
  • [2] Face Anti-Spoofing Using Chainlets and Deep Learning
    Alrethea, Sarah Abdulaziz
    Ahmad, Adil
    [J]. International Journal of Advanced Computer Science and Applications, 2024, 15 (11) : 807 - 814
  • [3] Learning Generalized Deep Feature Representation for Face Anti-Spoofing
    Li, Haoliang
    He, Peisong
    Wang, Shiqi
    Rocha, Anderson
    Jiang, Xinghao
    Kot, Alex C.
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2018, 13 (10) : 2639 - 2652
  • [4] A Secure Face Anti-spoofing Approach Using Deep Learning
    Safarzadeh, Meysam
    Ghasemi, Mohammad
    Khoramdel, Javad
    Ardekany, Ali Najafi
    [J]. 2019 7TH INTERNATIONAL CONFERENCE ON ROBOTICS AND MECHATRONICS (ICROM 2019), 2019, : 322 - 327
  • [5] Advanced Face Anti-Spoofing with Depth Segmentation
    Zhang, Licheng
    Sun, Nan
    Wu, Xihong
    Luo, Dingsheng
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [6] Deep Ensemble Learning with Frame Skipping for Face Anti-Spoofing
    University of Oulu, Center for Machine Vision and Signal Analysis, Finland
    不详
    [J]. Int. Conf. Image Process. Theory, Tools Appl., IPTA,
  • [7] Robust face anti-spoofing with depth information
    Wang, Yan
    Nian, Fudong
    Li, Teng
    Meng, Zhijun
    Wang, Kongqiao
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 49 : 332 - 337
  • [8] DEPTH-BASED ENSEMBLE LEARNING NETWORK FOR FACE ANTI-SPOOFING
    Jiang, Jie
    Sun, Yunlian
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2954 - 2958
  • [9] Consistency Regularization for Deep Face Anti-Spoofing
    Wang, Zezheng
    Yu, Zitong
    Wang, Xun
    Qin, Yunxiao
    Li, Jiahong
    Zhao, Chenxu
    Liu, Xin
    Lei, Zhen
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 : 1127 - 1140
  • [10] Learning Multi-Granularity Temporal Characteristics for Face Anti-Spoofing
    Wang, Zhuo
    Wang, Qiangchang
    Deng, Weihong
    Guo, Guodong
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 1254 - 1269