CASIA-SURF CeFA: A Benchmark for Multi-modal Cross-ethnicity Face Anti-spoofing

被引:67
|
作者
Liu, Ajian [1 ]
Tan, Zichang [2 ]
Wan, Jun [2 ]
Escalera, Sergio [3 ]
Guo, Guodong [4 ]
Li, Stan Z. [1 ,5 ]
机构
[1] MUST, Macau, Peoples R China
[2] UCAS, CASIA, NLPR, Beijing, Peoples R China
[3] UB, CVC, Barcelona, Spain
[4] Baidu Res, Beijing, Peoples R China
[5] Westlake Univ, Hangzhou, Peoples R China
关键词
D O I
10.1109/WACV48630.2021.00122
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The issue of ethnic bias has proven to affect the performance of face recognition in previous works, while it still remains to be vacant in face anti-spoofing. Therefore, in order to study the ethnic bias for face anti-spoofing, we introduce the largest CASIA-SURF Cross-ethnicity Face Anti-spoofing (CeFA) dataset, covering 3 ethnicities, 3 modalities, 1; 607 subjects, and 2D plus 3D attack types. Five protocols are introduced to measure the affect under varied evaluation conditions, such as cross-ethnicity, unknown spoofs or both of them. As our knowledge, CASIA-SURF CeFA is the first dataset including explicit ethnic labels in current released datasets. Then, we propose a novel multi-modal fusion method as a strong baseline to alleviate the ethnic bias, which employs a partially shared fusion strategy to learn complementary information from multiple modalities. Extensive experiments have been conducted on the proposed dataset to verify its significance and generalization capability for other existing datasets, i.e., CASIA-SURF, OULU-NPU and SiW datasets.
引用
收藏
页码:1178 / 1186
页数:9
相关论文
共 21 条
  • [1] CASIA-SURF: A Large-Scale Multi-Modal Benchmark for Face Anti-Spoofing
    Zhang, Shifeng
    Liu, Ajian
    Wan, Jun
    Liang, Yanyan
    Guo, Guodong
    Escalera, Sergio
    Escalante, Hugo Jair
    Li, Stan Z.
    [J]. IEEE Transactions on Biometrics, Behavior, and Identity Science, 2020, 2 (02): : 182 - 193
  • [2] Cross-ethnicity face anti-spoofing recognition challenge: A review
    Liu, Ajian
    Li, Xuan
    Wan, Jun
    Liang, Yanyan
    Escalera, Sergio
    Escalante, Hugo Jair
    Madadi, Meysam
    Jin, Yi
    Wu, Zhuoyuan
    Yu, Xiaogang
    Tan, Zichang
    Yuan, Qi
    Yang, Ruikun
    Zhou, Benjia
    Guo, Guodong
    Li, Stan Z.
    [J]. IET BIOMETRICS, 2021, 10 (01) : 24 - 43
  • [3] A Dataset and Benchmark for Large-scale Multi-modal Face Anti-spoofing
    Zhang, Shifeng
    Wang, Xiaobo
    Liu, Ajian
    Zhao, Chenxu
    Wan, Jun
    Escalera, Sergio
    Shi, Hailin
    Wang, Zezheng
    Li, Stan Z.
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 919 - 928
  • [4] A Cross Domain Multi-modal Dataset for Robust Face Anti-spoofing
    Ji, Qiaobin
    Xu, Shugong
    Chen, Xudong
    Zhang, Shunqing
    Cao, Shan
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 4309 - 4316
  • [5] A Dataset and Benchmark Towards Multi-Modal Face Anti-Spoofing Under Surveillance Scenarios
    Chen, Xudong
    Xu, Shugong
    Ji, Qiaobin
    Cao, Shan
    [J]. IEEE ACCESS, 2021, 9 : 28140 - 28155
  • [6] A hierarchical multi-modal cross-attention model for face anti-spoofing
    Xue, Hao
    Ma, Jing
    Guo, Xiaoyu
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 97
  • [7] Multi-modal Face Anti-spoofing Based on a Single Image
    Zhang, Quan
    Liao, Zexiang
    Huang, Yuezhen
    Lai, Jianhuang
    [J]. PATTERN RECOGNITION AND COMPUTER VISION,, PT III, 2021, 13021 : 424 - 435
  • [8] Multi-Modal Face Anti-Spoofing Based on Central Difference Networks
    Yu, Zitong
    Qin, Yunxiao
    Li, Xiaobai
    Wang, Zezheng
    Zhao, Chenxu
    Lei, Zhen
    Zhao, Guoying
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2766 - 2774
  • [9] Lightweight face anti-spoofing method based on cross-fused multi-modal features
    He, Xiping
    Li, Yi
    He, Dan
    Yuan, Rui
    Huang, Ling
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (02)
  • [10] PipeNet: Selective Modal Pipeline of Fusion Network for Multi-Modal Face Anti-Spoofing
    Yang, Qing
    Zhu, Xia
    Fwu, Jong-Kae
    Ye, Yun
    You, Ganmei
    Zhu, Yuan
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2739 - 2747