PLFace: Progressive Learning for Face Recognition with Mask Bias

被引:16
|
作者
Huang, Baojin [1 ]
Wang, Zhongyuan [1 ]
Wang, Guangcheng [1 ]
Jiang, Kui [1 ]
Han, Zhen [1 ]
Lu, Tao [2 ]
Liang, Chao [1 ]
机构
[1] Wuhan Univ, Sch Comp Sci, NERCMS, Wuhan 430072, Peoples R China
[2] Wuhan Inst Technol, Sch Comp Sci & Engn, Wuhan 430205, Peoples R China
基金
中国国家自然科学基金;
关键词
Face recognition; Progressive learning; Mask bias;
D O I
10.1016/j.patcog.2022.109142
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The outbreak of the COVID-19 coronavirus epidemic has promoted the development of masked face recognition (MFR). Nevertheless, the performance of regular face recognition is severely compromised when the MFR accuracy is blindly pursued. More facts indicate that MFR should be regarded as a mask bias of face recognition rather than an independent task. To mitigate mask bias, we propose a novel Pro-gressive Learning Loss (PLFace) that achieves a progressive training strategy for deep face recognition to learn balanced performance for masked/mask-free faces recognition based on margin losses. Particularly, our PLFace adaptively adjusts the relative importance of masked and mask-free samples during different training stages. In the early stage of training, PLFace mainly learns the feature representations of mask -free samples. At this time, the regular sample embeddings shrink to the corresponding prototype, which represents the center of each class while being stored in the last linear layer. In the later stage of train-ing, PLFace converges on mask-free samples and further focuses on masked samples until the masked sample embeddings are also gathered in the center of the class. The entire training process emphasizes the paradigm that normal samples shrink first and masked samples gather afterward. Extensive experi-mental results on popular regular and masked face benchmarks demonstrate that our proposed PLFace can effectively eliminate mask bias in face recognition. Compared to state-of-the-art competitors, PLFace significantly improves the accuracy of MFR while maintaining the performance of normal face recogni-tion.(c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Face Recognition and Learning Disability
    Manzanero, Antonio L.
    Recio, Maria
    Alemany, Alberto
    Martorell, Almudena
    ANUARIO DE PSICOLOGIA JURIDICA, 2011, 21 (01): : 41 - 48
  • [42] Federated Learning for Face Recognition
    Kim, Jaehyeok
    Park, Taehyeong
    Kim, Hyorin
    Kim, Suhyun
    2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2021,
  • [43] Curriculum Learning for Face Recognition
    Buyuktas, Baris
    Erdem, Cigdem Eroglu
    Erdem, Tanju
    28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020), 2021, : 650 - 654
  • [44] Face recognition by incremental learning
    Huang, WM
    Lee, BH
    Li, LY
    Leman, K
    2003 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS, VOLS 1-5, CONFERENCE PROCEEDINGS, 2003, : 4718 - 4723
  • [45] Mask-Up: A Face Mask Alert App Using Machine Learning
    Moyo, Nesisa
    Moyo, Sibonile
    Mutunhu, Belinda
    2022 IST-AFRICA CONFERENCE, 2022,
  • [46] Unlabeled Data Assistant: Improving Mask Robustness for Face Recognition
    Huang, Baojin
    Wang, Zhongyuan
    Yang, Jifan
    Han, Zhen
    Liang, Chao
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 3109 - 3123
  • [47] ULN: An efficient face recognition method for person wearing a mask
    Hongtao Lu
    Zijun Zhuang
    Multimedia Tools and Applications, 2022, 81 : 42393 - 42411
  • [48] The Effect of Wearing a Mask on Face Recognition Performance: an Exploratory Study
    Damer, Naser
    Grebe, Jonas Henry
    Chen, Cong
    Boutros, Fadi
    Kirchbuchner, Florian
    Kuijper, Arjan
    2020 INTERNATIONAL CONFERENCE OF THE BIOMETRICS SPECIAL INTEREST GROUP (BIOSIG), 2020, P-306
  • [49] Face mask recognition using a custom CNN and data augmentation
    Fazeli Ardekani, Pooya
    Tale, Seyede Zahra
    Parseh, Mohammad Javad
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (01) : 255 - 263
  • [50] Unlabeled Data Assistant: Improving Mask Robustness for Face Recognition
    Huang, Baojin
    Wang, Zhongyuan
    Yang, Jifan
    Han, Zhen
    Liang, Chao
    IEEE Transactions on Information Forensics and Security, 2024, 19 : 3109 - 3123