Masked Face Analysis via Multi-Task Deep Learning

被引:6
|
作者
Patel, Vatsa S. [1 ]
Nie, Zhongliang [1 ]
Le, Trung-Nghia [2 ]
Nguyen, Tam, V [1 ]
机构
[1] Univ Dayton, Dept Comp Sci, Dayton, OH 45469 USA
[2] Natl Inst Informat, Tokyo 1018430, Japan
基金
日本学术振兴会; 美国国家科学基金会;
关键词
multi-task learning; masked face; age; gender; expression; face detection; HUMAN AGE ESTIMATION;
D O I
10.3390/jimaging7100204
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Face recognition with wearable items has been a challenging task in computer vision and involves the problem of identifying humans wearing a face mask. Masked face analysis via multi-task learning could effectively improve performance in many fields of face analysis. In this paper, we propose a unified framework for predicting the age, gender, and emotions of people wearing face masks. We first construct FGNET-MASK, a masked face dataset for the problem. Then, we propose a multi-task deep learning model to tackle the problem. In particular, the multi-task deep learning model takes the data as inputs and shares their weight to yield predictions of age, expression, and gender for the masked face. Through extensive experiments, the proposed framework has been found to provide a better performance than other existing methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] FocusFace: Multi-task Contrastive Learning for Masked Face Recognition
    Neto, Pedro C.
    Boutros, Fadi
    Pinto, Joao Ribeiro
    Damer, Naser
    Sequeira, Ana F.
    Cardoso, Jaime S.
    [J]. 2021 16TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2021), 2021,
  • [2] Joint face alignment and segmentation via deep multi-task learning
    Zhao, Yucheng
    Tang, Fan
    Dong, Weiming
    Huang, Feiyue
    Zhang, Xiaopeng
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (10) : 13131 - 13148
  • [3] Joint face alignment and segmentation via deep multi-task learning
    Yucheng Zhao
    Fan Tang
    Weiming Dong
    Feiyue Huang
    Xiaopeng Zhang
    [J]. Multimedia Tools and Applications, 2019, 78 : 13131 - 13148
  • [4] Boosting Masked Face Recognition with Multi-Task ArcFace
    Montero, David
    Nieto, Marcos
    Leskovsky, Peter
    Aginako, Naiara
    [J]. 2022 16TH INTERNATIONAL CONFERENCE ON SIGNAL-IMAGE TECHNOLOGY & INTERNET-BASED SYSTEMS, SITIS, 2022, : 184 - 189
  • [5] Improving Evidential Deep Learning via Multi-Task Learning
    Oh, Dongpin
    Shin, Bonggun
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 7895 - 7903
  • [6] Heterogeneous Face Attribute Estimation: A Deep Multi-Task Learning Approach
    Han, Hu
    Jain, Anil K.
    Wang, Fang
    Shan, Shiguang
    Chen, Xilin
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (11) : 2597 - 2609
  • [7] Deep Multi-Task Learning for Joint Prediction of Heterogeneous Face Attributes
    Wang, Fang
    Han, Hu
    Shan, Shiguang
    Chen, Xilin
    [J]. 2017 12TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2017), 2017, : 173 - 179
  • [8] Information Cascades Modeling via Deep Multi-Task Learning
    Chen, Xueqin
    Zhang, Kunpeng
    Zhou, Fan
    Trajcevski, Goce
    Zhong, Ting
    Zhang, Fengli
    [J]. PROCEEDINGS OF THE 42ND INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '19), 2019, : 885 - 888
  • [9] Seismic Event Detection via Deep Multi-Task Learning
    Yu, Yang
    Zhang, Lei
    Shen, Jiakai
    Wang, Qingcai
    Liu, Guiquan
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [10] Hand Image Understanding via Deep Multi-Task Learning
    Zhang, Xiong
    Huang, Hongsheng
    Tan, Jianchao
    Xu, Hongmin
    Yang, Cheng
    Peng, Guozhu
    Wang, Lei
    Liu, Ji
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 11261 - 11272