A cascaded deep-learning-based model for face mask detection

被引:5
|
作者
Kumar, Akhil [1 ]
机构
[1] Himachal Pradesh Univ, Dept Comp Sci, Shimla, India
关键词
Face mask detection; ResNet34; YOLO; SPP layer; Deep learning; RECOGNITION;
D O I
10.1108/DTA-02-2022-0076
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Purpose - This work aims to present a deep learning model for face mask detection in surveillance environments such as automatic teller machines (ATMs), banks, etc. to identify persons wearing face masks. In surveillance environments, complete visibility of the face area is a guideline, and criminals and law offenders commit crimes by hiding their faces behind a face mask. The face mask detector model proposed in this work can be used as a tool and integrated with surveillance cameras in autonomous surveillance environments to identify and catch law offenders and criminals. Design/methodology/approach - The proposed face mask detector is developed by integrating the residual network (ResNet)34 feature extractor on top of three You Only Look Once (YOLO) detection layers along with the usage of the spatial pyramid pooling (SPP) layer to extract a rich and dense feature map. Furthermore, at the training time, data augmentation operations such as Mosaic and MixUp have been applied to the feature extraction network so that it can get trained with images of varying complexities. The proposed detector is trained and tested over a custom face mask detection dataset consisting of 52,635 images. For validation, comparisons have been provided with the performance of YOLO v1, v2, tiny YOLO v1, v2, v3 and v4 and other benchmark work present in the literature by evaluating performance metrics such as precision, recall, F1 score, mean average precision (mAP) for the overall dataset and average precision (AP) for each class of the dataset. Findings - The proposed face mask detector achieved 4.75-9.75 per cent higher detection accuracy in terms of mAP, 5-31 per cent higher AP for detection of faces with masks and, specifically, 2-30 per cent higher AP for detection of face masks on the face region as compared to the tested baseline variants of YOLO. Furthermore, the usage of the ResNet34 feature extractor and SPP layer in the proposed detection model reduced the training time and the detection time. The proposed face mask detection model can perform detection over an image in 0.45 s, which is 0.2-0.15 s lesser than that for other tested YOLO variants, thus making the proposed detection model perform detections at a higher speed. Research limitations/implications - The proposed face mask detector model can be utilized as a tool to detect persons with face masks who are a potential threat to the automatic surveillance environments such as ATMs, banks, airport security checks, etc. The other research implication of the proposed work is that it can be trained and tested for other object detection problems such as cancer detection in images, fish species detection, vehicle detection, etc. Practical implications - The proposed face mask detector can be integrated with automatic surveillance systems and used as a tool to detect persons with face masks who are potential threats to ATMs, banks, etc. and in the present times of COVID-19 to detect if the people are following a COVID-appropriate behavior of wearing a face mask or not in the public areas. Originality/value - The novelty of this work lies in the usage of the ResNet34 feature extractor with YOLO detection layers, whichmakes the proposedmodel a compact and powerful convolutional neural-network-based face mask detector model. Furthermore, the SPP layer has been applied to the ResNet34 feature extractor to make it able to extract a rich and dense feature map. The other novelty of the present work is the implementation of Mosaic and MixUp data augmentation in the training network that provided the feature extractor with 3x images of varying complexities and orientations and further aided in achieving higher detection accuracy. The proposed model is novel in terms of extracting rich features, performing augmentation at the training time and achieving high detection accuracy while maintaining the detection speed.
引用
收藏
页码:84 / 107
页数:24
相关论文
共 50 条
  • [21] Face mask detection and classification via deep transfer learning
    Xueping Su
    Meng Gao
    Jie Ren
    Yunhong Li
    Mian Dong
    Xi Liu
    Multimedia Tools and Applications, 2022, 81 : 4475 - 4494
  • [22] Face mask detection and classification via deep transfer learning
    Su, Xueping
    Gao, Meng
    Ren, Jie
    Li, Yunhong
    Dong, Mian
    Liu, Xi
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (03) : 4475 - 4494
  • [23] Comparison of the Effectiveness of Deep Learning Methods for Face Mask Detection
    Gedik, Onur
    Demirhan, Ayse
    TRAITEMENT DU SIGNAL, 2021, 38 (04) : 947 - 953
  • [24] Real-time Face Mask-Wearing Detection and Temperature Measurement based on a Deep Learning Model
    Tung, Chun-Liang
    Wang, Ching-Hsin
    Su, Yong-Lin
    JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2022, 66 (01)
  • [25] A Time Series Deep-Learning-Based Abnormality Detection Model in Power Consumption
    Li, Jingxiang
    Lai, Hao
    Shi, Yanhui
    Wang, Jinhai
    Journal of Network Intelligence, 2024, 9 (01): : 492 - 505
  • [26] Deep-Learning-Based Detection of Segregations for Ultrasonic Testing
    Elischberger, Frederik
    Bamberg, Joachim
    Jiang, Xiaoyi
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [27] Deep-Learning-Based Detection of Transmission Line Insulators
    Zhang, Jian
    Xiao, Tian
    Li, Minhang
    Zhou, Yucai
    ENERGIES, 2023, 16 (14)
  • [28] Deep-learning-based Intrusion Detection with Enhanced Preprocesses
    Lin, Chia-Ju
    Huang, Yueh-Min
    Chen, Ruey-Maw
    SENSORS AND MATERIALS, 2022, 34 (06) : 2391 - 2401
  • [29] Mask Detection From Face Images Using Deep Learning and Transfer Learning
    Ornek, Ahmet Haydar
    Celik, Mustafa
    Ceylan, Murat
    2021 15TH TURKISH NATIONAL SOFTWARE ENGINEERING SYMPOSIUM (UYMS), 2021, : 113 - 116
  • [30] Deep-Learning-Based Vulnerability Detection in Binary Executables
    Schaad, Andreas
    Binder, Dominik
    FOUNDATIONS AND PRACTICE OF SECURITY, FPS 2022, 2023, 13877 : 453 - 460