Masked face age and gender identification using CAFFE-modified MobileNetV2 on photo and real-time video images by transfer learning and deep learning techniques

被引:8
|
作者
Kumar, B. Anil [1 ]
Misra, Neeraj Kumar [1 ]
机构
[1] VIT AP Univ, Sch Elect Engn, Amaravati 522237, India
关键词
Masked face classification; Masked face age identification; Masked face gender identification; Transfer learning; Deep learning; Deep neural network; NEURAL-NETWORKS; RECOGNITION;
D O I
10.1016/j.eswa.2024.123179
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the most challenging factors related to masked face age and gender identification (MFAGI) is developing a technique to quickly carry out identification and maintain accuracy without needing people to remove their masks. The eyes, forehead and important frontal features including the ears were the main focus of this investigation. In this study, we evaluated and compared ten (10) different MFAGI techniques, which include traditional methods such as MobileNet, MobileNetV2, ResNet101, DenseNet169, DenseNet201, EfficientNetB0, ResNet152V2, InceptionV3, Xception and our one proposed approach. These 10 models were used to classify masked faces of people among sixteen (16) classes. Combining the convolutional architecture of fast feature embedding (CAFFE) with the modified MobileNetV2 (MNV2) model developed a novel method known as the "CMNV2"model. To achieve the goal of model performance and classification accuracy for MFAGI of people's faces, this work introduces a unique CMNV2 model by developing a pre -trained model with eight (8) different layers. Using deep learning (DL) and a transfer learning approach, we developed a unique novel approach to image feature extraction that outperforms the nine (9) traditional methods for masked face classification (MFC), masked face age identification (MFAI) and masked face gender identification (MFGI). This approach developed a Python model that was trained and evaluated on 12,160 masked face images. This study demonstrates that an efficient CMNV2 method can be achieved by combining transfer learning with deep neural network (DNN) development. This proposed CMNV2 model achieved 96.54% accuracy and 3.46% error rate with less parameters and computational time exceeding the other 9 different traditional masked identification methods. It also shows that our proposed CMNV2 strategy is more successful than the other 9 models and can identify masked people's faces age and gender in photo and real-time video images. Overall, the results of this research indicate that DL methods have the capability to improve the accuracy and speed with which masked face classification and identification is performed. The artificially masked faces of images dataset created by us utilized in this work is publicly made available on the Kaggle website https: //www.kaggle.com/datasets/banilkumar20phd7071/masked-face-age-and-gender-identify-artificial-masking.
引用
收藏
页数:25
相关论文
共 13 条
  • [1] Face Mask Detection on Photo and Real-Time Video Images Using Caffe-MobileNetV2 Transfer Learning
    Kumar, B. Anil
    Bansal, Mohan
    APPLIED SCIENCES-BASEL, 2023, 13 (02):
  • [2] An Integrated Approach for Real-Time Gender and Age Classification in Video Inputs Using FaceNet and Deep Learning Techniques
    Nazare, Abhishek
    Padmannavar, Sunita
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (07) : 1152 - 1159
  • [3] Brain Tumor Classification Using VGG-16 and MobileNetV2 Deep Learning Techniques on Magnetic Resonance Images (MRI)
    Saini, Rashmi
    Semwal, Prabhakar
    Jaware, Tushar Hrishikesh
    SOFT COMPUTING AND ITS ENGINEERING APPLICATIONS, ICSOFTCOMP 2022, 2023, 1788 : 300 - 313
  • [4] Real-time masked face recognition using deep learning-based double generator network
    Sumathy, G.
    Usha, M.
    Rajakumar, S.
    Jayapriya, P.
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (SUPPL 1) : 325 - 334
  • [5] Real-time Traffic Analysis Using Deep Learning Techniques And UAV Based Video
    Zhang, Huaizhong
    Liptrott, Mark
    Bessis, Nik
    Cheng, Jianquan
    2019 16TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), 2019,
  • [6] Real-Time Video Based Face Identification Using Fast Sparse Representation and Incremental Learning
    Karuppusamy, Selvakumar
    Jerome, Jovitha
    ADVANCES IN SIGNAL PROCESSING AND INTELLIGENT RECOGNITION SYSTEMS, 2014, 264 : 33 - 44
  • [7] Real-time identification of plant diseases using aerial robots and deep learning techniques
    Maski, Prajwal
    Panigrahi, Siddhant
    Azad, Abhinav
    Thondiyath, Asokan
    2023 21ST INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS, ICAR, 2023, : 480 - 485
  • [8] Protocol to analyze fundus images for multidimensional quality grading and real-time guidance using deep learning techniques
    Liu, Lixue
    Li, Mingyuan
    Lin, Duoru
    Yun, Dongyuan
    Lin, Zhenzhe
    Zhao, Lanqin
    Pang, Jianyu
    Li, Longhui
    Wu, Yuxuan
    Shang, Yuanjun
    Lin, Haotian
    Wu, Xiaohang
    STAR PROTOCOLS, 2023, 4 (04):
  • [9] Identifying temporary water bodies from drone images at real-time using deep-learning techniques
    Hieu Minh Truong
    Clavel, Manuel
    2022 INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING AND ANALYTICS (ACOMPA), 2022, : 12 - 19
  • [10] Assessing the ability of deep learning techniques to perform real-time identification of shark species in live streaming video from drones
    Purcell, Cormac R.
    Walsh, Andrew J.
    Colefax, Andrew P.
    Butcher, Paul
    FRONTIERS IN MARINE SCIENCE, 2022, 9