High-Precision and Lightweight Facial Landmark Detection Algorithm

被引:0
|
作者
Xu Lihuai [1 ]
Li Zhe [2 ]
Jiang Jiajia [1 ]
Duan Fajie [1 ]
Fu Xiao [1 ]
机构
[1] Tianjin Univ, State Key Lab Precis Measuring Technol & Instrume, Tianjin 300072, Peoples R China
[2] Chinese Acad Sci, Inst Deep Sea Sci & Engn, Sanya 572000, Hainan, Peoples R China
关键词
image processing; convolution neural networks; facial landmark detection algorithm; knowledge distillation; model optimization; lightweight network; NETWORK;
D O I
10.3788/LOP57.241026
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In view of the high complexity of the current facial landmark detection algorithm network model, which is not conducive to deployment on devices with limited computing resources, this paper proposes a high-precision and lightweight facial landmark detection algorithm based on the idea of knowledge distillation. This algorithm improves the Bottleneck module of residual network(ResNet50) and introduces packet deconvolution to obtain a lightweight student network. At the same time, a pixel-wise loss function and a pair-wise loss function are proposed. By aligning the output feature maps and intermediate feature maps of the teacher network and the student network, the prior knowledge of the teacher network is transferred to the student network, thereby improving the detection accuracy of the student network. Experiments show that the student network obtained by this algorithm has only 2.81 M parameter amount and 10. 20 MB model size, the frames per second on the GTX1080 graphics card is 162 frames and the normalized mean error on 300W and WFLW datasets are 3.60% and 5.50%, respectively.
引用
收藏
页数:7
相关论文
共 22 条
  • [1] Robust face landmark estimation under occlusion
    Burgos-Artizzu, Xavier P.
    Perona, Pietro
    Dollar, Piotr
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 1513 - 1520
  • [2] Supervision-by-Registration: An Unsupervised Approach to Improve the Precision of Facial Landmark Detectors
    Dong, Xuanyi
    Yu, Shoou-, I
    Weng, Xinshuo
    Wei, Shih-En
    Yang, Yi
    Sheikh, Yaser
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 360 - 368
  • [3] Style Aggregated Network for Facial Landmark Detection
    Dong, Xuanyi
    Yan, Yan
    Ouyang, Wanli
    Yang, Yi
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 379 - 388
  • [4] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [5] Hinton G., 2019, DISTILLING KNOWLEDGE
  • [6] Komodakis, 2019, PAYING MORE ATTENTIO
  • [7] Deep Alignment Network: A convolutional neural network for robust face alignment
    Kowalski, Marek
    Naruniec, Jacek
    Trzcinski, Tomasz
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 2034 - 2043
  • [8] Disentangling 3D Pose in A Dendritic CNN for Unconstrained 2D Face Alignment
    Kumar, Amit
    Chellappa, Rama
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 430 - 439
  • [9] Structured Knowledge Distillation for Semantic Segmentation
    Liu, Yifan
    Chen, Ke
    Liu, Chris
    Qin, Zengchang
    Luo, Zhenbo
    Wang, Jingdong
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 2599 - 2608
  • [10] Pose-Aware Face Recognition in the Wild
    Masi, Iacopo
    Rawls, Stephen
    Medioni, Gerard
    Natarajan, Prem
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 4838 - 4846