An Effective Deep Network for Head Pose Estimation without Keypoints

被引:0
|
作者
Thai, Chien [1 ]
Tran, Viet [1 ]
Bui, Minh [1 ]
Ninh, Huong [1 ]
Tran, Hai [1 ]
机构
[1] Viettel Aerosp Inst, Optoelect Ctr, Comp Vis Dept, Hanoi, Vietnam
关键词
Head Pose Estimation; Knowledge Distillation; Convolutional Neural Network; SUPPORT VECTOR MACHINES; FACE; CASCADE;
D O I
10.5220/0010870900003122
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human head pose estimation is an essential problem in facial analysis in recent years that has a lot of computer vision applications such as gaze estimation, virtual reality, driver assistance. Because of the importance of the head pose estimation problem, it is necessary to design a compact model to resolve this task in order to reduce the computational cost when deploying on facial analysis-based applications such as large camera surveillance systems, AI cameras while maintaining accuracy. In this work, we propose a lightweight model that effectively addresses the head pose estimation problem. Our approach has two main steps. 1) We first train many teacher models on the synthesis dataset - 300W-LPA to get the head pose pseudo labels. 2) We design an architecture with the ResNet18 backbone and train our proposed model with the ensemble of these pseudo labels via the knowledge distillation process. To evaluate the effectiveness of our model, we use AFLW-2000 and BIWI - two real-world head pose datasets. Experimental results show that our proposed model significantly improves the accuracy in comparison with the state-of-the-art head pose estimation methods. Furthermore, our model has the real-time speed of similar to 300 FPS when inferring on Tesla V100.
引用
收藏
页码:90 / 98
页数:9
相关论文
共 50 条
  • [1] Fine-Grained Head Pose Estimation Without Keypoints
    Ruiz, Nataniel
    Chong, Eunji
    Rehg, James M.
    PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 2155 - 2164
  • [2] Multiple Teacher Knowledge Distillation for Head Pose Estimation Without Keypoints
    Thai C.
    Nham N.
    Tran V.
    Bui M.
    Ninh H.
    Tran H.
    SN Computer Science, 4 (6)
  • [3] Lightweight head pose estimation without keypoints based on multi-scale lightweight neural network
    Xiaolei Chen
    Yubing Lu
    Baoning Cao
    Dongmei Lin
    Ishfaq Ahmad
    The Visual Computer, 2023, 39 (6) : 2455 - 2469
  • [4] Lightweight head pose estimation without keypoints based on multi-scale lightweight neural network
    Chen, Xiaolei
    Lu, Yubing
    Cao, Baoning
    Lin, Dongmei
    Ahmad, Ishfaq
    VISUAL COMPUTER, 2023, 39 (06): : 2455 - 2469
  • [5] NOSE, EYES AND EARS: HEAD POSE ESTIMATION BY LOCATING FACIAL KEYPOINTS
    Gupta, Aryaman
    Thakkar, Kalpit
    Gandhi, Vineet
    Narayanan, P. J.
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 1977 - 1981
  • [6] Multiclass classification based on a deep convolutional network for head pose estimation
    Ying Cai
    Meng-long Yang
    Jun Li
    Frontiers of Information Technology & Electronic Engineering, 2015, 16 : 930 - 939
  • [7] Multiclass classification based on a deep convolutional network for head pose estimation
    Cai, Ying
    Yang, Meng-long
    Li, Jun
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2015, 16 (11) : 930 - 939
  • [8] TinyPoseNet: A Fast and Compact Deep Network for Robust Head Pose Estimation
    Li, Shanru
    Wang, Liping
    Yang, Shuang
    Wang, Yuanquan
    Wang, Chongwen
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT II, 2017, 10635 : 53 - 63
  • [9] Complex Human Pose Estimation via Keypoints Association Constraint Network
    Zhu, Xuan
    Guo, Zhenpeng
    Liu, Xin
    Li, Bin
    Peng, Jinye
    Chen, Peirong
    Wang, Rongzhi
    IEEE ACCESS, 2020, 8 : 205938 - 205947
  • [10] Hybrid Deep Convolutional Network for Face Alignment and Head Pose Estimation
    Wang, Zhiyong
    Liu, Jingjing
    Liu, Honghai
    INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2022), PT II, 2022, 13456 : 513 - 522