Wide Range Head Pose Estimation Using a Single RGB Camera for Intelligent Surveillance

被引:12
|
作者
Rahmaniar, Wahyu [1 ]
ul Haq, Qazi Mazhar [1 ]
Lin, Ting-Lan [1 ,2 ]
机构
[1] Natl Taipei Univ Technol, Dept Elect Engn, Taipei 10608, Taiwan
[2] Chung Yuan Christian Univ, Dept Elect Engn, Taoyuan 320314, Taiwan
关键词
Head; Pose estimation; Feature extraction; Three-dimensional displays; Magnetic heads; Deep learning; Real-time systems; CNN; coarse-fine classification; deep learning; Euler angle; head pose estimation; intelligent surveillance;
D O I
10.1109/JSEN.2022.3168863
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Head pose estimation is one of the sensing systems needed for some intelligent surveillance, such as human behavior analysis, intelligent driver assistance, visual attention, and monitoring. These systems require accurate alignment and head movement direction prediction. The previous methods are greatly dependent on the facial landmarks and depth information. Usually, the head pose is measured by estimating several keypoints that require a correct head pose mapping to get accurate results. Moreover, facial landmarks have a detrimental effect on performance when the face is occluded or not adequately visualized. This paper proposes a method for head pose estimation of various facial conditions, such as occlusion and challenging viewpoints. We present a combination of coarse and fine feature maps classification to train a multi-loss deep Convolutional Neural Networks (CNN) to get precise Euler angles (yaw, pitch, roll) of the head position without keypoints and landmarks. Our proposed method uses more quantization units for angle classification to learn coarse and fine structure mapping for better spatial clustering features on an RGB image of a single camera. The experiments are performed on benchmark datasets and some head poses in real cases. The mean average error of prediction is 5.06 degrees, 4.06 degrees, and 2.96 degrees, for the AFLW2000, AFLW, and BIWI datasets, which significantly improves the head pose estimation performance compared to the previous methods. Additionally, the proposed method outperforms previous approaches in computation time of 11 frames per second that is beneficial for real-life applications.
引用
收藏
页码:11112 / 11121
页数:10
相关论文
共 50 条
  • [21] 3D Pose Estimation of Daily Objects Using an RGB-D Camera
    Choi, Changhyun
    Christensen, Henrik I.
    2012 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2012, : 3342 - 3349
  • [22] Robust 3D head mracking using camera pose estimation
    Ohayon, Shay
    Rivlin, Ehud
    18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2006, : 1063 - +
  • [23] SINGLE VIEW HEAD POSE ESTIMATION
    Martins, Pedro
    Batista, Jorge
    2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5, 2008, : 1652 - 1655
  • [24] Review of Intelligent Video Surveillance with Single Camera
    Liu, Ying
    Fan, Jiu-lun
    Wang, DianWei
    FOURTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2011): MACHINE VISION, IMAGE PROCESSING, AND PATTERN ANALYSIS, 2012, 8349
  • [25] 3D Head pose estimation and camera mouse implementation using a monocular video camera
    Nabati, Masoomeh
    Behrad, Alireza
    SIGNAL IMAGE AND VIDEO PROCESSING, 2015, 9 (01) : 39 - 44
  • [26] 3D Head pose estimation and camera mouse implementation using a monocular video camera
    Masoomeh Nabati
    Alireza Behrad
    Signal, Image and Video Processing, 2015, 9 : 39 - 44
  • [27] 3-D Canonical Pose Estimation and Abnormal Gait Recognition With a Single RGB-D Camera
    Guo, Yao
    Deligianni, Fani
    Gu, Xiao
    Yang, Guang-Zhong
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (04): : 3617 - 3624
  • [28] A practical framework of multi-person 3D human pose estimation with a single RGB camera
    Ma, Le
    Lian, Sen
    Wang, Shandong
    Meng, Weiliang
    Xiao, Jun
    Zhang, Xiaopeng
    2021 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS (VRW 2021), 2021, : 420 - 421
  • [29] Visual surveillance using wide-angle camera and laser range finder
    Song, T. -H.
    Ha, J. -E.
    ELECTRONICS LETTERS, 2016, 52 (06) : 445 - 446
  • [30] Wide Range Time of Flight Camera for Outdoor Surveillance
    Falie, D.
    Buzuloiu, V.
    MRRS: 2008 MICROWAVES, RADAR AND REMOTE SENSING SYMPOSIUM, PROCEEDINGS, 2008, : 79 - 82