Enhanced Gaze Following via Object Detection and Human Pose Estimation

被引：13
|
作者：
Guan, Jian [1 ]
Yin, Liming [2 ]
Sun, Jianguo [1 ]
Qi, Shuhan [2 ]
Wang, Xuan [2 ]
Liao, Qing [2 ,3 ]
机构：
[1] Harbin Engn Univ, Coll Comp Sci & Technol, Harbin 150001, Peoples R China
[2] Harbin Inst Technol Shenzhen, Dept Comp Sci & Technol, Shenzhen 518055, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518000, Peoples R China
来源：
MULTIMEDIA MODELING (MMM 2020), PT II | 2020年 / 11962卷
关键词：
Gaze following; Objection detection; Human pose estimation; Deep neural network;
D O I：
10.1007/978-3-030-37734-2_41
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
The aim of gaze following is to estimate the gaze direction, which is useful for the understanding of human behaviour in various applications. However, it is still an open problem that has not been fully studied. In this paper, we present a novel framework for gaze following problem, where both the front/side face case and the back face case are taken into account. For the front/side face case, head pose estimation is applied to estimate the gaze, and then object detection is used to further refine the gaze direction by selecting the object that intersects with the gaze in a certain range. For the back face case, a deep neural network with the human pose information is proposed for gaze estimation. Experiments are carried out to demonstrate the superiority of the proposed method, as compared with the state-of-the-art method.
引用
下载
收藏
页码：502 / 513
页数：12
相关论文
共 50 条
  • [21] Planar Pose Estimation Using Object Detection and Reinforcement Learning
    Rasmussen, Frederik Norby
    Andersen, Sebastian Terp
    Grossmann, Bjarne
    Boukas, Evangelos
    Nalpantidis, Lazaros
    COMPUTER VISION SYSTEMS (ICVS 2019), 2019, 11754 : 353 - 365
  • [22] Real-Time Pose Estimation Piggybacked on Object Detection
    Juranek, Roman
    Herout, Adam
    Dubska, Marketa
    Zemcik, Pavel
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 2381 - 2389
  • [23] Viewpoint-aware object detection and continuous pose estimation
    Glasner, Daniel
    Galun, Meirav
    Alpert, Sharon
    Basri, Ronen
    Shakhnarovich, Gregory
    IMAGE AND VISION COMPUTING, 2012, 30 (12) : 923 - 933
  • [24] Pose-RCNN: Joint Object Detection and Pose Estimation Using 3D Object Proposals
    Braun, Markus
    Rao, Qing
    Wang, Yikang
    Flohr, Fabian
    2016 IEEE 19TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2016, : 1546 - 1551
  • [25] RNNPose: 6-DoF Object Pose Estimation via Recurrent Correspondence Field Estimation and Pose Optimization
    Xu, Yan
    Lin, Kwan-Yee
    Zhang, Guofeng
    Wang, Xiaogang
    Li, Hongsheng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (07) : 4669 - 4683
  • [26] Pose estimation based on human detection and segmentation
    Chen Qiang
    Zheng EnLiang
    Liu YunCai
    SCIENCE IN CHINA SERIES F-INFORMATION SCIENCES, 2009, 52 (02): : 244 - 251
  • [27] Pose estimation based on human detection and segmentation
    CHEN Qiang
    Science China(Information Sciences), 2009, (02) : 244 - 251
  • [28] Pose estimation based on human detection and segmentation
    CHEN QiangZHENG EnLiang LIU YunCai Institute of Image Processing and Pattern RecognitionShanghai Jiao Tong UniversityShanghai China
    Science in China(Series F:Information Sciences), 2009, 52 (02) : 244 - 251
  • [29] Pose estimation based on human detection and segmentation
    Qiang Chen
    EnLiang Zheng
    YunCai Liu
    Science in China Series F: Information Sciences, 2009, 52 : 244 - 251
  • [30] Detection of head pose and gaze direction for human-computer interaction
    Weidenbacher, Ulrich
    Layher, Georg
    Bayerl, Pierre
    Neumann, Heiko
    PERCEPTION AND INTERACTIVE TECHNOLOGIES, PROCEEDINGS, 2006, 4021 : 9 - 19
12345