A Head Pose-free Approach for Appearance-based Gaze Estimation

被引:26
|
作者
Lu, Feng [1 ]
Okabe, Takahiro [1 ]
Sugano, Yusuke [1 ]
Sato, Yoichi [1 ]
机构
[1] Univ Tokyo, Inst Ind Sci, Tokyo, Japan
关键词
TRACKING TECHNIQUES;
D O I
10.5244/C.25.126
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To infer human gaze from eye appearance, various methods have been proposed. However, most of them assume a fixed head pose because allowing free head motion adds 6 degrees of freedom to the problem and requires a prohibitively large number of training samples. In this paper, we aim at solving the appearance-based gaze estimation problem under free head motion without significantly increasing the cost of training. The idea is to decompose the problem into subproblems, including initial estimation under fixed head pose and subsequent compensations for estimation biases caused by head rotation and eye appearance distortion. Then each subproblem is solved by either learning-based method or geometric-based calculation. Specifically, the gaze estimation bias caused by eye appearance distortion is learnt effectively from a 5-seconds video clip. Extensive experiments were conducted to verify the effectiveness of the proposed approach.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Head Pose-Free Appearance-Based Gaze Sensing via Eye Image Synthesis
    Lu, Feng
    Sugano, Yusuke
    Okabe, Takahiro
    Sato, Yoichi
    [J]. 2012 21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012), 2012, : 1008 - 1011
  • [2] Learning gaze biases with head motion for head pose-free gaze estimation
    Lu, Feng
    Okabe, Takahiro
    Sugano, Yusuke
    Sato, Yoichi
    [J]. IMAGE AND VISION COMPUTING, 2014, 32 (03) : 169 - 179
  • [3] A Deep Learning Approach to Appearance-Based Gaze Estimation under Head Pose Variations
    Sun, Hsin-Pei
    Yang, Cheng-Hsun
    Lai, Shang-Hong
    [J]. PROCEEDINGS 2017 4TH IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), 2017, : 935 - 940
  • [4] Head pose-free gaze estimation using domain adaptation
    Ahn, Byungtae
    Seo, Minseok
    Choi, Dong-Geol
    [J]. ELECTRONICS LETTERS, 2021, 57 (16) : 618 - 620
  • [5] Model-based head pose-free gaze estimation for assistive communication
    Cristina, Stefania
    Camilleri, Kenneth P.
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2016, 149 : 157 - 170
  • [6] Gaze Estimation From Eye Appearance: A Head Pose-Free Method via Eye Image Synthesis
    Lu, Feng
    Sugano, Yusuke
    Okabe, Takahiro
    Sato, Yoichi
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (11) : 3680 - 3693
  • [7] Free-Head Appearance-Based Eye Gaze Estimation on Mobile Devices
    Jigang, Liu
    Lee, Bu Sung
    Rajan, Deepu
    [J]. 2019 1ST INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE IN INFORMATION AND COMMUNICATION (ICAIIC 2019), 2019, : 232 - 237
  • [8] Appearance-based Gaze Tracking with Free Head Movement
    Lai, Chih-Chuan
    Chen, Yu-Ting
    Chen, Kuan-Wen
    Chen, Shen-Chi
    Shih, Sheng-Wen
    Hung, Yi-Ping
    [J]. 2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 1869 - 1873
  • [9] Appearance-based gaze estimation under slight head motion
    Guo, Zhizhi
    Zhou, Qianxiang
    Liu, Zhongqi
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (02) : 2203 - 2222
  • [10] Appearance-based gaze estimation under slight head motion
    Zhizhi Guo
    Qianxiang Zhou
    Zhongqi Liu
    [J]. Multimedia Tools and Applications, 2017, 76 : 2203 - 2222