Appearance-Based Gaze Estimation Using Dilated-Convolutions

被引:53
|
作者
Chen, Zhaokang [1 ]
Shi, Bertram E. [1 ]
机构
[1] Hong Kong Univ Sci & Technol, Kowloon, Hong Kong, Peoples R China
来源
关键词
Appearance-based gaze estimation; Dilated-convolutions;
D O I
10.1007/978-3-030-20876-9_20
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Appearance-based gaze estimation has attracted more and more attention because of its wide range of applications. The use of deep convolutional neural networks has improved the accuracy significantly. In order to improve the estimation accuracy further, we focus on extracting better features from eye images. Relatively large changes in gaze angles may result in relatively small changes in eye appearance. We argue that current architectures for gaze estimation may not be able to capture such small changes, as they apply multiple pooling layers or other downsampling layers so that the spatial resolution of the high-level layers is reduced significantly. To evaluate whether the use of features extracted at high resolution can benefit gaze estimation, we adopt dilated-convolutions to extract high-level features without reducing spatial resolution. In cross-subject experiments on the Columbia Gaze dataset for eye contact detection and the MPIIGaze dataset for 3D gaze vector regression, the resulting Dilated-Nets achieve significant (up to 20.8%) gains when compared to similar networks without dilated-convolutions. Our proposed Dilated-Net achieves state-of-the-art results on both the Columbia Gaze and the MPIIGaze datasets.
引用
收藏
页码:309 / 324
页数:16
相关论文
共 50 条
  • [1] Appearance-based Gaze Estimation using Kinect
    Choi, Jinsoo
    Ahn, Byungtae
    Park, Jaesik
    Kweon, In So
    [J]. 2013 10TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS AND AMBIENT INTELLIGENCE (URAI), 2013, : 260 - 261
  • [2] Appearance-Based Gaze Estimation Using Visual Saliency
    Sugano, Yusuke
    Matsushita, Yasuyuki
    Sato, Yoichi
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (02) : 329 - 341
  • [3] Appearance-based eye gaze estimation
    Tan, KH
    Kriegman, DJ
    Ahuja, N
    [J]. SIXTH IEEE WORKSHOP ON APPLICATIONS OF COMPUTER VISION, PROCEEDINGS, 2002, : 191 - 195
  • [4] Appearance-Based Gaze Estimation in the Wild
    Zhang, Xucong
    Sugano, Yusuke
    Fritz, Mario
    Bulling, Andreas
    [J]. 2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 4511 - 4520
  • [5] Gaze-Net: Appearance-Based Gaze Estimation using Capsule Networks
    Mahanama, Bhanuka
    Jayawardana, Yasith
    Jayarathna, Sampath
    [J]. AUGMENTED HUMAN 2020: PROCEEDINGS OF THE 11TH AUGMENTED HUMAN INTERNATIONAL CONFERENCE, 2020,
  • [6] Appearance-based Gaze Estimation using Attention and Difference Mechanism
    Murthy, L. R. D.
    Biswas, Pradipta
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 3137 - 3146
  • [7] Appearance-Based Gaze Estimation for ASD Diagnosis
    Li, Jing
    Chen, Zejin
    Zhong, Yihao
    Lam, Hak-Keung
    Han, Junxia
    Ouyang, Gaoxiang
    Li, Xiaoli
    Liu, Honghai
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (07) : 6504 - 6517
  • [8] Appearance-Based Gaze Estimation for Driver Monitoring
    Nikan, Soodeh
    Upadhyay, Devesh
    [J]. GAZE MEETS MACHINE LEARNING WORKSHOP, VOL 210, 2022, 210 : 127 - 139
  • [9] Revisiting Data Normalization for Appearance-Based Gaze Estimation
    Zhang, Xucong
    Sugano, Yusuke
    Bulling, Andreas
    [J]. 2018 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS (ETRA 2018), 2018,
  • [10] Offset Calibration for Appearance-Based Gaze Estimation via Gaze Decomposition
    Chen, Zhaokang
    Shi, Bertram E.
    [J]. 2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 259 - 268