Unsupervised Learning of Eye Gaze Representation from the Web

被引:11
|
作者
Dubey, Neeru [1 ]
Ghosh, Shreya [1 ]
Dhall, Abhinav [1 ]
机构
[1] Indian Inst Technol Ropar, Dept Comp Sci & Engn, Learning Affect & Semant Image Anal LASII Grp, Ropar, India
关键词
D O I
10.1109/ijcnn.2019.8851961
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic eye gaze estimation has interested researchers for a while now. In this paper, we propose an unsupervised learning based method for estimating the eye gaze region. To train the proposed network "Ize-Net" in self-supervised manner, we collect a large 'in the wild' dataset containing 1,54,251 images from the web. For the images in the database, we divide the gaze into three regions based on an automatic technique based on pupil-centers localization and then use a feature-based technique to determine the gaze region. The performance is evaluated on the Tablet Gaze and CAVE datasets by fine-tuning results of Ize-Net for the task of eye gaze estimation. The feature representation learned is also used to train traditional machine learning algorithms for eye gaze estimation. The results demonstrate that the proposed method learns a rich data representation, which can be efficiently fine-tuned for any eye gaze estimation dataset.
引用
收藏
页数:7
相关论文
共 50 条
  • [31] Visual representation of eye gaze is coded by a nonopponent multichannel system
    Calder, Andrew J.
    Jenkins, Rob
    Cassel, Anneli
    Clifford, Colin W. G.
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2008, 137 (02) : 244 - 261
  • [32] Attractive Eye: Augmented Gaze Representation for "What is the robot looking at?"
    Yamaguchi, Tomoyuki
    Hashimoto, Shuji
    [J]. ICRA: 2009 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-7, 2009, : 3703 - 3708
  • [33] Analyzing Eye Gaze of Users with Learning Disability
    Saluja, Kamalpreet Singh
    Dv, JeevithaShree
    Arjun, Somnath
    Biswas, Pradipta
    Paul, Teena
    [J]. ICGSP '19 - PROCEEDINGS OF THE 2019 3RD INTERNATIONAL CONFERENCE ON GRAPHICS AND SIGNAL PROCESSING, 2019, : 95 - 99
  • [34] Unsupervised Object-Level Representation Learning from Scene Images
    Xie, Jiahao
    Zhan, Xiaohang
    Liu, Ziwei
    Ong, Yew Soon
    Loy, Chen Change
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021,
  • [35] Learning unsupervised node representation from multi-view network
    Wang, Chen
    Chen, Xiaojun
    Chen, Bingkun
    Nie, Feiping
    Wang, Bo
    Ming, Zhong
    [J]. INFORMATION SCIENCES, 2021, 579 : 700 - 716
  • [36] Low Cost Eye Gaze Tracker Using Web Camera
    Mounica, M. Sai
    Manvita, M.
    Jyotsna, C.
    Amudha, J.
    [J]. PROCEEDINGS OF THE 2019 3RD INTERNATIONAL CONFERENCE ON COMPUTING METHODOLOGIES AND COMMUNICATION (ICCMC 2019), 2019, : 79 - 85
  • [37] Unsupervised Learning of a Scene-Specific Coarse Gaze Estimator
    Benfold, Ben
    Reid, Ian
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2011, : 2344 - 2351
  • [38] Representation Learning for the Semantic Web
    Paulheim, Heiko
    Tresp, Volker
    Liu, Zhiyuan
    [J]. JOURNAL OF WEB SEMANTICS, 2020, 61-62
  • [39] EM-Gaze: eye context correlation and metric learning for gaze estimation
    Zhou, Jinchao
    Li, Guoan
    Shi, Feng
    Guo, Xiaoyan
    Wan, Pengfei
    Wang, Miao
    [J]. VISUAL COMPUTING FOR INDUSTRY BIOMEDICINE AND ART, 2023, 6 (01)
  • [40] Lovasz Principle for Unsupervised Graph Representation Learning
    Sun, Ziheng
    Ding, Chris
    Fan, Jicong
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,