Unsupervised Learning of Eye Gaze Representation from the Web

被引:11
|
作者
Dubey, Neeru [1 ]
Ghosh, Shreya [1 ]
Dhall, Abhinav [1 ]
机构
[1] Indian Inst Technol Ropar, Dept Comp Sci & Engn, Learning Affect & Semant Image Anal LASII Grp, Ropar, India
关键词
D O I
10.1109/ijcnn.2019.8851961
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic eye gaze estimation has interested researchers for a while now. In this paper, we propose an unsupervised learning based method for estimating the eye gaze region. To train the proposed network "Ize-Net" in self-supervised manner, we collect a large 'in the wild' dataset containing 1,54,251 images from the web. For the images in the database, we divide the gaze into three regions based on an automatic technique based on pupil-centers localization and then use a feature-based technique to determine the gaze region. The performance is evaluated on the Tablet Gaze and CAVE datasets by fine-tuning results of Ize-Net for the task of eye gaze estimation. The feature representation learned is also used to train traditional machine learning algorithms for eye gaze estimation. The results demonstrate that the proposed method learns a rich data representation, which can be efficiently fine-tuned for any eye gaze estimation dataset.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Unsupervised Representation Learning for Gaze Estimation
    Yu, Yu
    Odobez, Jean-Marc
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 7312 - 7322
  • [2] Unsupervised Multi-View Gaze Representation Learning
    Gideon, John
    Su, Shan
    Stent, Simon
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 4997 - 5005
  • [3] Cross-Encoder for Unsupervised Gaze Representation Learning
    Sun, Yunjia
    Zeng, Jiabei
    Shan, Shiguang
    Chen, Xilin
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 3682 - 3691
  • [4] Unsupervised Domain Adaptation for Learning Eye Gaze from a Million Synthetic Images: An Adversarial Approach
    Lahiri, Avisek
    Agarwalla, Abhinav
    Biswas, Prabir Kumar
    [J]. ELEVENTH INDIAN CONFERENCE ON COMPUTER VISION, GRAPHICS AND IMAGE PROCESSING (ICVGIP 2018), 2018,
  • [5] Federated unsupervised representation learning
    Zhang, Fengda
    Kuang, Kun
    Chen, Long
    You, Zhaoyang
    Shen, Tao
    Xiao, Jun
    Zhang, Yin
    Wu, Chao
    Wu, Fei
    Zhuang, Yueting
    Li, Xiaolin
    [J]. FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2023, 24 (08) : 1181 - 1193
  • [6] Continual Unsupervised Representation Learning
    Rao, Dushyant
    Visin, Francesco
    Rusu, Andrei A.
    Teh, Yee Whye
    Pascanu, Razvan
    Hadsell, Raia
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [7] Learning Sense Representation from Word Representation for Unsupervised Word Sense Disambiguation
    Wang, Jie
    Fu, Zhenxin
    Li, Moxin
    Zhang, Haisong
    Zhao, Dongyan
    Yan, Rui
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 13947 - 13948
  • [8] Contrastive Representation Learning for Gaze Estimation
    Jindal, Swati
    Manduchi, Roberto
    [J]. GAZE MEETS MACHINE LEARNING WORKSHOP, VOL 210, 2022, 210 : 37 - +
  • [9] The Myth of the innocent Eye and the Power of the Representation of the Gaze in Culture
    Uzelac, Sonja Briski
    [J]. ARS ADRIATICA, 2015, (05) : 203 - 210
  • [10] Collaborative Unsupervised Visual Representation Learning from Decentralized Data
    Zhuang, Weiming
    Gan, Xin
    Wen, Yonggang
    Zhang, Shuai
    Yi, Shuai
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4892 - 4901