Iris Geometric Transformation Guided Deep Appearance-Based Gaze Estimation

被引:0
|
作者
Nie, Wei [1 ]
Wang, Zhiyong [1 ]
Ren, Weihong [1 ]
Zhang, Hanlin [1 ]
Liu, Honghai [1 ,2 ]
机构
[1] Harbin Inst Technol Shenzhen, State Key Lab Robot & Syst, Shenzhen 518055, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518000, Peoples R China
基金
中国国家自然科学基金;
关键词
Estimation; Iris; Artificial neural networks; Three-dimensional displays; Feature extraction; Faces; Multitasking; Training; Heating systems; Vectors; Appearance-based gaze estimation; deep learning; geometric priors; eye landmarks; EYE; VISION;
D O I
10.1109/TIP.2025.3546465
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The geometric alterations in the iris's appearance are intricately linked to the gaze direction. However, current deep appearance-based gaze estimation methods mainly rely on latent feature sharing to leverage iris features for improving deep representation learning, often neglecting the explicit modeling of their geometric relationships. To address this issue, this paper revisits the physiological structure of the eyeball and introduces a set of geometric assumptions, such as "the normal vector of the iris center approximates the gaze direction". Building on these assumptions, we propose an Iris Geometric Transformation Guided Gaze estimation (IGTG-Gaze) module, which establishes an explicit geometric parameter sharing mechanism to link gaze direction and sparse iris landmark coordinates directly. Extensive experimental results demonstrate that IGTG-Gaze seamlessly integrates into various deep neural networks, flexibly extends from sparse iris landmarks to dense eye mesh, and consistently achieves leading performance in both within- and cross-dataset evaluations, all while maintaining end-to-end optimization. These advantages highlight IGTG-Gaze as a practical and effective approach for enhancing deep gaze representation from appearance.
引用
收藏
页码:1616 / 1631
页数:16
相关论文
共 50 条
  • [31] A Coarse-to-Fine Adaptive Network for Appearance-Based Gaze Estimation
    Cheng, Yihua
    Huang, Shiyao
    Wang, Fei
    Qian, Chen
    Lu, Feng
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 10623 - 10630
  • [32] Distraction Detection in Automotive Environment using Appearance-based Gaze Estimation
    Murthy, L. R. D.
    Mukhopadhyay, Abhishek
    Biswas, Pradipta
    COMPANION PROCEEDINGS OF THE 27TH INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES, IUI 2022 COMPANION, 2022, : 38 - 41
  • [33] Appearance-Based Gaze Estimation With Online Calibration From Mouse Operations
    Sugano, Yusuke
    Matsushita, Yasuyuki
    Sato, Yoichi
    Koike, Hideki
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2015, 45 (06) : 750 - 760
  • [34] Learning to Personalize in Appearance-Based Gaze Tracking
    Linden, Erik
    Sjortrand, Jonas
    Proutiere, Alexandre
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 1140 - 1148
  • [35] Learning-by-Synthesis for Appearance-based 3D Gaze Estimation
    Sugano, Yusuke
    Matsushita, Yasuyuki
    Sato, Yoichi
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 1821 - 1828
  • [36] Appearance-Based Gaze Estimation as a Benchmark for Eye Image Data Generation Methods
    Katrychuk, Dmytro
    Komogortsev, Oleg V.
    APPLIED SCIENCES-BASEL, 2024, 14 (20):
  • [37] Free-Head Appearance-Based Eye Gaze Estimation on Mobile Devices
    Jigang, Liu
    Lee, Bu Sung
    Rajan, Deepu
    2019 1ST INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE IN INFORMATION AND COMMUNICATION (ICAIIC 2019), 2019, : 232 - 237
  • [38] Appearance-based Gaze Estimation with Multi-Modal Convolutional Neural Networks
    Wang, Fei
    Wang, Yan
    Li, Teng
    INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE AND ROBOTICS 2021, 2021, 11884
  • [39] TabletGaze: dataset and analysis for unconstrained appearance-based gaze estimation in mobile tablets
    Huang, Qiong
    Veeraraghavan, Ashok
    Sabharwal, Ashutosh
    MACHINE VISION AND APPLICATIONS, 2017, 28 (5-6) : 445 - 461
  • [40] Appearance-Based Gaze Tracking: A Brief Review
    Jiang, Jiaqi
    Zhou, Xiaolong
    Chan, Sixian
    Chen, Shengyong
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PART VI, 2019, 11745 : 629 - 640