A Method for Accurate 3-D Gaze Estimation With a Single Camera and Two Collinear Light Sources

被引:3
|
作者
Liu, Jiahui [1 ]
Chi, Jiannan [1 ,2 ]
Fan, Shuo [1 ]
机构
[1] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
[2] Minist Educ, Engn Res Ctr Intelligence Percept & Autonomous Con, Beijing 100124, Peoples R China
关键词
Three-dimensional displays; Estimation; Pupils; Light sources; Cameras; Iris; Optical imaging; Corneal reflection; eye gaze; gaze estimation; iris features; pupil refraction; EYE GAZE; TRACKING; MODEL;
D O I
10.1109/TIM.2022.3210925
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The simplest configuration for estimating 3-D line-of-sight (LoS) based on corneal reflection and pupil refraction uses a single camera and two noncollinear light sources. The corneal radius and 3-D corneal center can be determined by solving a system of six equations with six unknowns. However, when two light sources are collinear with the camera, the reflection planes of the two light sources are coplanar. In this case, the estimation of the 3-D corneal center is underdetermined in the absence of any preknown eyeball parameters (e.g., corneal radius). To solve this issue, this article proposes to calibrate the corneal radius with corneal reflections from two light sources combined with an iris imaging model so that the 3-D corneal center is estimated with a known corneal radius. Then, the pupil features or iris features can be selected to estimate the 3-D pupil center or 3-D iris center, which uses an optimization solution for only the center parameters to avoid unnecessary errors. Thus, the optical axis of the eyeball is constructed with two spatial centers, and the kappa angle calculated in real time is used to convert the optical axis of the eyeball to the 3-D LoS. We simulated this gaze estimation process using pupil and iris features, and performed error analysis on the proposed method. In practical experiments, the proposed method was verified using iris features, and the gaze accuracy was 1.22 degrees and 1.13 degrees in the x - and y -directions, respectively, which is comparable to that of more sophisticated systems. A single-camera-two-collinear-light-source system is the most typical and common system configuration, and the realization of 3-D gaze estimation under such a system configuration can effectively promote the wide application of eye-tracking interaction.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] 3-D Gaze-Estimation Method Using a Multi-Camera-Multi-Light-Source System
    Chi, Jiannan
    Liu, Jiahui
    Wang, Feng
    Chi, Yingkai
    Hou, Zeng-Guang
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (12) : 9695 - 9708
  • [2] Accurate 3-d measurement using a single video camera
    Heikkila, J
    Silven, O
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 1996, 10 (02) : 139 - 149
  • [3] Iris Feature-Based 3-D Gaze Estimation Method Using a One-Camera-One-Light-Source System
    Liu, Jiahui
    Chi, Jiannan
    Lu, Ning
    Yang, Zuoyun
    Wang, Zhiliang
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (07) : 4940 - 4954
  • [4] 3-D Gaze Estimation by Stereo Gaze Direction
    Pichitwong, Wudthipong
    Chamnongthai, Kosin
    [J]. 2016 13TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY (ECTI-CON), 2016,
  • [5] High Precision 3D Gaze Estimation based on Two-Camera-Two-Light-Source System
    Chi, Jiannan
    Yang, Zuoyun
    Liu, Jiahui
    Wang, Feng
    Chi, Yingkai
    Fan, Fang
    [J]. BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2020, 126 : 111 - 111
  • [6] 3D Gaze Estimation with a Single Camera without IR Illumination
    Chen, Jixu
    Ji, Qiang
    [J]. 19TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1-6, 2008, : 3843 - 3846
  • [7] A novel method to measure 3-D displacement by single camera
    Yi Yaxing
    Yue Kaiduan
    Li Zhongke
    Chen Qi
    Shao Jun
    [J]. 2008 INTERNATIONAL CONFERENCE ON OPTICAL INSTRUMENTS AND TECHNOLOGY: ADVANCED SENSOR TECHNOLOGIES AND APPLICATIONS, 2009, 7157
  • [8] Screen-Light Decomposition Framework for Point-of-Gaze Estimation Using a Single Uncalibrated Camera and Multiple Light Sources
    Carlos H. Morimoto
    Flávio L. Coutinho
    Dan W. Hansen
    [J]. Journal of Mathematical Imaging and Vision, 2020, 62 : 585 - 605
  • [9] Screen-Light Decomposition Framework for Point-of-Gaze Estimation Using a Single Uncalibrated Camera and Multiple Light Sources
    Morimoto, Carlos H.
    Coutinho, Flavio L.
    Hansen, Dan W.
    [J]. JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2020, 62 (04) : 585 - 605
  • [10] Detecting eye position and gaze from a single camera and 2 light sources
    Morimoto, CH
    Amir, A
    Flickner, M
    [J]. 16TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITON, VOL IV, PROCEEDINGS, 2002, : 314 - 317