3-D Gaze-Estimation Method Using a Multi-Camera-Multi-Light-Source System

被引:12
|
作者
Chi, Jiannan [1 ]
Liu, Jiahui [1 ]
Wang, Feng [1 ]
Chi, Yingkai [2 ]
Hou, Zeng-Guang [3 ]
机构
[1] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
[2] Northern Theater Command, Gen Hosp, Dept Pathol, Shenyang 110015, Peoples R China
[3] Chinese Acad Sci, Inst Automat, State Key Lab Complex Syst Management & Control, Beijing 100190, Peoples R China
关键词
Pupils; Cameras; Cornea; Estimation; Three-dimensional displays; Optical distortion; 3-D gaze estimation; corneal reflection; multi-camera-multi-light-source (MCMLS) system; optical axis reconstruction; pupil refraction; user calibration; SINGLE CAMERA; TRACKING; CALIBRATION;
D O I
10.1109/TIM.2020.3006681
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The image of the center of a 3-D circular target is not the center of its imaging ellipse due to the imaging distortion of the spatial circular targets; therefore, traditional 3-D gaze-estimation methods with the multi-camera-multi-light-source (MCMLS) systems generally replace the projection of the pupil center with the virtual image of the pupil center for 3-D gaze estimation. However, this introduces a large gaze-estimation error when the oblique angle between the optical axis of the eye and the camera optical axis is large. To eliminate the error caused by using the virtual image of the pupil center, a 3-D gaze-estimation method using an MCMLS system is developed in this study. We first estimate the cornea center and then determine the matching points of the pupil imaging ellipse using the special polar plane. After the cornea radius and the kappa angle are calibrated, the optical axis of the eye is reconstructed by the refraction planes constructed by the edge points of the pupil imaging ellipses. Thus, the 3-D gaze is estimated by the real-time calculated transformation matrix represented by the kappa angle. The feasibility and performance of the method have been analyzed by the simulations and the experiments. Since the estimation of the spatial pupil center or the construction of the refraction plane using the virtual image of the pupil center is not required, the proposed method mitigates the inherent errors caused by optical axis reconstruction in the traditional methods and simplifies the algorithm for gaze estimation, which has a practical value.
引用
收藏
页码:9695 / 9708
页数:14
相关论文
共 50 条
  • [41] A Novel Integrated Eye-Tracking System With Stereo Stimuli for 3-D Gaze Estimation
    Sun, Jinglin
    Wu, Zhipeng
    Wang, Han
    Jing, Peiguang
    Liu, Yu
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [42] Absolute and Relative Pose Estimation of a Multi-View Camera System using 2D-3D Line Pairs and Vertical Direction
    Abdellali, Hichem
    Kato, Zoltan
    [J]. 2018 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2018, : 225 - 232
  • [43] Scattering from 3-D multi-layered surfaces using adaptive integral method
    Topsakal, E
    Carr, M
    Volakis, JL
    Bleszynski, M
    [J]. IEEE ANTENNAS AND PROPAGATION SOCIETY INTERNATIONAL SYMPOSIUM, VOLS 1-4: TRANSMITTING WAVES OF PROGRESS TO THE NEXT MILLENNIUM, 2000, : 1868 - 1871
  • [44] 3-D Shape Model Retrieval Using Multi Range Image Phase Correlation Method
    Sugawara, Yuki
    Lee, Dae Song
    Kawanaka, Akira
    [J]. 2012 IEEE INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND INFORMATION TECHNOLOGY (ISSPIT), 2012, : 61 - 66
  • [45] 3-D Motion Parameter Estimation via Multi-static SAR
    Wang, Pengfei
    Qiu, Xiaoyan
    Wu, Xuewei
    Jiang, Yanna
    Li, Boda
    Jiang, Jie
    Li, Yajun
    [J]. PROCEEDINGS OF 2019 IEEE 2ND INTERNATIONAL CONFERENCE ON ELECTRONIC INFORMATION AND COMMUNICATION TECHNOLOGY (ICEICT 2019), 2019, : 287 - 290
  • [46] 3-D segmentation of multi-view images based on disparity estimation
    Naemura, T
    Kaneko, M
    Harashima, H
    [J]. VISUAL COMMUNICATIONS AND IMAGE PROCESSING '96, 1996, 2727 : 1173 - 1184
  • [47] Improvement of calibration method for multi-camera line structured light vision system
    Yang, Hongmai
    Fang, Changshuai
    Zhang, Xiaodong
    [J]. APPLIED PHYSICS B-LASERS AND OPTICS, 2022, 128 (06):
  • [48] Improvement of calibration method for multi-camera line structured light vision system
    Hongmai Yang
    Changshuai Fang
    Xiaodong Zhang
    [J]. Applied Physics B, 2022, 128
  • [49] 3D Hand Gestures Calibration Method for Multi-Display by Using a Depth Camera
    Kim, Hee-Kwon
    Lee, Jisu
    Yu, ChoRong
    Shim, HeeSook
    Gil, Youn-Hee
    Jee, Hyung-Keun
    [J]. 2017 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC), 2017, : 1044 - 1046
  • [50] 3-D Cameras A Novel Method and Device for 3-D Imaging Using Light Detection and Ranging
    Lim, Jaechan
    Kim, Taemin
    [J]. IEEE INDUSTRIAL ELECTRONICS MAGAZINE, 2015, 9 (03) : 6 - 8