3-D Gaze-Estimation Method Using a Multi-Camera-Multi-Light-Source System

被引:12
|
作者
Chi, Jiannan [1 ]
Liu, Jiahui [1 ]
Wang, Feng [1 ]
Chi, Yingkai [2 ]
Hou, Zeng-Guang [3 ]
机构
[1] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
[2] Northern Theater Command, Gen Hosp, Dept Pathol, Shenyang 110015, Peoples R China
[3] Chinese Acad Sci, Inst Automat, State Key Lab Complex Syst Management & Control, Beijing 100190, Peoples R China
关键词
Pupils; Cameras; Cornea; Estimation; Three-dimensional displays; Optical distortion; 3-D gaze estimation; corneal reflection; multi-camera-multi-light-source (MCMLS) system; optical axis reconstruction; pupil refraction; user calibration; SINGLE CAMERA; TRACKING; CALIBRATION;
D O I
10.1109/TIM.2020.3006681
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The image of the center of a 3-D circular target is not the center of its imaging ellipse due to the imaging distortion of the spatial circular targets; therefore, traditional 3-D gaze-estimation methods with the multi-camera-multi-light-source (MCMLS) systems generally replace the projection of the pupil center with the virtual image of the pupil center for 3-D gaze estimation. However, this introduces a large gaze-estimation error when the oblique angle between the optical axis of the eye and the camera optical axis is large. To eliminate the error caused by using the virtual image of the pupil center, a 3-D gaze-estimation method using an MCMLS system is developed in this study. We first estimate the cornea center and then determine the matching points of the pupil imaging ellipse using the special polar plane. After the cornea radius and the kappa angle are calibrated, the optical axis of the eye is reconstructed by the refraction planes constructed by the edge points of the pupil imaging ellipses. Thus, the 3-D gaze is estimated by the real-time calculated transformation matrix represented by the kappa angle. The feasibility and performance of the method have been analyzed by the simulations and the experiments. Since the estimation of the spatial pupil center or the construction of the refraction plane using the virtual image of the pupil center is not required, the proposed method mitigates the inherent errors caused by optical axis reconstruction in the traditional methods and simplifies the algorithm for gaze estimation, which has a practical value.
引用
收藏
页码:9695 / 9708
页数:14
相关论文
共 50 条
  • [1] Iris Feature-Based 3-D Gaze Estimation Method Using a One-Camera-One-Light-Source System
    Liu, Jiahui
    Chi, Jiannan
    Lu, Ning
    Yang, Zuoyun
    Wang, Zhiliang
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (07) : 4940 - 4954
  • [2] A Method for Accurate 3-D Gaze Estimation With a Single Camera and Two Collinear Light Sources
    Liu, Jiahui
    Chi, Jiannan
    Fan, Shuo
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [3] An Eye Gaze Tracking Method of Virtual Reality Headset Using A Single Camera and Multi-light Source
    Lu, Shengfu
    Li, Richeng
    Jiao, Jinan
    Kang, Jiaming
    Zhao, Nana
    Li, Mi
    [J]. 2020 4TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND INFORMATION TECHNOLOGY (CMVIT 2020), 2020, 1518
  • [4] A Method of Gaze Estimation for Wearable Multi-Camera Devices Using Stereo Vision
    Wan Zijing
    Wang Xiangjun
    [J]. AOPC 2017: OPTICAL SENSING AND IMAGING TECHNOLOGY AND APPLICATIONS, 2017, 10462
  • [5] A Multi-Gesture Interaction System Using a 3-D Iris Disk Model for Gaze Estimation and an Active Appearance Model for 3-D Hand Pointing
    Reale, Michael J.
    Canavan, Shaun
    Yin, Lijun
    Hu, Kaoning
    Hung, Terry
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2011, 13 (03) : 474 - 486
  • [6] High Precision 3D Gaze Estimation based on Two-Camera-Two-Light-Source System
    Chi, Jiannan
    Yang, Zuoyun
    Liu, Jiahui
    Wang, Feng
    Chi, Yingkai
    Fan, Fang
    [J]. BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2020, 126 : 111 - 111
  • [7] A REAL-TIME 3-D MULTI-CAMERA VISION SYSTEM
    LUH, JYS
    KLAASEN, JA
    [J]. PROCEEDINGS OF THE SOCIETY OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS, 1984, 449 : 400 - 408
  • [8] Remarks on 3D human posture estimation system using simple multi-camera system
    Takahashi, Kazuhiko
    Nagasawa, Yusuke
    Hashimoto, Masafumi
    [J]. 2006 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-6, PROCEEDINGS, 2006, : 1962 - +
  • [9] 3-D object Projection Method of Multi-Camera Revolve Batch Rendering
    Bai Xiaoming
    Xie Xiaofang
    Yu Jihong
    [J]. ADVANCES IN CIVIL ENGINEERING II, PTS 1-4, 2013, 256-259 : 2894 - +
  • [10] Multi-directional camera 3-D vision system for micro-operation
    Hata, S
    Torigoe, D
    Guo, SX
    Sugimoto, K
    [J]. 15TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 4, PROCEEDINGS: APPLICATIONS, ROBOTICS SYSTEMS AND ARCHITECTURES, 2000, : 583 - 588