Gaze estimation using a head-mounted single full-view camera

被引:1
|
作者
Li, Jianfeng [1 ]
Shan, Yuhao [2 ]
Li, Shigang [1 ,2 ]
Chen, Tong [1 ]
机构
[1] Southwest Univ, Sch Elect & Informat Engn, Chongqing Key Lab Nonlinear Circuit & Intelligent, Chongqing, Peoples R China
[2] Hiroshima City Univ, Grad Sch Informat Sci, Hiroshima, Japan
关键词
spherical camera model; head-mounted camera; point of gaze; eye-model-based gaze estimation;
D O I
10.1117/1.JEI.28.1.013002
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We present a gaze estimation method for a head-mounted full-view egocentric camera that can capture egocentric video together with users' gaze cues. While the conventional gaze recording device has two cameras, an eye camera and a scene camera, the proposed gaze recording device has only a single spherical camera with a full field of view. To determine the point of gaze on full-view images, we present an eyemodel-based gaze estimation method by means of three-dimensional iris projection. First, an eye model is built according to the precalibration process of an eyeball center and the eyeball biological parameters; then, we express the 3D iris contour in the eye model and project it back to the spherical camera model. Since 2D iris contours can be detected directly on images and can also be expressed under the spherical model, the relationship between the 3D iris contour and the 2D iris contour can be found. By solving this problem, the gaze direction under the camera model is determined; subsequently, the point of gaze on the images can be inferred. Since in the proposed method, a single spherical camera can play the role of the conventional two cameras, not only do the proposed method results have a simpler system structure but also the cumbersome operation of the calibration for the conventional two-camera gaze measurement devices becomes unnecessary. The effectiveness of the proposed method is shown by the experimental results. (C) 2019 SPIE and IS&T
引用
收藏
页数:8
相关论文
共 50 条
  • [1] The Benefits of Depth Information for Head-Mounted Gaze Estimation
    Stojanov, Stefan
    Talathi, Sachin
    Sharma, Abhishek
    [J]. 2022 ACM SYMPOSIUM ON EYE TRACKING RESEARCH AND APPLICATIONS, ETRA 2022, 2022,
  • [2] Toward Precise Gaze Estimation for Mobile Head-Mounted Gaze Tracking Systems
    Su, Dan
    Li, You-Fu
    Chen, Hao
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2019, 15 (05) : 2660 - 2672
  • [3] Full-view spherical image camera
    Li, Shigang
    [J]. 18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 4, PROCEEDINGS, 2006, : 386 - +
  • [4] Gaze Tracking and Point Estimation Using Low-Cost Head-Mounted Devices
    Lee, Ko-Feng
    Chen, Yen-Lin
    Yu, Chao-Wei
    Chin, Kai-Yi
    Wu, Chen-Han
    [J]. SENSORS, 2020, 20 (07)
  • [5] Using a head-mounted camera to infer attention direction
    Schmitow, Clara
    Stenberg, Gunilla
    Billard, Aude
    von Hofsten, Claes
    [J]. INTERNATIONAL JOURNAL OF BEHAVIORAL DEVELOPMENT, 2013, 37 (05) : 468 - 474
  • [6] TWO-PHASE APPROACH - CALIBRATION AND IRIS CONTOUR ESTIMATION - FOR GAZE TRACKING OF HEAD-MOUNTED EYE CAMERA
    Li, Jianfeng
    Li, Shigang
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 3136 - 3140
  • [7] Pointing by Gaze, Head, and Foot in a Head-Mounted Display
    Minakata, Katsumi
    Hansen, John Paulin
    MacKenzie, I. Scott
    Baekgaard, Per
    Rajanna, Vijay
    [J]. ETRA 2019: 2019 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, 2019,
  • [8] A body-mounted camera system for capturing user-view images without head-mounted camera
    Yamazoe, H
    Utsumi, A
    Hosaka, K
    [J]. NINTH IEEE INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, PROCEEDINGS, 2005, : 114 - 121
  • [9] A body-mounted camera system for capturing user-view images without head-mounted camera
    [J]. Yamazoe, H. (yamazoe@atr.jp), (IEEE Computer Society):
  • [10] The combination of a mobile gaze-driven and a head-mounted camera in a hybrid perspective setup
    Vockeroth, Johannes
    Dera, Thomas
    Boening, Guido
    Bartl, Klaus
    Bardins, Stanislavs
    Schneider, Erich
    [J]. 2007 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS, VOLS 1-8, 2007, : 2791 - +