A neural network for 3D gaze recording with binocular eye trackers

被引:38
|
作者
Essig, Kai [1 ]
Pomplun, Marc [2 ]
Ritter, Helge [1 ]
机构
[1] Bielefeld Univ, Neuroinformat Grp, Fac Technol, POB 10 01 31, D-33501 Bielefeld, Germany
[2] Univ Massachusetts, Dept Comp Sci, Boston, MA 02125 USA
关键词
Eye tracking; Neural network; 3D calibration; Anaglyphs;
D O I
10.1080/17445760500354440
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Using eye tracking for the investigation of visual attention has become increasingly popular during the last few decades. Nevertheless, only a small number of eye tracking studies have employed 3D displays, although such displays would closely resemble our natural visual environment. Besides higher cost and effort for the experimental setup, the main reason for the avoidance of 3D displays is the problem of computing a subject's current 3D gaze position based on the measured binocular gaze angles. The geometrical approaches to this problem that have been studied so far involved substantial error in the measurement of 3D gaze trajectories. In order to tackle this problem, we developed an anaglyph-based 3D calibration procedure and used a well-suited type of artificial neural network-a parametrized self-organizing map (PSOM)-to estimate the 3D gaze point from a subject's binocular eye-position data. We report an experiment in which the accuracy of the PSOM gaze-point estimation is compared to a geometrical solution. The results show that the neural network approach produces more accurate results than the geometrical method, especially for the depth axis and for distant stimuli.
引用
收藏
页码:79 / 95
页数:17
相关论文
共 50 条
  • [1] Binocular 3D reconstruction based on neural network
    Lin, MX
    Zhao, YR
    Guan, ZG
    Ding, FH
    Xu, QX
    Wang, XH
    ADVANCES IN NEURAL NETWORKS - ISNN 2005, PT 2, PROCEEDINGS, 2005, 3497 : 765 - 771
  • [2] Neural 3D Gaze: 3D Pupil Localization and Gaze Tracking based on Anatomical Eye Model and Neural Refraction Correction
    Lu, Conny
    Chakravarthula, Praneeth
    Liu, Kaihao
    Liu, Xixiang
    Li, Siyuan
    Fuchs, Henry
    2022 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR 2022), 2022, : 375 - 383
  • [3] Wearable Gaze Trackers: Mapping Visual Attention in 3D
    Jensen, Rasmus R.
    Stets, Jonathan D.
    Suurmets, Seidi
    Clement, Jesper
    Aanaes, Henrik
    IMAGE ANALYSIS, SCIA 2017, PT I, 2017, 10269 : 66 - 76
  • [4] User-Calibration-Free Gaze Estimation Method Using a Binocular 3D Eye Model
    Nagamatsu, Takashi
    Sugano, Ryuichi
    Iwamoto, Yukina
    Kamahara, Junzo
    Tanaka, Naoki
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2011, E94D (09): : 1817 - 1829
  • [5] 3D Gaze Estimation from 2D Pupil Positions on Monocular Head-Mounted Eye Trackers
    Mansouryar, Mohsen
    Steil, Julian
    Sugano, Yusuke
    Bulling, Andreas
    2016 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS (ETRA 2016), 2016, : 197 - 200
  • [6] A 3D Morphable Eye Region Model for Gaze Estimation
    Wood, Erroll
    Baltrusaitis, Tadas
    Morency, Louis-Philippe
    Robinson, Peter
    Bulling, Andreas
    COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 : 297 - 313
  • [7] 3D Gaze tracking by combining eye- and facial-gaze vectors
    Kim, Byoung Cheul
    Ko, Daejune
    Jang, Unsoo
    Han, Hyuksoo
    Lee, Eui Chul
    JOURNAL OF SUPERCOMPUTING, 2017, 73 (07): : 3038 - 3052
  • [8] 3D Gaze tracking by combining eye- and facial-gaze vectors
    Byoung Cheul Kim
    Daejune Ko
    Unsoo Jang
    Hyuksoo Han
    Eui Chul Lee
    The Journal of Supercomputing, 2017, 73 : 3038 - 3052
  • [9] Binocular vision calibration and 3D re-construction with an orthogonal learning neural network
    Ge, Dong-yuan
    Yao, Xi-fan
    Lian, Zhao-tong
    MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (23) : 15635 - 15650
  • [10] Binocular vision calibration and 3D re-construction with an orthogonal learning neural network
    Dong-yuan Ge
    Xi-fan Yao
    Zhao-tong Lian
    Multimedia Tools and Applications, 2016, 75 : 15635 - 15650