Novel eye gaze tracking techniques under natural head movement

被引:191
|
作者
Zhu, Zhiwei
Ji, Qiang
机构
[1] Rensselaer Polytech Inst, Dept Elect Comp & Syst Engn, Troy, NY 12180 USA
[2] Sarnoff Corp, Comp Vis Lab, Princeton, NJ 08540 USA
关键词
eye gaze tracking; gaze estimation; human computer interaction;
D O I
10.1109/TBME.2007.895750
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Most available remote eye gaze trackers have two characteristics that hinder them being widely used as the important computer input devices for human computer interaction. First, they have to be calibrated for each user individually; second, they have low tolerance for head movement and require the users to hold their heads unnaturally still. In this paper, by exploiting the eye anatomy, we propose two novel solutions to allow natural head movement and minimize the calibration procedure to only one time for a new individual. The first technique is proposed to estimate the 3-D eye gaze directly. In this technique, the cornea of the. eyeball is modeled as a convex mirror. Via the properties of convex mirror, a simple method is proposed to estimate the 3-D optic axis of the eye. The visual axis, which is the true 3-D gaze direction of the user, can be determined subsequently after knowing the angle deviation between the visual axis and optic axis by a simple calibration procedure. Therefore, the gaze point on an object in the scene can be obtained by simply intersecting the estimated 3-D gaze direction with the object. Different from the first technique, our second technique does not need to estimate the 3-D eye gaze directly, and the gaze point on an object is estimated from a gaze mapping function implicitly. In addition, a dynamic computational head compensation model is developed to automatically update the gaze mapping function whenever the head moves. Hence, the eye gaze can be estimated under natural head movement. Furthermore, it minimizes the calibration procedure to only one time for a new individual. The advantage of the proposed techniques over the current state of the art eye gaze trackers is that it can estimate the eye gaze of the user accurately under natural head movement, without need to perform the gaze calibration every time before using it. Our proposed methods will improve the usability of the eye, gaze tracking technology, and we believe that it represents an important step for the eye tracker to be accepted as a natural computer input device.
引用
收藏
页码:2246 / 2260
页数:15
相关论文
共 50 条
  • [1] Eye gaze tracking under natural head movements
    Zhu, ZW
    Ji, Q
    [J]. 2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, : 918 - 923
  • [2] Gaze Tracking by Joint Head and Eye Pose Estimation Under Free Head Movement
    Cristina, Stefania
    Camilleri, Kenneth P.
    [J]. 2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2019,
  • [3] Non-intrusive eye gaze tracking under natural head movements
    Kim, SC
    Sked, M
    Ji, Q
    [J]. PROCEEDINGS OF THE 26TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-7, 2004, 26 : 2271 - 2274
  • [4] Single camera remote eye gaze tracking under natural head movements
    Liu, Ruian
    Jin, Shijiu
    Wu, Xiaorong
    [J]. ADVANCES IN ARTIFICIAL REALITY AND TELE-EXISTENCE, PROCEEDINGS, 2006, 4282 : 614 - +
  • [5] Tracking Eye Gaze under Coordinated Head Rotations with an Ordinary Camera
    Wang, Haibo
    Pan, Chunhong
    Chaillou, Christophe
    [J]. COMPUTER VISION - ACCV 2009, PT II, 2010, 5995 : 120 - +
  • [6] Eye gaze tracking system with head unfixed
    Zhao, Xincan
    Lu, Zhaoyang
    [J]. Nanjing Hangkong Hangtian Daxue Xuebao/Journal of Nanjing University of Aeronautics and Astronautics, 2010, 42 (04): : 435 - 439
  • [7] A Real-time Compensation Strategy for Non-contact Gaze Tracking Under Natural Head Movement
    Huang Ying
    Wang Zhiliang
    Tu Xuyan
    [J]. CHINESE JOURNAL OF ELECTRONICS, 2010, 19 (03) : 446 - 450
  • [8] Eye&Head: Synergetic Eye and Head Movement for Gaze Pointing and Selection
    Sidenmark, Ludwig
    Gellersen, Hans
    [J]. PROCEEDINGS OF THE 32ND ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY (UIST 2019), 2019, : 1161 - 1174
  • [9] In the eye of the beholder: A survey of gaze tracking techniques
    Liu, Jiahui
    Chi, Jiannan
    Yang, Huijie
    Yin, Xucheng
    [J]. PATTERN RECOGNITION, 2022, 132
  • [10] Eye gaze tracking techniques for interactive applications
    Morimoto, CH
    Mimica, MRM
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2005, 98 (01) : 4 - 24