Real-time recording and classification of eye movements in an immersive virtual environment

被引:39
|
作者
Diaz, Gabriel [1 ]
Cooper, Joseph [2 ]
Kit, Dmitry [2 ]
Hayhoe, Mary [1 ]
机构
[1] Univ Texas Austin, Ctr Perceptual Syst, Austin, TX 78712 USA
[2] Univ Texas Austin, Dept Comp Sci, Austin, TX 78712 USA
来源
JOURNAL OF VISION | 2013年 / 13卷 / 12期
关键词
virtual reality; eye movements; gaze; methods; GAZE;
D O I
10.1167/13.12.5
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
Despite the growing popularity of virtual reality environments, few laboratories are equipped to investigate eye movements within these environments. This primer is intended to reduce the time and effort required to incorporate eye-tracking equipment into a virtual reality environment. We discuss issues related to the initial startup and provide algorithms necessary for basic analysis. Algorithms are provided for the calculation of gaze angle within a virtual world using a monocular eye-tracker in a three-dimensional environment. In addition, we provide algorithms for the calculation of the angular distance between the gaze and a relevant virtual object and for the identification of fixations, saccades, and pursuit eye movements. Finally, we provide tools that temporally synchronize gaze data and the visual stimulus and enable real-time assembly of a video-based record of the experiment using the Quicktime MOV format, available at http://sourceforge.net/p/utdvrlibraries/. This record contains the visual stimulus, the gaze cursor, and associated numerical data and can be used for data exportation, visual inspection, and validation of calculated gaze movements.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Real-time video recording of eye movements - an inexpensive system
    Nandi, R.
    Pajaniappane, A.
    Palaniappan, R.
    [J]. JOURNAL OF LARYNGOLOGY AND OTOLOGY, 2008, 122 (02): : 199 - 200
  • [2] An immersive virtual environment training system on real-time motion platform
    Chen, J
    Fang, YC
    Loftin, RB
    Leiss, EL
    Lin, CY
    Su, S
    [J]. CAD/GRAPHICS '2001: PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN AND COMPUTER GRAPHICS, VOLS 1 AND 2, 2001, : 951 - 954
  • [3] Eye Movements, Visual Search and Scene Memory, in an Immersive Virtual Environment
    Kit, Dmitry
    Katz, Leor
    Sullivan, Brian
    Snyder, Kat
    Ballard, Dana
    Hayhoe, Mary
    [J]. PLOS ONE, 2014, 9 (04):
  • [4] Immersive Sketching to Author Crowd Movements in Real-time
    Boensch, Andrea
    Barton, Sebastian J.
    Ehret, Jonathan
    Kuhlen, Torsten W.
    [J]. PROCEEDINGS OF THE 20TH ACM INTERNATIONAL CONFERENCE ON INTELLIGENT VIRTUAL AGENTS (ACM IVA 2020), 2020,
  • [5] The Contribution of Real-Time Mirror Reflections of Motor Actions on Virtual Body Ownership in an Immersive Virtual Environment
    Gonzalez-Franco, Mar
    Perez-Marcos, Daniel
    Spanlang, Bernhard
    Slater, Mel
    [J]. IEEE VIRTUAL REALITY 2010, PROCEEDINGS, 2010, : 111 - 114
  • [6] REAL-TIME BIOMETRIC EMOTION ASSESSMENT IN AN IMMERSIVE ENVIRONMENT
    Vinhas, Vasco
    Silva, Daniel Castro
    Reis, Luis Paulo
    Oliveira, Eugenio
    [J]. ICINCO 2009: PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS, VOL 2: ROBOTICS AND AUTOMATION, 2009, : 153 - 158
  • [7] Real-time pointing gesture recognition for an immersive environment
    Kehl, R
    Van Gool, L
    [J]. SIXTH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, PROCEEDINGS, 2004, : 577 - 582
  • [8] FULLDOME INTERFACING A Real-time Immersive Environment as a Tool for Design
    Melenbrink, Nathan
    King, Nathan
    [J]. Proceedings of the 20th International Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2015): EMERGING EXPERIENCES IN THE PAST, PRESENT AND FUTURE OF DIGITAL ARCHITECTURE, 2015, : 221 - 230
  • [9] A real-time virtual environment rendering system
    Deng, Hongbin
    Xu, Yihua
    Wang, Li
    [J]. ICAT 2006: 16TH INTERNATIONAL CONFERENCE ON ARTIFICIAL REALITY AND TELEXISTENCE - WORSHOPS, PROCEEDINGS, 2006, : 458 - +
  • [10] A virtual laboratory environment for real-time experiments
    Carnevali, G
    Buttazzo, G
    [J]. INTELLIGENT COMPONENTS AND INSTRUMENTS FOR CONTROL APPLICATIONS 2003, 2003, : 31 - 36