A review of machine learning in scanpath analysis for passive gaze-based interaction

被引:1
|
作者
Selim, Abdulrahman Mohamed [1 ]
Barz, Michael [1 ,2 ]
Bhatti, Omair Shahzad [1 ]
Alam, Hasan Md Tusfiqur [1 ]
Sonntag, Daniel [1 ,2 ]
机构
[1] German Res Ctr Artificial Intelligence DFKI, Interact Machine Learning Dept, Saarbrucken, Germany
[2] Carl von Ossietzky Univ Oldenburg, Appl Artificial Intelligence, Oldenburg, Germany
来源
关键词
machine learning; eye tracking; scanpath; passive gaze-based interaction; literature review; EYE-MOVEMENT PATTERNS; TRACKING; PREDICTION; CLASSIFICATION; RECOGNITION; ALGORITHMS; VISUALIZATION; ACCURACY; NETWORKS; SEARCH;
D O I
10.3389/frai.2024.1391745
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The scanpath is an important concept in eye tracking. It refers to a person's eye movements over a period of time, commonly represented as a series of alternating fixations and saccades. Machine learning has been increasingly used for the automatic interpretation of scanpaths over the past few years, particularly in research on passive gaze-based interaction, i.e., interfaces that implicitly observe and interpret human eye movements, with the goal of improving the interaction. This literature review investigates research on machine learning applications in scanpath analysis for passive gaze-based interaction between 2012 and 2022, starting from 2,425 publications and focussing on 77 publications. We provide insights on research domains and common learning tasks in passive gaze-based interaction and present common machine learning practices from data collection and preparation to model selection and evaluation. We discuss commonly followed practices and identify gaps and challenges, especially concerning emerging machine learning topics, to guide future research in the field.
引用
收藏
页数:28
相关论文
共 50 条
  • [41] GazeEMD: Detecting Visual Intention in Gaze-Based Human-Robot Interaction
    Shi, Lei
    Copot, Cosmin
    Vanlanduit, Steve
    ROBOTICS, 2021, 10 (02)
  • [42] Automated Gaze-Based Identification of Students' Strategies in Histogram Tasks through an Interpretable Mathematical Model and a Machine Learning Algorithm
    Boels, Lonneke
    Moreno-Esteva, Enrique Garcia
    Bakker, Arthur
    Drijvers, Paul
    INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION, 2024, 34 (03) : 931 - 973
  • [43] Automated gaze-based mind wandering detection during computerized learning in classrooms
    Hutt, Stephen
    Krasich, Kristina
    Mills, Caitlin
    Bosch, Nigel
    White, Shelby
    Brockmole, James R.
    D'Mello, Sidney K.
    USER MODELING AND USER-ADAPTED INTERACTION, 2019, 29 (04) : 821 - 867
  • [44] Understanding the Effectiveness of Adaptive Guidance for Narrative Visualization: A Gaze-Based Analysis
    Barral, Oswald
    Lalle, Sebastien
    Conati, Cristina
    PROCEEDINGS OF THE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES, IUI 2020, 2020, : 1 - 9
  • [45] Automated gaze-based mind wandering detection during computerized learning in classrooms
    Stephen Hutt
    Kristina Krasich
    Caitlin Mills
    Nigel Bosch
    Shelby White
    James R. Brockmole
    Sidney K. D’Mello
    User Modeling and User-Adapted Interaction, 2019, 29 : 821 - 867
  • [46] Optimum object selection methods for spontaneous gaze-based interaction with linear and circular trajectories
    Nurlatifa, Hafzatin
    Hartanto, Rudy
    Ataka, Ahmad
    Wibirama, Sunu
    RESULTS IN ENGINEERING, 2024, 21
  • [47] Evaluating requirements for gaze-based interaction in a see-through head mounted display
    Graupner, Sven-Thomas
    Heubner, Michael
    Pannasch, Sebastian
    Velichkovsky, Boris M.
    PROCEEDINGS OF THE EYE TRACKING RESEARCH AND APPLICATIONS SYMPOSIUM (ETRA 2008), 2008, : 91 - 94
  • [48] Experimental researches on gaze-based 3D interaction to stereo image display
    Kwon, Yong-Moo
    Shul, Jai Kyung
    TECHNOLOGIES FOR E-LEARNING AND DIGITAL ENTERTAINMENT, PROCEEDINGS, 2006, 3942 : 1112 - 1120
  • [49] Weighted Pointer: Error-aware Gaze-based Interaction through Fallback Modalities
    Sidenmark, Ludwig
    Parent, Mark
    Wu, Chi-Hao
    Chan, Joannes
    Glueck, Michael
    Wigdor, Daniel
    Grossman, Tovi
    Giordano, Marcello
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (11) : 3585 - 3595
  • [50] Surface Recalibration as a New Method Improving Gaze-Based Human-Computer Interaction
    Biele, Cezary
    Kobylinski, Pawel
    INTELLIGENT HUMAN SYSTEMS INTEGRATION, IHSI 2018, 2018, 722 : 197 - 202