A review of machine learning in scanpath analysis for passive gaze-based interaction

被引:1
|
作者
Selim, Abdulrahman Mohamed [1 ]
Barz, Michael [1 ,2 ]
Bhatti, Omair Shahzad [1 ]
Alam, Hasan Md Tusfiqur [1 ]
Sonntag, Daniel [1 ,2 ]
机构
[1] German Res Ctr Artificial Intelligence DFKI, Interact Machine Learning Dept, Saarbrucken, Germany
[2] Carl von Ossietzky Univ Oldenburg, Appl Artificial Intelligence, Oldenburg, Germany
来源
关键词
machine learning; eye tracking; scanpath; passive gaze-based interaction; literature review; EYE-MOVEMENT PATTERNS; TRACKING; PREDICTION; CLASSIFICATION; RECOGNITION; ALGORITHMS; VISUALIZATION; ACCURACY; NETWORKS; SEARCH;
D O I
10.3389/frai.2024.1391745
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The scanpath is an important concept in eye tracking. It refers to a person's eye movements over a period of time, commonly represented as a series of alternating fixations and saccades. Machine learning has been increasingly used for the automatic interpretation of scanpaths over the past few years, particularly in research on passive gaze-based interaction, i.e., interfaces that implicitly observe and interpret human eye movements, with the goal of improving the interaction. This literature review investigates research on machine learning applications in scanpath analysis for passive gaze-based interaction between 2012 and 2022, starting from 2,425 publications and focussing on 77 publications. We provide insights on research domains and common learning tasks in passive gaze-based interaction and present common machine learning practices from data collection and preparation to model selection and evaluation. We discuss commonly followed practices and identify gaps and challenges, especially concerning emerging machine learning topics, to guide future research in the field.
引用
收藏
页数:28
相关论文
共 50 条
  • [31] Gaze-Based Assessments of Vigilance and Avoidance in Social Anxiety: a Review
    Nigel T. M. Chen
    Patrick J. F. Clarke
    Current Psychiatry Reports, 2017, 19
  • [32] Gaze-Based Human-SmartHome-Interaction by Augmented Reality Controls
    Cottin, Tim
    Nordheimer, Eugen
    Wagner, Achim
    Badreddin, Essameddin
    ADVANCES IN ROBOT DESIGN AND INTELLIGENT CONTROL, 2017, 540 : 378 - 385
  • [33] Gaze-based Mode-Switching to Enhance Interaction with Menus on Tablets
    Fleischhauer, Yanfei Hu
    Surale, Hemant
    Alt, Florian
    Pfeuffer, Ken
    ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, ETRA 2023, 2023,
  • [34] Research on gaze-based interaction to 3D display system
    Kwon, Yong-Moo
    Jeon, Kyeong-Won
    Kim, Sung-Kyu
    THREE-DIMENSIONAL TV, VIDEO, AND DISPLAY V, 2006, 6392
  • [35] GazeAR: Mobile Gaze-Based Interaction in the Context of Augmented Reality Games
    Lankes, Michael
    Stiglbauer, Barbara
    AUGMENTED REALITY, VIRTUAL REALITY, AND COMPUTER GRAPHICS, PT I, 2016, 9768 : 397 - 406
  • [36] LAIF: A logging and interaction framework for gaze-based interfaces in virtual entertainment environments
    Nacke, Lennart E.
    Stellmach, Sophie
    Sasse, Dennis
    Niesenhaus, Joerg
    Dachselt, Raimund
    ENTERTAINMENT COMPUTING, 2011, 2 (04) : 265 - 273
  • [37] Gaze-based attention network analysis in a virtual reality classroom
    Stark, Philipp
    Hasenbein, Lisa
    Kasneci, Enkelejda
    Goellner, Richard
    METHODSX, 2024, 12
  • [38] Gaze-Based Prediction of Students' Math Difficulties - A Time Dynamic Machine Learning Approach to Enable Early Individual Assistance
    Kennel, Kathrin
    Ishimaru, Shoya
    Kuechemann, Stefan
    Steinert, Steffen
    Kuhn, Jochen
    Ruzika, Stefan
    INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION, 2025,
  • [39] Gaze-Based Interaction Adaptation for People with Involuntary Head Movements (Student Abstract)
    Tong, Cindy
    Chan, Rosanna
    THIRTY-EIGTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 21, 2024, : 23669 - 23670
  • [40] GazeCast: Using Mobile Devices to Allow Gaze-based Interaction on Public Displays
    Namnakani, Omar
    Sinrattanavong, Penpicha
    Abdrabou, Yasmeen
    Bulling, Andreas
    Alt, Florian
    Khamis, Mohamed
    ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, ETRA 2023, 2023,