A review of machine learning in scanpath analysis for passive gaze-based interaction

被引:1
|
作者
Selim, Abdulrahman Mohamed [1 ]
Barz, Michael [1 ,2 ]
Bhatti, Omair Shahzad [1 ]
Alam, Hasan Md Tusfiqur [1 ]
Sonntag, Daniel [1 ,2 ]
机构
[1] German Res Ctr Artificial Intelligence DFKI, Interact Machine Learning Dept, Saarbrucken, Germany
[2] Carl von Ossietzky Univ Oldenburg, Appl Artificial Intelligence, Oldenburg, Germany
来源
关键词
machine learning; eye tracking; scanpath; passive gaze-based interaction; literature review; EYE-MOVEMENT PATTERNS; TRACKING; PREDICTION; CLASSIFICATION; RECOGNITION; ALGORITHMS; VISUALIZATION; ACCURACY; NETWORKS; SEARCH;
D O I
10.3389/frai.2024.1391745
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The scanpath is an important concept in eye tracking. It refers to a person's eye movements over a period of time, commonly represented as a series of alternating fixations and saccades. Machine learning has been increasingly used for the automatic interpretation of scanpaths over the past few years, particularly in research on passive gaze-based interaction, i.e., interfaces that implicitly observe and interpret human eye movements, with the goal of improving the interaction. This literature review investigates research on machine learning applications in scanpath analysis for passive gaze-based interaction between 2012 and 2022, starting from 2,425 publications and focussing on 77 publications. We provide insights on research domains and common learning tasks in passive gaze-based interaction and present common machine learning practices from data collection and preparation to model selection and evaluation. We discuss commonly followed practices and identify gaps and challenges, especially concerning emerging machine learning topics, to guide future research in the field.
引用
收藏
页数:28
相关论文
共 50 条
  • [21] Gaze-based Notetaking for Learning from Lecture Videos
    Nguyen, Cuong
    Liu, Feng
    34TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2016, 2016, : 2093 - 2097
  • [22] A passive BCI for monitoring the intentionality of the gaze-based moving object selection
    Zhao, Darisy G.
    Vasilyev, Anatoly N.
    Kozyrskiy, Bogdan L.
    Melnichuk, Eugeny, V
    Isachenko, Andrey, V
    Velichkovsky, Boris M.
    Shishkin, Sergei L.
    JOURNAL OF NEURAL ENGINEERING, 2021, 18 (02)
  • [23] Gaze-based prediction of pen-based virtual interaction tasks
    Cig, Cagia
    Sezgin, Tevfik Metin
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2015, 73 : 91 - 106
  • [24] Gaze-Based Human-Robot Interaction by the Brunswick Model
    Berra, Riccardo
    Setti, Francesco
    Cristani, Marco
    IMAGE ANALYSIS AND PROCESSING - ICIAP 2019, PT II, 2019, 11752 : 511 - 521
  • [25] GazeScale: Towards General Gaze-Based Interaction in Public Places
    Porta, Marco
    Caminiti, Antonino
    Dondi, Piercarlo
    PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, ICMI 2022, 2022, : 591 - 596
  • [26] A Non-Verbal Turing Test: Differentiating Mind from Machine in Gaze-Based Social Interaction
    Pfeiffer, Ulrich J.
    Timmermans, Bert
    Bente, Gary
    Vogeley, Kai
    Schilbach, Leonhard
    PLOS ONE, 2011, 6 (11):
  • [27] Proposing Gaze-Based Interaction and Automated Screening Results for Visual Aerial Image Analysis
    Hild, Jutta
    Sommer, Lars
    Holzbach, Gerrit
    Voit, Michael
    Peinsipp-Byma, Elisabeth
    ENGINEERING PSYCHOLOGY AND COGNITIVE ERGONOMICS, EPCE 2023, PT I, 2023, 14017 : 200 - 214
  • [28] Interaction Design of Dwell Selection Toward Gaze-based AR/VR Interaction
    Isomoto, Toshiya
    Yamanaka, Shota
    Shizuki, Buntarou
    2022 ACM SYMPOSIUM ON EYE TRACKING RESEARCH AND APPLICATIONS, ETRA 2022, 2022,
  • [29] A Gaze-Based Analysis of Human Detection of Email Phishing
    Pietrantonio, Francesco
    Botta, Alessio
    Zinno, Stefania
    Ventre, Giorgio
    Gallo, Luigi
    Mancuso, Laura
    Presta, Roberta
    2024 SILICON VALLEY CYBERSECURITY CONFERENCE, SVCC 2024, 2024,
  • [30] Gaze-Based Assessments of Vigilance and Avoidance in Social Anxiety: a Review
    Chen, Nigel T. M.
    Clarke, Patrick J. F.
    CURRENT PSYCHIATRY REPORTS, 2017, 19 (09)