Eye-tracking and artificial intelligence to enhance motivation and learning

被引:46
|
作者
Sharma, Kshitij [1 ]
Giannakos, Michail [1 ]
Dillenbourg, Pierre [2 ]
机构
[1] Norwegian Univ Sci & Technol, Dept Comp Sci, Trondheim, Norway
[2] Ecole Polytech Fed Lausanne, Dept Comp Sci, Lausanne, Switzerland
关键词
Eye-tracking; Motivation; Learning; MOOCs; Video based learning; Multimodal analytics; Massive open online courses; Deep learning; READING TIME; COMPREHENSION;
D O I
10.1186/s40561-020-00122-x
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
The interaction with the various learners in a Massive Open Online Course (MOOC) is often complex. Contemporary MOOC learning analytics relate with click-streams, keystrokes and other user-input variables. Such variables however, do not always capture users' learning and behavior (e.g., passive video watching). In this paper, we present a study with 40 students who watched a MOOC lecture while their eye-movements were being recorded. We then proposed a method to define stimuli-based gaze variables that can be used for any kind of stimulus. The proposed stimuli-based gaze variables indicate students' content-coverage (in space and time) and reading processes (area of interest based variables) and attention (i.e., with-me-ness), at the perceptual (following teacher's deictic acts) and conceptual levels (following teacher discourse). In our experiment, we identified a significant mediation effect of the content coverage, reading patterns and the two levels of with-me-ness on the relation between students' motivation and their learning performance. Such variables enable common measurements for the different kind of stimuli present in distinct MOOCs. Our long-term goal is to create student profiles based on their performance and learning strategy using stimuli-based gaze variables and to provide students gaze-aware feedback to improve overall learning process. One key ingredient in the process of achieving a high level of adaptation in providing gaze-aware feedback to the students is to use Artificial Intelligence (AI) algorithms for prediction of student performance from their behaviour. In this contribution, we also present a method combining state-of-the-art AI technique with the eye-tracking data to predict student performance. The results show that the student performance can be predicted with an error of less than 5%.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Eye-tracking and artificial intelligence to enhance motivation and learning
    Kshitij Sharma
    Michail Giannakos
    Pierre Dillenbourg
    [J]. Smart Learning Environments, 7
  • [2] Eye-Tracking to Enhance Usability: A Race Game
    Ilhan, A. Ezgi
    [J]. INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 1, 2019, 868 : 201 - 214
  • [3] Uncovering Learning Styles through Eye Tracking and Artificial Intelligence
    Bittner, Dominik
    Nadimpalli, Vamsi Krishna
    Grabinger, Lisa
    Ezer, Timur
    Hauser, Florian
    Mottok, Juergen
    [J]. PROCEEDINGS OF THE 2024 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, ETRA 2024, 2024,
  • [4] Eye-tracking
    Tanenhaus, MK
    SpiveyKnowlton, MJ
    [J]. LANGUAGE AND COGNITIVE PROCESSES, 1996, 11 (06): : 583 - 588
  • [5] STUDYING LEARNING IN GAMES USING EYE-TRACKING
    Knoepfle, Daniel T.
    Wang, Joseph Tao-yi
    Camerer, Colin F.
    [J]. JOURNAL OF THE EUROPEAN ECONOMIC ASSOCIATION, 2009, 7 (2-3) : 388 - 398
  • [6] AI for Psychometrics: Validating Machine Learning Models in Measuring Emotional Intelligence with Eye-Tracking Techniques
    Wang, Wei
    Kofler, Liat
    Lindgren, Chapman
    Lobel, Max
    Murphy, Amanda
    Tong, Qiwen
    Pickering, Kemar
    [J]. JOURNAL OF INTELLIGENCE, 2023, 11 (09)
  • [7] The Zero Effect: An Eye-Tracking Study of Affect and Motivation in Risky Choices
    Ludwig, Jonas
    Jaudas, Alexander
    Achtziger, Anja
    [J]. JOURNAL OF BEHAVIORAL DECISION MAKING, 2024, 37 (03)
  • [8] Eye-Tracking Feature Extraction for Biometric Machine Learning
    Lim, Jia Zheng
    Mountstephens, James
    Teo, Jason
    [J]. FRONTIERS IN NEUROROBOTICS, 2022, 15
  • [9] An eye-tracking study of cueing effects in multimedia learning
    Jamet, Eric
    [J]. COMPUTERS IN HUMAN BEHAVIOR, 2014, 32 : 47 - 53
  • [10] Learning to detect objects from eye-tracking data
    Papadopoulous, D. P.
    Clarke, A. D. F.
    Keller, F.
    Ferrari, V.
    [J]. I-PERCEPTION, 2014, 5 (05):