Measuring Cognitive Load in Virtual Reality Training via Pupillometry

被引:0
|
作者
Lee, Joy Yeonjoo [1 ]
de Jong, Nynke [2 ]
Donkers, Jeroen [3 ]
Jarodzka, Halszka [4 ]
van Merrienboer, Jeroen J. G. [3 ]
机构
[1] Leiden Univ, Fac Governance & Global Affairs, NL-2501 EE The Hague, Netherlands
[2] Maastricht Univ, Fac Hlth Med & Life Sci, Hlth Serv Res, NL-6200 MD Maastricht, Netherlands
[3] Maastricht Univ, Sch Hlth Profess Educ, Fac Hlth Med & Life Sci, NL-6200 MD Maastricht, Netherlands
[4] Open Univ, Fac Educ Sci, Heerlen, Netherlands
关键词
Cognitive load; educational simulations; medical training; mobile and personal devices; personalized e-learning; virtual and augmented reality; PUPIL SIZE; PROCESSING LOAD; MEMORY; GAZE; EDUCATION; DIAMETER; OUTCOMES; DESIGN; TOOLS; K-12;
D O I
10.1109/TLT.2023.3326473
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Pupillometry is known as a reliable technique to measure cognitive load in learning and performance. However, its applicability to virtual reality (VR) environments, an emerging technology for simulation-based training, has not been well-verified in educational contexts. Specifically, the VR display causes light reflexes that confound task-evoked pupillary responses (TEPRs), impairing cognitive load measures. Through this pilot study, we validated whether task difficulty can predict cognitive load as measured by TEPRs corrected for the light reflex and if these TEPRs correlate with cognitive load self-ratings and performance. A total number of 14 students in health sciences performed observation tasks in two conditions: difficult versus easy tasks while watching a VR scenario in home health care. Then, a cognitive load self-rating ensued. We used a VR system with a built-in eye tracker and a photosensor installed to assess pupil diameter and light intensity during the scenario. Employing a method from the human-computer interaction field, we determined TEPRs by modeling the pupil light reflexes using a baseline. As predicted, the difficult task caused significantly larger TEPRs than the easy task. Only in the difficult task condition did TEPRs positively correlate with the performance measure. These results suggest that TEPRs are valid measures of cognitive load in VR training when corrected for the light reflex. It opens up possibilities of using real-time cognitive load for assessment and instructional design for VR training. Future studies should test our findings with a larger sample size, in various domains, involving complex VR functions such as haptic interaction.
引用
收藏
页码:704 / 710
页数:7
相关论文
共 50 条
  • [1] Cognitive Load Estimation Based on Pupillometry in Virtual Reality with Uncontrolled Scene Lighting
    Eckert, Marie
    Habets, Emanuel A. P.
    Rummukainen, Olli S.
    [J]. 2021 13TH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2021, : 73 - 76
  • [2] Training cognitive skills in virtual reality: Measuring performance
    Tichon, Jennifer
    [J]. CYBERPSYCHOLOGY & BEHAVIOR, 2007, 10 (02): : 286 - 289
  • [3] Assessing Cognitive Load via Pupillometry
    Weber, Pavel
    Rupprecht, Franca
    Wiesen, Stefan
    Hamann, Bernd
    Ebert, Achim
    [J]. ADVANCES IN ARTIFICIAL INTELLIGENCE AND APPLIED COGNITIVE COMPUTING, 2021, : 1087 - 1096
  • [4] Virtual Reality in Cognitive Training
    Matre, Martin
    Johansen, Truls
    Lovstad, Marianne
    [J]. BRAIN INJURY, 2019, 33 : 114 - 114
  • [5] Cognitive training with virtual reality
    Ghyme, S
    Kim, MY
    Choi, JS
    [J]. CISST'03: PROCEEDING OF THE INTERNATIONAL CONFERENCE ON IMAGING SCIENCE, SYSTEMS AND TECHNOLOGY, VOLS 1 AND 2, 2003, : 358 - 362
  • [6] Measuring Cognitive Load and Insight: A Methodology Exemplified in a Virtual Reality Learning Context
    Collins, Jonny
    Regenbrecht, Holger
    Langlotz, Tobias
    Can, Yekta Said
    Ersoy, Cem
    Butson, Russell
    [J]. 2019 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR), 2019, : 351 - 362
  • [7] Cognitive Load/flow and Performance in Virtual Reality Simulation Training of Laparoscopic Surgery
    Yu, Peng
    Pan, Junjun
    Wang, Zhaoxue
    Shen, Yang
    Wang, Lili
    Li, Jialun
    Hao, Aimin
    Wang, Haipeng
    [J]. 2021 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS (VRW 2021), 2021, : 468 - 469
  • [8] The effect of distributed virtual reality simulation training on cognitive load during subsequent dissection training
    Andersen, Steven Arild Wuyts
    Konge, Lars
    Sorensen, Mads Solvsten
    [J]. MEDICAL TEACHER, 2018, 40 (07) : 684 - 689
  • [9] Measuring Cognitive Load: Heart-rate Variability and Pupillometry Assessment
    Urrestilla, Nerea
    St-Onge, David
    [J]. COMPANION PUBLICATON OF THE 2020 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (ICMI '20 COMPANION), 2020, : 405 - 410
  • [10] Dynamic Cognitive Load Assessment in Virtual Reality
    Elkin, Rachel L.
    Beaubien, Jeff M.
    Damaghi, Nathaniel
    Chang, Todd P.
    Kessler, David O.
    [J]. SIMULATION & GAMING, 2024, 55 (04) : 755 - 775