Multimodal versus unimodal instruction in a complex learning context

被引:35
|
作者
Gellevij, M [1 ]
Van der Meij, H [1 ]
De Jong, T [1 ]
Pieters, J [1 ]
机构
[1] Univ Twente, Dept Educ Sci & Technol, NL-7500 AE Enschede, Netherlands
来源
JOURNAL OF EXPERIMENTAL EDUCATION | 2002年 / 70卷 / 03期
关键词
cognitive load; documentation; dual coding; screen captures; usability visualizations;
D O I
10.1080/00220970209599507
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Multimodal instruction with text and pictures was compared with unimodal, text-only instruction. More specifically, 44 students used a visual or a textual manual to learn a complex software application. During 2 103-116-min training sessions, cognitive load, and time and ability to recover from errors were measured. After training, the authors tested students' learning on trained and untrained tasks. The results for cognitive load, training time, and learning effects initially supported dual coding theory. The results show that even in this complex situation, multimodal instruction led to a better performance than unimodal instruction. That is, the multimodal manual led to a stronger mental model of the computer program, improved identification of window elements and objects, and speeded up the location of window elements and objects.
引用
收藏
页码:215 / 239
页数:25
相关论文
共 50 条
  • [1] Learning With Privileged Multimodal Knowledge for Unimodal Segmentation
    Chen, Cheng
    Dou, Qi
    Jin, Yueming
    Liu, Quande
    Heng, Pheng Ann
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (03) : 621 - 632
  • [2] The Effects of Unimodal Representation Choices on Multimodal Learning
    Ito, Fernando Tadao
    Caseli, Helena de Medeiros
    Moreira, Jander
    [J]. PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2018), 2018, : 2119 - 2126
  • [3] Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representations
    Mai S.
    Zeng Y.
    Hu H.
    [J]. IEEE Transactions on Multimedia, 2023, 25 : 4121 - 4134
  • [4] Arabic language investigation in the context of unimodal and multimodal sentiment analysis
    Youcef, Fatima Zohra
    Barigou, Fatiha
    [J]. 2021 22ND INTERNATIONAL ARAB CONFERENCE ON INFORMATION TECHNOLOGY (ACIT), 2021, : 19 - 25
  • [5] Improving Unimodal Object Recognition with Multimodal Contrastive Learning
    Meyer, Johannes
    Eitel, Andreas
    Brox, Thomas
    Burgard, Wolfram
    [J]. 2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 5656 - 5663
  • [6] Multimodal communication and mate choice in wolf spiders: female response to multimodal versus unimodal signals
    Uetz, George W.
    Roberts, J. Andrew
    Taylor, Phillip W.
    [J]. ANIMAL BEHAVIOUR, 2009, 78 (02) : 299 - 305
  • [7] Unimodal and Multimodal Integrated Representation Learning via Improved Information Bottleneck for Multimodal Sentiment Analysis
    Zhang, Tonghui
    Dong, Changfei
    Su, Jinsong
    Zhang, Haiying
    Li, Yuzheng
    [J]. NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2022, PT I, 2022, 13551 : 564 - 576
  • [8] Gradient Decoupled Learning With Unimodal Regularization for Multimodal Remote Sensing Classification
    Wei, Shicai
    Luo, Chunbo
    Ma, Xiaoguang
    Luo, Yang
    [J]. IEEE Transactions on Geoscience and Remote Sensing, 2024, 62
  • [9] Learning to Learn Better Unimodal Representations via Adaptive Multimodal Meta-Learning
    Sun, Ya
    Mai, Sijie
    Hu, Haifeng
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (03) : 2209 - 2223
  • [10] Unimodal statistical learning produces multimodal object-like representations
    Lengyel, Gabor
    Zalalyte, Goda
    Pantelides, Alexandros
    Ingram, James N.
    Fiser, Jozsef
    Lengyel, Mate
    Wolpert, Daniel M.
    [J]. ELIFE, 2019, 8