Gesture helps learners learn, but not merely by guiding their visual attention

被引:59
|
作者
Wakefield, Elizabeth [1 ,2 ]
Novack, Miriam A. [1 ,3 ]
Congdon, Eliza L. [1 ,4 ]
Franconeri, Steven [3 ]
Goldin-Meadow, Susan [1 ]
机构
[1] Univ Chicago, Dept Psychol, 5848 S Univ Ave, Chicago, IL 60637 USA
[2] Loyola Univ, Dept Psychol, 6525 N Sheridan Rd, Chicago, IL 60626 USA
[3] Northwestern Univ, Dept Psychol, Evanston, IL USA
[4] Bucknell Univ, Dept Psychol, Lewisburg, PA 17837 USA
基金
美国国家科学基金会;
关键词
TEACHERS GESTURES; SPEECH; CHILDREN; HANDS; IDEAS;
D O I
10.1111/desc.12664
中图分类号
B844 [发展心理学(人类心理学)];
学科分类号
040202 ;
摘要
Teaching a new concept through gestureshand movements that accompany speechfacilitates learning above-and-beyond instruction through speech alone (e.g., Singer & Goldin-Meadow, ). However, the mechanisms underlying this phenomenon are still under investigation. Here, we use eye tracking to explore one often proposed mechanismgesture's ability to direct visual attention. Behaviorally, we replicate previous findings: Children perform significantly better on a posttest after learning through Speech+Gesture instruction than through Speech Alone instruction. Using eye tracking measures, we show that children who watch a math lesson with gesture do allocate their visual attention differently from children who watch a math lesson without gesturethey look more to the problem being explained, less to the instructor, and are more likely to synchronize their visual attention with information presented in the instructor's speech (i.e., follow along with speech) than children who watch the no-gesture lesson. The striking finding is that, even though these looking patterns positively predict learning outcomes, the patterns do not mediate the effects of training condition (Speech Alone vs. Speech+Gesture) on posttest success. We find instead a complex relation between gesture and visual attention in which gesture moderates the impact of visual looking patterns on learningfollowing along with speech predicts learning for children in the Speech+Gesture condition, but not for children in the Speech Alone condition. Gesture's beneficial effects on learning thus come not merely from its ability to guide visual attention, but also from its ability to synchronize with speech and affect what learners glean from that speech.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] A study on improving performance in gesture training through visual guidance based on learners' errors
    Jeanne, Florian
    Thouvenin, Indira
    Lenglet, Alban
    [J]. VRST'17: PROCEEDINGS OF THE 23RD ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY, 2017,
  • [32] Design and Evaluation of Visual Cues for Restoring and Guiding Visual Attention in Eye-Tracked VR
    Woodworth, Jason W.
    Yoshimura, Andrew
    Lipari, Nicholas G.
    Borst, Christoph W.
    [J]. 2023 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS, VRW, 2023, : 442 - 450
  • [33] Joint attention helps infants learn new words: event-related potential evidence
    Hirotani, Masako
    Stets, Manuela
    Striano, Tricia
    Friederici, Angela D.
    [J]. NEUROREPORT, 2009, 20 (06) : 600 - 605
  • [34] Synchronized practice helps bearded capuchin monkeys learn to extend attention while learning a tradition
    Fragaszy, Dorothy M.
    Eshchar, Yonat
    Visalberghi, Elisabetta
    Resende, Briseida
    Laity, Kellie
    Izar, Patricia
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2017, 114 (30) : 7798 - 7805
  • [35] Tracking learners' visual attention during a multimedia presentation in a real classroom
    Yang, Fang-Ying
    Chang, Chun-Yen
    Chien, Wan-Ru
    Chien, Yu-Ta
    Tseng, Yuen-Hsien
    [J]. COMPUTERS & EDUCATION, 2013, 62 : 208 - 220
  • [36] What Do Deep Saliency Models Learn about Visual Attention?
    Chen, Shi
    Jiang, Ming
    Zhao, Qi
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [37] The Cascading Development of Visual Attention in Infancy: Learning to Look and Looking to Learn
    Oakes, Lisa M.
    [J]. CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE, 2023, 32 (05) : 410 - 417
  • [38] Novel Methodology for Guiding Attention of Faces through Relative Visual Saliency (RVS)
    Kumar, Ravi Kant
    Garain, Jogendra
    Sanyal, Goutam
    Kisku, Dakshina Ranjan
    [J]. 2015 INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS ICCAR 2015, 2015, : 228 - 232
  • [39] A Study on the Possibility of Applying Subliminal Visual Cue for Guiding Subject's Attention
    Takahashi, Hiroshi
    Honda, Hirohiko
    [J]. JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2012, 16 (01) : 96 - 107
  • [40] The Role of Target-Distractor Relationships in Guiding Attention and the Eyes in Visual Search
    Becker, Stefanie I.
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2010, 139 (02) : 247 - 265