Gesture helps learners learn, but not merely by guiding their visual attention

被引:59
|
作者
Wakefield, Elizabeth [1 ,2 ]
Novack, Miriam A. [1 ,3 ]
Congdon, Eliza L. [1 ,4 ]
Franconeri, Steven [3 ]
Goldin-Meadow, Susan [1 ]
机构
[1] Univ Chicago, Dept Psychol, 5848 S Univ Ave, Chicago, IL 60637 USA
[2] Loyola Univ, Dept Psychol, 6525 N Sheridan Rd, Chicago, IL 60626 USA
[3] Northwestern Univ, Dept Psychol, Evanston, IL USA
[4] Bucknell Univ, Dept Psychol, Lewisburg, PA 17837 USA
基金
美国国家科学基金会;
关键词
TEACHERS GESTURES; SPEECH; CHILDREN; HANDS; IDEAS;
D O I
10.1111/desc.12664
中图分类号
B844 [发展心理学(人类心理学)];
学科分类号
040202 ;
摘要
Teaching a new concept through gestureshand movements that accompany speechfacilitates learning above-and-beyond instruction through speech alone (e.g., Singer & Goldin-Meadow, ). However, the mechanisms underlying this phenomenon are still under investigation. Here, we use eye tracking to explore one often proposed mechanismgesture's ability to direct visual attention. Behaviorally, we replicate previous findings: Children perform significantly better on a posttest after learning through Speech+Gesture instruction than through Speech Alone instruction. Using eye tracking measures, we show that children who watch a math lesson with gesture do allocate their visual attention differently from children who watch a math lesson without gesturethey look more to the problem being explained, less to the instructor, and are more likely to synchronize their visual attention with information presented in the instructor's speech (i.e., follow along with speech) than children who watch the no-gesture lesson. The striking finding is that, even though these looking patterns positively predict learning outcomes, the patterns do not mediate the effects of training condition (Speech Alone vs. Speech+Gesture) on posttest success. We find instead a complex relation between gesture and visual attention in which gesture moderates the impact of visual looking patterns on learningfollowing along with speech predicts learning for children in the Speech+Gesture condition, but not for children in the Speech Alone condition. Gesture's beneficial effects on learning thus come not merely from its ability to guide visual attention, but also from its ability to synchronize with speech and affect what learners glean from that speech.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Gesture helps learners learn, but not merely by guiding their visual attention
    Goldin-Meadow, Susan
    Wakefield, Elizabeth
    Novack, Miriam
    Congdon, Eliza
    Franconeri, Steven
    [J]. COGNITIVE PROCESSING, 2018, 19 : S14 - S14
  • [2] Joint Attention Helps Adult Learners Learn New Words
    Hirotani, Masako
    Shimada, Koji
    Okazaki, Shuntaro
    Tanabe, Hiroki C.
    Sadato, Norihiro
    [J]. CANADIAN JOURNAL OF EXPERIMENTAL PSYCHOLOGY-REVUE CANADIENNE DE PSYCHOLOGIE EXPERIMENTALE, 2012, 66 (04): : 321 - 321
  • [3] Guiding Driver Visual Attention with LEDs
    Schmidt, Gerald J.
    Rittger, Lena
    [J]. AUTOMOTIVEUI 2017: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON AUTOMOTIVE USER INTERFACES AND INTERACTIVE VEHICULAR APPLICATIONS, 2017, : 279 - 286
  • [4] On Guiding Visual Attention with Language Specification
    Nasseri, Keyan
    Petryk, Suzanne
    Gonzalez, Joseph
    Dunlap, Lisa
    Darrell, Trevor
    Rohrbach, Anna
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18071 - 18081
  • [5] Sensitivity to parental attention helps children learn new verbs
    Takane, Yuriko Oshima
    Krastev, Sekoul
    Boyle, Kristen
    [J]. INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2016, 51 : 814 - 814
  • [6] Guiding Visual Question Answering with Attention Priors
    Le, Thao Minh
    Le, Vuong
    Gupta, Sunil
    Venkatesh, Svetha
    Tran, Truyen
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 4370 - 4379
  • [7] GUIDING VISUAL ATTENTION BY MANIPULATING ORIENTATION IN IMAGES
    Mateescu, Victor A.
    Bajic, Ivan V.
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME 2013), 2013,
  • [8] Guiding visual attention in individuals with mental retardation
    Serna, RW
    Carlin, MT
    [J]. INTERNATIONAL REVIEW OF RESEARCH IN MENTAL RETARDATION, VOL 24, 2001, 24 : 321 - 357
  • [9] Matjarr Djuyal: How Using Gesture in Teaching Gathang Helps Preschoolers Learn Nouns
    Radley, Anjilkurri
    Jones, Caroline
    Hanham, Jose
    Richards, Mark
    [J]. LANGUAGES, 2021, 6 (02)
  • [10] Image Modification Based on a Visual Saliency Map for Guiding Visual Attention
    Takimoto, Hironori
    Kokui, Tatsuhiko
    Yamauchi, Hitoshi
    Kishihara, Mitsuyoshi
    Okubo, Kensuke
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2015, E98D (11): : 1967 - 1975