The Development of the Ability to Semantically Integrate Information in Speech and Iconic Gesture in Comprehension

被引:32
|
作者
Sekine, Kazuki [1 ]
Sowden, Hannah [2 ]
Kita, Sotaro [1 ]
机构
[1] Univ Warwick, Dept Psychol, Coventry CV4 7AL, W Midlands, England
[2] Univ Kingston, Dept English Language & Commun, Kingston Upon Thames, Surrey, England
关键词
Gesture; Speech; Semantics; Multimodal communication; Preschool children; CHILDREN; COMMUNICATION; OBJECTS; REPRESENTATION; TELEVISION; IMITATION; LANGUAGE; MEMORY; MIND;
D O I
10.1111/cogs.12221
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
We examined whether children's ability to integrate speech and gesture follows the pattern of a broader developmental shift between 3- and 5-year-old children (Ramscar & Gitcho, 2007) regarding the ability to process two pieces of information simultaneously. In Experiment 1, 3-year-olds, 5-year-olds, and adults were presented with either an iconic gesture or a spoken sentence or a combination of the two on a computer screen, and they were instructed to select a photograph that best matched the message. The 3-year-olds did not integrate information in speech and gesture, but 5-year-olds and adults did. In Experiment 2, 3-year-old children were presented with the same speech and gesture as in Experiment 1 that were produced live by an experimenter. When presented live, 3-year-olds could integrate speech and gesture. We concluded that development of the integration ability is a part of the broader developmental shift; however, live-presentation facilitates the nascent integration ability in 3-year-olds.
引用
收藏
页码:1855 / 1880
页数:26
相关论文
共 50 条
  • [41] Integration of iconic gestures and speech in left superior temporal areas boosts speech comprehension under adverse listening conditions
    Holle, Henning
    Obleser, Jonas
    Rueschemeyer, Shirley-Ann
    Gunter, Thomas C.
    NEUROIMAGE, 2010, 49 (01) : 875 - 884
  • [42] Degree of Language Experience Modulates Visual Attention to Visible Speech and Iconic Gestures During Clear and Degraded Speech Comprehension
    Drijvers, Linda
    Vaitonyte, Julija
    Ozyurek, Asli
    COGNITIVE SCIENCE, 2019, 43 (10)
  • [43] Gesture-speech phenomena, learning, and development
    Roth, WM
    EDUCATIONAL PSYCHOLOGIST, 2003, 38 (04) : 249 - 263
  • [44] Physical and Perceptual Factors Shape the Neural Mechanisms That Integrate Audiovisual Signals in Speech Comprehension
    Lee, HweeLing
    Noppeney, Uta
    JOURNAL OF NEUROSCIENCE, 2011, 31 (31): : 11338 - 11350
  • [45] Children integrate speech and gesture across a wider temporal window than speech and action when learning a math concept
    Carrazza, Cristina
    Wakefield, Elizabeth M.
    Hemani-Lopez, Naureen
    Plath, Kristin
    Goldin-Meadow, Susan
    COGNITION, 2021, 210
  • [46] A speaker's gesture style can affect language comprehension: ERP evidence from gesture-speech integration
    Obermeier, Christian
    Kelly, Spencer D.
    Gunter, Thomas C.
    SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2015, 10 (09) : 1236 - 1243
  • [47] A development framework for semantically interoperable health information systems
    Lopez, Diego M.
    Blobel, Bernd G. M. E.
    INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, 2009, 78 (02) : 83 - 103
  • [48] Neural development of networks for audiovisual speech comprehension
    Dick, Anthony Steven
    Solodkin, Ana
    Small, Steven L.
    BRAIN AND LANGUAGE, 2010, 114 (02) : 101 - 114
  • [49] Part of the message comes in gesture: how people with aphasia convey information in different gesture types as compared with information in their speech
    van Nispen, Karin
    van de Sandt-Koenderman, Mieke
    Sekine, Kazuki
    Krahmer, Emiel
    Rose, Miranda L.
    APHASIOLOGY, 2017, 31 (09) : 1078 - 1103
  • [50] Supramodal neural processing of abstract information conveyed by speech and gesture
    Straube, Benjamin
    He, Yifei
    Steines, Miriam
    Gebhardt, Helge
    Kircher, Tilo
    Sammer, Gebhard
    Nagels, Arne
    FRONTIERS IN BEHAVIORAL NEUROSCIENCE, 2013, 7