The Development of the Ability to Semantically Integrate Information in Speech and Iconic Gesture in Comprehension

被引:32
|
作者
Sekine, Kazuki [1 ]
Sowden, Hannah [2 ]
Kita, Sotaro [1 ]
机构
[1] Univ Warwick, Dept Psychol, Coventry CV4 7AL, W Midlands, England
[2] Univ Kingston, Dept English Language & Commun, Kingston Upon Thames, Surrey, England
关键词
Gesture; Speech; Semantics; Multimodal communication; Preschool children; CHILDREN; COMMUNICATION; OBJECTS; REPRESENTATION; TELEVISION; IMITATION; LANGUAGE; MEMORY; MIND;
D O I
10.1111/cogs.12221
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
We examined whether children's ability to integrate speech and gesture follows the pattern of a broader developmental shift between 3- and 5-year-old children (Ramscar & Gitcho, 2007) regarding the ability to process two pieces of information simultaneously. In Experiment 1, 3-year-olds, 5-year-olds, and adults were presented with either an iconic gesture or a spoken sentence or a combination of the two on a computer screen, and they were instructed to select a photograph that best matched the message. The 3-year-olds did not integrate information in speech and gesture, but 5-year-olds and adults did. In Experiment 2, 3-year-old children were presented with the same speech and gesture as in Experiment 1 that were produced live by an experimenter. When presented live, 3-year-olds could integrate speech and gesture. We concluded that development of the integration ability is a part of the broader developmental shift; however, live-presentation facilitates the nascent integration ability in 3-year-olds.
引用
收藏
页码:1855 / 1880
页数:26
相关论文
共 50 条
  • [31] COMPREHENSION AND PRODUCTION OF GESTURE IN COMBINATION WITH SPEECH IN ONE-WORD SPEAKERS
    MORFORD, M
    GOLDINMEADOW, S
    JOURNAL OF CHILD LANGUAGE, 1992, 19 (03) : 559 - 580
  • [32] Offering a hand to pragmatic understanding: The role of speech and gesture in comprehension and memory
    Kelly, SD
    Barr, DJ
    Church, RB
    Lynch, K
    JOURNAL OF MEMORY AND LANGUAGE, 1999, 40 (04) : 577 - 592
  • [33] The Role of Synchrony and Ambiguity in Speech-Gesture Integration during Comprehension
    Habets, Boukje
    Kita, Sotaro
    Shao, Zeshu
    Oezyurek, Asli
    Hagoort, Peter
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2011, 23 (08) : 1845 - 1854
  • [34] The development of speech and gesture in Sesotho narratives
    Brookes, Heather
    Agyepong, Dorothy
    White, Michelle
    Yalala, Sefela
    GESTURE, 2023, 22 (03) : 233 - 261
  • [35] Getting to the elephants: Gesture and preschoolers' comprehension of route direction information
    Austin, Elizabeth E.
    Sweller, Naomi
    JOURNAL OF EXPERIMENTAL CHILD PSYCHOLOGY, 2017, 163 : 1 - 14
  • [36] The effect of directive words on integrated comprehension of speech and iconic gestures for actions in young children
    Miyake, Hidenori
    Sugimura, Shinichiro
    INFANT AND CHILD DEVELOPMENT, 2018, 27 (05):
  • [37] What Iconic Gesture Fragments Reveal about Gesture-Speech Integration: When Synchrony Is Lost, Memory Can Help
    Obermeier, Christian
    Holle, Henning
    Gunter, Thomas C.
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2011, 23 (07) : 1648 - 1663
  • [38] Beat that Word: How Listeners Integrate Beat Gesture and Focus in Multimodal Speech Discourse
    Dimitrova, Diana
    Chu, Mingyuan
    Wang, Lin
    Ozyurek, Asli
    Hagoort, Peter
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2016, 28 (09) : 1255 - 1269
  • [39] Two Sides of the Same Coin: Speech and Gesture Mutually Interact to Enhance Comprehension
    Kelly, Spencer D.
    Ozyurek, Asli
    Maris, Eric
    PSYCHOLOGICAL SCIENCE, 2010, 21 (02) : 260 - 267
  • [40] Ability of speech production and comprehension in children with developmental language disorder
    Zecevic-Filipovic, L.
    Golubovic, S.
    JOURNAL OF CEREBRAL BLOOD FLOW AND METABOLISM, 2009, 29 : S543 - S543