The Development of the Ability to Semantically Integrate Information in Speech and Iconic Gesture in Comprehension

被引:32
|
作者
Sekine, Kazuki [1 ]
Sowden, Hannah [2 ]
Kita, Sotaro [1 ]
机构
[1] Univ Warwick, Dept Psychol, Coventry CV4 7AL, W Midlands, England
[2] Univ Kingston, Dept English Language & Commun, Kingston Upon Thames, Surrey, England
关键词
Gesture; Speech; Semantics; Multimodal communication; Preschool children; CHILDREN; COMMUNICATION; OBJECTS; REPRESENTATION; TELEVISION; IMITATION; LANGUAGE; MEMORY; MIND;
D O I
10.1111/cogs.12221
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
We examined whether children's ability to integrate speech and gesture follows the pattern of a broader developmental shift between 3- and 5-year-old children (Ramscar & Gitcho, 2007) regarding the ability to process two pieces of information simultaneously. In Experiment 1, 3-year-olds, 5-year-olds, and adults were presented with either an iconic gesture or a spoken sentence or a combination of the two on a computer screen, and they were instructed to select a photograph that best matched the message. The 3-year-olds did not integrate information in speech and gesture, but 5-year-olds and adults did. In Experiment 2, 3-year-old children were presented with the same speech and gesture as in Experiment 1 that were produced live by an experimenter. When presented live, 3-year-olds could integrate speech and gesture. We concluded that development of the integration ability is a part of the broader developmental shift; however, live-presentation facilitates the nascent integration ability in 3-year-olds.
引用
收藏
页码:1855 / 1880
页数:26
相关论文
共 50 条
  • [21] Gesticulator: A framework for semantically-aware speech-driven gesture generation
    Kucherenko, Taras
    Jonell, Patrik
    van Waveren, Sanne
    Henter, Gustav Eje
    Alexanderson, Simon
    Leite, Iolanda
    Kjellstrom, Hedvig
    PROCEEDINGS OF THE 2020 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, ICMI 2020, 2020, : 242 - 250
  • [22] Information packaging in speech shapes information packaging in gesture: The role of speech planning units in the coordination of speech-gesture production
    Fritz, Isabella
    Kita, Sotaro
    Littlemore, Jeannette
    Krott, Andrea
    JOURNAL OF MEMORY AND LANGUAGE, 2019, 104 : 56 - 69
  • [23] Visual Context Enhanced: The Joint Contribution of Iconic Gestures and Visible Speech to Degraded Speech Comprehension
    Drijvers, Linda
    Ozyurek, Asli
    JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2017, 60 (01): : 212 - 222
  • [24] Efficiency of Speech and Iconic Gesture Integration For Robotic and Human Communicators - a Direct Comparison
    Bremner, Paul
    Leonards, Ute
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2015, : 1999 - 2006
  • [25] An intentional stance modulates the integration of gesture and speech during comprehension
    Kelly, Spencer D.
    Ward, Sarah
    Creigh, Peter
    Bartolotti, James
    BRAIN AND LANGUAGE, 2007, 101 (03) : 222 - 233
  • [26] Auditory comprehension in Alzheimer disease: Influences of gesture and speech rate
    Pashek, Gail V.
    DiVenere, Evelyn
    JOURNAL OF MEDICAL SPEECH-LANGUAGE PATHOLOGY, 2006, 14 (03) : 143 - 155
  • [27] Second Language Speech Intelligibility Revisited: Differential Roles of Phonological Accuracy, Visual Speech, and Iconic Gesture
    Wheeler, Page
    Saito, Kazuya
    MODERN LANGUAGE JOURNAL, 2022, 106 (02): : 429 - 448
  • [28] The development of the ability to recognize the meaning of iconic signs
    Tolar, Tammy D.
    Lederberg, Amy R.
    Gokhale, Sonali
    Tomasello, Michael
    JOURNAL OF DEAF STUDIES AND DEAF EDUCATION, 2008, 13 (02): : 225 - 240
  • [29] How early do children understand gesture-speech combinations with iconic gestures?
    Stanfield, Carmen
    Williamson, Rebecca
    Ozcaliskan, Seyda
    JOURNAL OF CHILD LANGUAGE, 2014, 41 (02) : 462 - 471
  • [30] Emoji as gesture in digital communication: Emoji improve comprehension of indirect speech
    Hancock, Patrick M.
    Hilverman, Caitlin
    Cook, Susan Wagner
    Halvorson, Kimberly M.
    PSYCHONOMIC BULLETIN & REVIEW, 2024, 31 (03) : 1335 - 1347