Infant perception of audio-visual speech synchrony in familiar and unfamiliar fluent speech

被引:24
|
作者
Pons, Ferran [1 ,2 ]
Lewkowicz, David J. [3 ,4 ]
机构
[1] Univ Barcelona, Dept Psicol Basica, Barcelona 08035, Spain
[2] Inst Brain Cognit & Behav IR3C, Barcelona, Spain
[3] Florida Atlantic Univ, Dept Psychol, Boca Raton, FL 33431 USA
[4] Florida Atlantic Univ, Ctr Complex Syst & Brain Sci, Boca Raton, FL 33431 USA
关键词
Infancy; Speech perception; Audiovisual perception; LANGUAGE DISCRIMINATION; INTERSENSORY PERCEPTION; BILINGUAL ENVIRONMENTS; SELECTIVE ATTENTION; TEMPORAL WINDOW; INTEGRATION; RECALIBRATION; RECOGNITION; ASYNCHRONY; ABILITIES;
D O I
10.1016/j.actpsy.2013.12.013
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
We investigated the effects of linguistic experience and language familiarity on the perception of audio-visual (A-V) synchrony in fluent speech. In Experiment 1, we tested a group of monolingual Spanish- and Catalan-learning 8-month-old infants to a video clip of a person speaking Spanish. Following habituation to the audiovisually synchronous video, infants saw and heard desynchronized clips of the same video where the audio stream now preceded the video stream by 366, 500, or 666 ms. In Experiment 2, monolingual Catalan and Spanish infants were tested with a video clip of a person speaking English. Results indicated that in both experiments, infants detected a 666 and a 500 ms asynchrony. That is, their responsiveness to A-V synchrony was the same regardless of their specific linguistic experience or familiarity with the tested language. Compared to previous results from infant studies with isolated audiovisual syllables, these results show that infants are more sensitive to A-V temporal relations inherent in fluent speech. Furthermore, the absence of a language familiarity effect on the detection of A-V speech asynchrony at eight months of age is consistent with the broad perceptual tuning usually observed in infant response to linguistic input at this age. (C) 2014 Elsevier B.V. All rights reserved.
引用
收藏
页码:142 / 147
页数:6
相关论文
共 50 条
  • [1] Infant Perception of Audio-Visual Speech Synchrony
    Lewkowicz, David J.
    [J]. DEVELOPMENTAL PSYCHOLOGY, 2010, 46 (01) : 66 - 77
  • [2] Audio-visual speech perception without speech cues
    Saldana, HM
    Pisoni, DB
    Fellowes, JM
    Remez, RE
    [J]. ICSLP 96 - FOURTH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, PROCEEDINGS, VOLS 1-4, 1996, : 2187 - 2190
  • [3] Audio-visual speech perception is special
    Tuomainen, J
    Andersen, TS
    Tiippana, K
    Sams, M
    [J]. COGNITION, 2005, 96 (01) : B13 - B22
  • [4] Perception of audiovisual speech synchrony for familiar and unfamiliar ethnic speakers.
    Ujiie, Yuta
    Takahashi, Kohske
    [J]. PERCEPTION, 2022, 51 : 91 - 91
  • [5] AUDIO-VISUAL SPEECH PERCEPTION - A PRELIMINARY REPORT
    EWERTSEN, HW
    NIELSEN, HB
    NIELSEN, SS
    [J]. ACTA OTO-LARYNGOLOGICA, 1970, : 229 - &
  • [6] The coordination of production and perception in audio-visual speech
    Vatikiotis-Bateson, E
    Munhall, KG
    [J]. INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2000, 35 (3-4) : 281 - 281
  • [7] Audio-visual speech in noise perception in dyslexia
    van Laarhoven, Thijs
    Keetels, Mirjam
    Schakel, Lemmy
    Vroomen, Jean
    [J]. DEVELOPMENTAL SCIENCE, 2018, 21 (01)
  • [8] Talker variability in audio-visual speech perception
    Heald, Shannon L. M.
    Nusbaum, Howard C.
    [J]. FRONTIERS IN PSYCHOLOGY, 2014, 5
  • [9] The effect of audibility on audio-visual speech perception in infant cochlear implant recipients
    Barker, BA
    Bass-Ringdahl, SM
    [J]. COCHLEAR IMPLANTS, 2004, 1273 : 316 - 319
  • [10] An audio-visual corpus for speech perception and automatic speech recognition (L)
    Cooke, Martin
    Barker, Jon
    Cunningham, Stuart
    Shao, Xu
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2006, 120 (05): : 2421 - 2424