The Development of Cortical Responses to the Integration of Audiovisual Speech in Infancy

被引:2
|
作者
Dopierala, Aleksandra A. W. [1 ,2 ]
Perez, David Lopez [3 ]
Mercure, Evelyne [4 ]
Pluta, Agnieszka [1 ,6 ]
Malinowska-Korczak, Anna [3 ]
Evans, Samuel [5 ,6 ]
Wolak, Tomasz [7 ]
Tomalski, Przemyslaw [1 ,3 ]
机构
[1] Univ Warsaw, Fac Psychol, Warsaw, Poland
[2] Univ British Columbia, Dept Psychol, Vancouver, BC, Canada
[3] Polish Acad Sci, Inst Psychol, Warsaw, Poland
[4] Goldsmiths Univ London, London, England
[5] Kings Coll London, London, England
[6] Univ Westminister, London, England
[7] Inst Physiol & Pathol Hearing, Bioimaging Res Ctr, World Hearing Ctr, Warsaw, Poland
关键词
fNIRS; Audiovisual integration; Infant; Speech processing; Neurocognitive development; INFERIOR FRONTAL-CORTEX; PERCEPTION; INFORMATION; ORIGINS; FACE;
D O I
10.1007/s10548-023-00959-8
中图分类号
R74 [神经病学与精神病学];
学科分类号
摘要
In adults, the integration of audiovisual speech elicits specific higher (super-additive) or lower (sub-additive) cortical responses when compared to the responses to unisensory stimuli. Although there is evidence that the fronto-temporal network is active during perception of audiovisual speech in infancy, the development of fronto-temporal responses to audiovisual integration remains unknown. In the current study, 5-month-olds and 10-month-olds watched bimodal (audiovisual) and alternating unimodal (auditory + visual) syllables. In this context we use alternating unimodal to denote alternating auditory and visual syllables that are perceived as separate syllables by adults. Using fNIRS we measured responses over large cortical areas including the inferior frontal and superior temporal regions. We identified channels showing different responses to bimodal than alternating unimodal condition and used multivariate pattern analysis (MVPA) to decode patterns of cortical responses to bimodal (audiovisual) and alternating unimodal (auditory + visual) speech. Results showed that in both age groups integration elicits cortical responses consistent with both super- and sub-additive responses in the fronto-temporal cortex. The univariate analyses revealed that between 5 and 10 months spatial distribution of these responses becomes increasingly focal. MVPA correctly classified responses at 5 months, with key input from channels located in the inferior frontal and superior temporal channels of the right hemisphere. However, MVPA classification was not successful at 10 months, suggesting a potential cortical re-organisation of audiovisual speech perception at this age. These results show the complex and non-gradual development of the cortical responses to integration of congruent audiovisual speech in infancy.
引用
收藏
页码:459 / 475
页数:17
相关论文
共 50 条
  • [1] The Development of Cortical Responses to the Integration of Audiovisual Speech in Infancy
    Aleksandra A. W. Dopierała
    David López Pérez
    Evelyne Mercure
    Agnieszka Pluta
    Anna Malinowska-Korczak
    Samuel Evans
    Tomasz Wolak
    Przemysław Tomalski
    [J]. Brain Topography, 2023, 36 : 459 - 475
  • [2] Electrophysiological responses of audiovisual integration from infancy to adulthood
    Vannasing, Phetsamone
    Dionne-Dostie, Emmanuelle
    Tremblay, Julie
    Paquette, Natacha
    Collignon, Olivier
    Gallagher, Anne
    [J]. BRAIN AND COGNITION, 2024, 178
  • [3] The effect of face orientation on audiovisual speech integration in infancy: An electrophysiological study
    Szmytke, Magdalena
    Ilyka, Dianna
    Duda-Golawska, Joanna
    Laudanska, Zuzanna
    Malinowska-Korczak, Anna
    Tomalski, Przemyslaw
    [J]. DEVELOPMENTAL PSYCHOBIOLOGY, 2023, 65 (07)
  • [4] Distinct cortical locations for integration of audiovisual speech and the McGurk effect
    Erickson, Laura C.
    Zielinski, Brandon A.
    Zielinski, Jennifer E. V.
    Liu, Guoying
    Turkeltaub, Peter E.
    Leaver, Amber M.
    Rauschecker, Josef P.
    [J]. FRONTIERS IN PSYCHOLOGY, 2014, 5
  • [5] Modeling the Development of Audiovisual Cue Integration in Speech Perception
    Getz, Laura M.
    Nordeen, Elke R.
    Vrabic, Sarah C.
    Toscano, Joseph C.
    [J]. BRAIN SCIENCES, 2017, 7 (03):
  • [6] THE COHERENCE OF SPEECH IN AUDIOVISUAL INTEGRATION
    ABRY, C
    CATHIARD, MA
    ROBERTRIBES, J
    SCHWARTZ, JL
    [J]. CAHIERS DE PSYCHOLOGIE COGNITIVE-CURRENT PSYCHOLOGY OF COGNITION, 1994, 13 (01): : 52 - 59
  • [7] DEVELOPMENT OF MOTION-SPECIFIC CORTICAL RESPONSES IN INFANCY
    WATTAMBELL, J
    [J]. VISION RESEARCH, 1991, 31 (02) : 287 - 297
  • [8] Object familiarity and semantic congruency modulate responses in cortical audiovisual integration areas
    Hein, Grit
    Doehrmann, Oliver
    Mueller, Notger G.
    Kaiser, Jochen
    Muckli, Lars
    Naumer, Marcus J.
    [J]. JOURNAL OF NEUROSCIENCE, 2007, 27 (30): : 7881 - 7887
  • [9] Integration of Audiovisual Speech and Priming Effects
    Ali, Azra N.
    [J]. INTERSPEECH 2008: 9TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2008, VOLS 1-5, 2008, : 2044 - 2047
  • [10] Audiovisual temporal integration of speech and gesture
    Margiotoudi, Konstantina
    Kelly, Spencer
    Vatakis, Argiro
    [J]. INTERNATIONAL CONFERENCE ON TIMING AND TIME PERCEPTION, 2014, 126 : 154 - +