Audio-visual speech perception in adult readers with dyslexia: an fMRI study

被引:24
|
作者
Ruesseler, Jascha [1 ]
Ye, Zheng [2 ]
Gerth, Ivonne [3 ]
Szycik, Gregor R. [4 ]
Muente, Thomas F. [5 ,6 ]
机构
[1] Otto Friedrich Univ Bamberg, Dept Psychol, Bamberg, Germany
[2] Chinese Acad Sci, Inst Psychol, Beijing, Peoples R China
[3] Klinikum Magdeburg, Neurol, Magdeburg, Germany
[4] Hannover Med Sch, Dept Psychiat, Hannover, Germany
[5] Univ Lubeck, Dept Neurol, Ratzeburger Allee 160, D-23562 Lubeck, Germany
[6] Univ Lubeck, Inst Psychol 2, Lubeck, Germany
关键词
Developmental dyslexia; Audio-visual processing; Event-related fMRI; Independent component analysis; INDEPENDENT COMPONENT ANALYSIS; AUDITORY-VISUAL SPEECH; MULTISENSORY INTEGRATION; DEVELOPMENTAL DYSLEXIA; READING-DISABILITY; HEARING LIPS; NEURAL BASIS; SCHIZOPHRENIA; BRAIN; NETWORKS;
D O I
10.1007/s11682-017-9694-y
中图分类号
R445 [影像诊断学];
学科分类号
100207 ;
摘要
Developmental dyslexia is a specific deficit in reading and spelling that often persists into adulthood. In the present study, we used slow event-related fMRI and independent component analysis to identify brain networks involved in perception of audio-visual speech in a group of adult readers with dyslexia (RD) and a group of fluent readers (FR). Participants saw a video of a female speaker saying a disyllabic word. In the congruent condition, audio and video input were identical whereas in the incongruent condition, the two inputs differed. Participants had to respond to occasionally occurring animal names. The independent components analysis (ICA) identified several components that were differently modulated in FR and RD. Two of these components including fusiform gyrus and occipital gyrus showed less activation in RD compared to FR possibly indicating a deficit to extract face information that is needed to integrate auditory and visual information in natural speech perception. A further component centered on the superior temporal sulcus (STS) also exhibited less activation in RD compared to FR. This finding is corroborated in the univariate analysis that shows less activation in STS for RD compared to FR. These findings suggest a general impairment in recruitment of audiovisual processing areas in dyslexia during the perception of natural speech.
引用
收藏
页码:357 / 368
页数:12
相关论文
共 50 条
  • [21] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
    Choi, Jeongsoo
    Park, Se Jin
    Kim, Minsu
    Ro, Yong Man
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 27315 - 27327
  • [22] An audio-visual distance for audio-visual speech vector quantization
    Girin, L
    Foucher, E
    Feng, G
    1998 IEEE SECOND WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, 1998, : 523 - 528
  • [24] Preschoolers' perception of audio-visual speech influenced by articulatory ability
    Rogers, J
    Desjardins, RN
    Werker, JF
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 1996, 31 (3-4) : 4249 - 4249
  • [25] Experience-driven audio-visual integration in speech perception
    Stephens, J
    Holt, L
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2005, : 82 - 82
  • [26] Audio-visual speech experience with age influences perceived audio-visual asynchrony in speech
    Alm, M. (magnus.alm@svt.ntnu.no), 1600, Acoustical Society of America (134):
  • [27] Audio-visual speech experience with age influences perceived audio-visual asynchrony in speech
    Alm, Magnus
    Behne, Dawn
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2013, 134 (04): : 3001 - 3010
  • [28] Neural correlates of audio-visual integration: an fMRI study
    Handley, R.
    Reinders, S.
    Marques, T.
    Pariante, C.
    McGuire, P.
    Dazzan, P.
    EARLY INTERVENTION IN PSYCHIATRY, 2008, 2 : A97 - A97
  • [29] Contributions of local speech encoding and functional connectivity to audio-visual speech perception
    Giordano, Bruno L.
    Ince, Robin A. A.
    Gross, Joachim
    Schyns, Philippe G.
    Panzeri, Stefano
    Kayser, Christoph
    ELIFE, 2017, 6
  • [30] Infant perception of audio-visual speech synchrony in familiar and unfamiliar fluent speech
    Pons, Ferran
    Lewkowicz, David J.
    ACTA PSYCHOLOGICA, 2014, 149 : 142 - 147