Lipreading and Audiovisual Speech Recognition Across the Adult Lifespan: Implications for Audiovisual Integration

被引:54
|
作者
Tye-Murray, Nancy [1 ]
Spehar, Brent [1 ]
Myerson, Joel [2 ]
Hale, Sandra [2 ]
Sommers, Mitchell [2 ]
机构
[1] Washington Univ, Sch Med, Dept Otolaryngol, St Louis, MO 63110 USA
[2] Washington Univ, Dept Psychol, St Louis, MO 63130 USA
基金
美国国家卫生研究院;
关键词
audiovisual integration; lipreading; audiovisual speech advantage; auditory enhancement; visual enhancement; VISUAL SPEECH; OLDER-ADULTS; WORD-RECOGNITION; INDIVIDUAL-DIFFERENCES; AUDITORY-CORTEX; HEARING; PERCEPTION; PREVALENCE; ACTIVATION; VISION;
D O I
10.1037/pag0000094
中图分类号
R4 [临床医学]; R592 [老年病学];
学科分类号
1002 ; 100203 ; 100602 ;
摘要
In this study of visual (V-only) and audiovisual (AV) speech recognition in adults aged 22-92 years, the rate of age-related decrease in V-only performance was more than twice that in AV performance. Both auditory-only (A-only) and V-only performance were significant predictors of AV speech recognition, but age did not account for additional (unique) variance. Blurring the visual speech signal decreased speech recognition, and in AV conditions involving stimuli associated with equivalent unimodal performance for each participant, speech recognition remained constant from 22 to 92 years of age. Finally, principal components analysis revealed separate visual and auditory factors, but no evidence of an AV integration factor. Taken together, these results suggest that the benefit that comes from being able to see as well as hear a talker remains constant throughout adulthood and that changes in this AV advantage are entirely driven by age-related changes in unimodal visual and auditory speech recognition.
引用
收藏
页码:380 / 389
页数:10
相关论文
共 50 条
  • [21] A neuromagnetic study of the integration of audiovisual speech in the brain
    Sams, M
    Levanen, S
    [J]. BRAIN TOPOGRAPHY TODAY, 1997, 1147 : 47 - 53
  • [22] Attention to touch weakens audiovisual speech integration
    Alsius, Agnes
    Navarra, Jordi
    Soto-Faraco, Salvador
    [J]. EXPERIMENTAL BRAIN RESEARCH, 2007, 183 (03) : 399 - 404
  • [23] Speech Cues Contribute to Audiovisual Spatial Integration
    Bishop, Christopher W.
    Miller, Lee M.
    [J]. PLOS ONE, 2011, 6 (08):
  • [24] A measure for assessing the effects of audiovisual speech integration
    Nicholas Altieri
    James T. Townsend
    Michael J. Wenger
    [J]. Behavior Research Methods, 2014, 46 : 406 - 415
  • [25] Attention to touch weakens audiovisual speech integration
    Agnès Alsius
    Jordi Navarra
    Salvador Soto-Faraco
    [J]. Experimental Brain Research, 2007, 183 : 399 - 404
  • [26] Normative data on audiovisual speech integration using sentence recognition and capacity measures
    Altieri, Nicholas
    Hudock, Daniel
    [J]. INTERNATIONAL JOURNAL OF AUDIOLOGY, 2016, 55 (04) : 206 - 214
  • [27] Assessing the role of attention in the audiovisual integration of speech
    Navarra, Jordi
    Alsius, Agnes
    Soto-Faraco, Salvador
    Spence, Charles
    [J]. INFORMATION FUSION, 2010, 11 (01) : 4 - 11
  • [28] A measure for assessing the effects of audiovisual speech integration
    Altieri, Nicholas
    Townsend, James T.
    Wenger, Michael J.
    [J]. BEHAVIOR RESEARCH METHODS, 2014, 46 (02) : 406 - 415
  • [29] Reduced efficiency of audiovisual integration for nonnative speech
    Yi, Han-Gyol
    Phelps, Jasmine E. B.
    Smiljanic, Rajka
    Chandrasekaran, Bharath
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2013, 134 (05): : EL387 - EL393
  • [30] Bimodal variational autoencoder for audiovisual speech recognition
    Hadeer M. Sayed
    Hesham E. ElDeeb
    Shereen A. Taie
    [J]. Machine Learning, 2023, 112 : 1201 - 1226