Lipreading and Audiovisual Speech Recognition Across the Adult Lifespan: Implications for Audiovisual Integration

被引:59
|
作者
Tye-Murray, Nancy [1 ]
Spehar, Brent [1 ]
Myerson, Joel [2 ]
Hale, Sandra [2 ]
Sommers, Mitchell [2 ]
机构
[1] Washington Univ, Sch Med, Dept Otolaryngol, St Louis, MO 63110 USA
[2] Washington Univ, Dept Psychol, St Louis, MO 63130 USA
基金
美国国家卫生研究院;
关键词
audiovisual integration; lipreading; audiovisual speech advantage; auditory enhancement; visual enhancement; VISUAL SPEECH; OLDER-ADULTS; WORD-RECOGNITION; INDIVIDUAL-DIFFERENCES; AUDITORY-CORTEX; HEARING; PERCEPTION; PREVALENCE; ACTIVATION; VISION;
D O I
10.1037/pag0000094
中图分类号
R4 [临床医学]; R592 [老年病学];
学科分类号
1002 ; 100203 ; 100602 ;
摘要
In this study of visual (V-only) and audiovisual (AV) speech recognition in adults aged 22-92 years, the rate of age-related decrease in V-only performance was more than twice that in AV performance. Both auditory-only (A-only) and V-only performance were significant predictors of AV speech recognition, but age did not account for additional (unique) variance. Blurring the visual speech signal decreased speech recognition, and in AV conditions involving stimuli associated with equivalent unimodal performance for each participant, speech recognition remained constant from 22 to 92 years of age. Finally, principal components analysis revealed separate visual and auditory factors, but no evidence of an AV integration factor. Taken together, these results suggest that the benefit that comes from being able to see as well as hear a talker remains constant throughout adulthood and that changes in this AV advantage are entirely driven by age-related changes in unimodal visual and auditory speech recognition.
引用
收藏
页码:380 / 389
页数:10
相关论文
共 50 条
  • [31] Reduced efficiency of audiovisual integration for nonnative speech
    Yi, Han-Gyol
    Phelps, Jasmine E. B.
    Smiljanic, Rajka
    Chandrasekaran, Bharath
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2013, 134 (05): : EL387 - EL393
  • [32] Automatic Bimodal Audiovisual Speech Recognition: A Review
    Kandagal, Amaresh P.
    Udayashankara, V.
    2014 INTERNATIONAL CONFERENCE ON CONTEMPORARY COMPUTING AND INFORMATICS (IC3I), 2014, : 940 - 945
  • [33] Bimodal variational autoencoder for audiovisual speech recognition
    Hadeer M. Sayed
    Hesham E. ElDeeb
    Shereen A. Taie
    Machine Learning, 2023, 112 : 1201 - 1226
  • [34] Integration of faces and vocalizations in ventral prefrontal cortex: Implications for the evolution of audiovisual speech
    Romanski, Lizabeth M.
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2012, 109 : 10717 - 10724
  • [35] Bimodal variational autoencoder for audiovisual speech recognition
    Sayed, Hadeer M.
    ElDeeb, Hesham E.
    Taie, Shereen A.
    MACHINE LEARNING, 2023, 112 (04) : 1201 - 1226
  • [36] Recent advances in the automatic recognition of audiovisual speech
    Potamianos, G
    Neti, C
    Gravier, G
    Garg, A
    Senior, AW
    PROCEEDINGS OF THE IEEE, 2003, 91 (09) : 1306 - 1326
  • [37] Amazigh Audiovisual Speech Recognition System Design
    Addarrazi, Ilham
    Satori, Hassan
    Satori, Khalid
    2017 INTELLIGENT SYSTEMS AND COMPUTER VISION (ISCV), 2017,
  • [38] END-TO-END AUDIOVISUAL SPEECH RECOGNITION
    Petridis, Stavros
    Stafylakis, Themos
    Ma, Pingchuan
    Cai, Feipeng
    Tzimiropoulos, Georgios
    Pantic, Maja
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 6548 - 6552
  • [39] DETECTING ADVERSARIAL ATTACKS ON AUDIOVISUAL SPEECH RECOGNITION
    Ma, Pingchuan
    Petridis, Stavros
    Pantic, Maja
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6403 - 6407
  • [40] Temporal Multimodal Learning in Audiovisual Speech Recognition
    Hu, Di
    Li, Xuelong
    Lu, Xiaoqiang
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 3574 - 3582