Auditory and auditory-visual perception of clear and conversational speech

被引:105
|
作者
Helfer, KS
机构
[1] Dept. of Communication Disorders, University of Massachusetts, Amherst, MA
[2] Dept. of Communication Disorders, Sch. of Pub. Hlth. and Hlth. Sci., Arnold House, Amherst
来源
关键词
speech perception; speechreading; noise;
D O I
10.1044/jslhr.4002.432
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
Research has shown that speaking in a deliberately clear manner con improve the accuracy of auditory speech recognition. Allowing listeners access to visual speech cues also enhances speech understanding. Whether the nature of information provided by speaking clearly and by using visual speech cues is redundant has not been determined. This study examined how speaking mode (clear vs. conversational) and presentation mode (auditory vs. auditory-visual) influenced the perception of words within nonsense sentences. In Experiment 1, 30 young listeners with normal hearing responded to videotaped stimuli presented audiovisually in the presence of background noise at one of three signal-to-noise ratios. In Experiment 2, 9 participants returned for an additional assessment using auditory-only presentation. Results of these experiments showed significant effects of speaking mode (clear speech was easier to understand than was conversational speech) and presentation mode (auditory-visual presentation led to better performance than did auditory-only presentation). The benefit of clear speech was greater For words occurring in the middle of sentences than for words at either the beginning or end of sentences for both auditory-only and auditory-visual presentation, whereas the greatest benefit from supplying visual cues was for words at the end of sentences spoken both clearly and conversationally. The total benefit from speaking clearly and supplying visual cues was equal to the sum of each of these effects. Overall, the results suggest that speaking clearly and providing visual speech information provide complementary (rather than redundant) information.
引用
收藏
页码:432 / 443
页数:12
相关论文
共 50 条
  • [31] Auditory-Visual Integration During Nonconscious Perception
    Ching, April
    Kim, Jeesun
    Davis, Chris
    [J]. PERCEPTION, 2019, 48 : 68 - 68
  • [32] Auditory, visual and audiovisual clear speech
    Gagné, JP
    Rochette, AJ
    Charest, M
    [J]. SPEECH COMMUNICATION, 2002, 37 (3-4) : 213 - 230
  • [33] LEARNING OF EQUALITY BETWEEN AN AUDITORY AND A VISUAL STIMULUS ALTERS THE PERCEPTION OF AUDITORY-VISUAL SIMULTANEITY
    Hasegawa, Hiroshi
    Saito, Wataru
    [J]. PROCEEDINGS OF THE 22ND INTERNATIONAL CONGRESS ON SOUND AND VIBRATION: MAJOR CHALLENGES IN ACOUSTICS, NOISE AND VIBRATION RESEARCH, 2015, 2015,
  • [34] Auditory-visual speech recognition by hearing-impaired subjects: Consonant recognition, sentence recognition, and auditory-visual integration
    Grant, KW
    Walden, BE
    Seitz, PF
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1998, 103 (05): : 2677 - 2690
  • [35] Auditory-visual speech to infants and adults: signals and correlations
    Kim, Jeesun
    Davis, Chris
    Kitamura, Christine
    [J]. 13TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2012 (INTERSPEECH 2012), VOLS 1-3, 2012, : 1118 - 1121
  • [36] Auditory-visual speech integration by prelinguistic infants: Perception of an emergent consonant in the McGurk effect
    Burnham, D
    Dodd, B
    [J]. DEVELOPMENTAL PSYCHOBIOLOGY, 2004, 45 (04) : 204 - 220
  • [37] Informational masking of speech in children: Auditory-visual integration
    Wightman, F
    Kistler, D
    Brungart, D
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2006, 119 (06): : 3940 - 3949
  • [38] Perception of auditory-visual temporal synchrony in human infants
    Lewkowicz, DJ
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 1996, 22 (05) : 1094 - 1106
  • [39] PERCEPTION OF AUDITORY-VISUAL SIMULTANEITY CHANGES BY ILLUMINANCE AT THE EYES
    Hasegawa, Hiroshi
    Hatakeyama, Shu
    [J]. PROCEEDINGS OF THE 23RD INTERNATIONAL CONGRESS ON SOUND AND VIBRATION: FROM ANCIENT TO MODERN ACOUSTICS, 2016,
  • [40] PROCESSING AUDITORY-VISUAL SPEECH IN INFANCY AND ACROSS PHONOLOGIES
    BURNHAM, D
    [J]. INTERNATIONAL JOURNAL OF PSYCHOLOGY, 1992, 27 (3-4) : 59 - 59