Face masks and speaking style affect audio-visual word recognition and memory of native and non-native speecha)

被引:46
|
作者
Smiljanic, Rajka [1 ]
Keerstock, Sandie [2 ]
Meemann, Kirsten [1 ]
Ransom, Sarah M. [1 ]
机构
[1] Univ Texas Austin, Dept Linguist, 305 East 23rd St STOP B5100, Austin, TX 78712 USA
[2] Univ Missouri, Dept Psychol Sci, 124 Psychol Bldg, Columbia, MO 65211 USA
来源
关键词
CLEAR SPEECH; LISTENING EFFORT; INTELLIGIBILITY; PERCEPTION; BENEFIT;
D O I
10.1121/10.0005191
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Though necessary, protective mask wearing in response to the COVID-19 pandemic presents communication challenges. The present study examines how signal degradation and loss of visual information due to masks affects intelligibility and memory for native and non-native speech. We also test whether clear speech can alleviate perceptual difficulty for masked speech. One native and one non-native speaker of English recorded video clips in conversational speech without a mask and conversational and clear speech with a mask. Native English listeners watched video clips presented in quiet or mixed with competing speech. The results showed that word recognition and recall of speech produced with a mask can be as accurate as without a mask in optimal listening conditions. Masks affected non-native speech processing at easier noise levels than native speech. Clear speech with a mask significantly improved accuracy in all listening conditions. Speaking clearly, reducing noise, and using surgical masks as well as good signal amplification can help compensate for the loss of intelligibility due to background noise, lack of visual cues, physical distancing, or non-native speech. The findings have implications for communication in classrooms and hospitals where listeners interact with teachers and healthcare providers, oftentimes non-native speakers, through their protective barriers.
引用
收藏
页码:4013 / 4023
页数:11
相关论文
共 38 条
  • [1] Audio style transfer for non-native speech recognition
    Radzikowski, Kacper
    PHOTONICS APPLICATIONS IN ASTRONOMY, COMMUNICATIONS, INDUSTRY, AND HIGH-ENERGY PHYSICS EXPERIMENTS 2018, 2018, 10808
  • [2] Linguistic experience and audio-visual perception of non-native fricatives
    Department of Linguistics, Simon Fraser University, Burnaby, BC V5A 1S6, Canada
    不详
    Journal of the Acoustical Society of America, 2008, 124 (03): : 1716 - 1726
  • [3] Linguistic experience and audio-visual perception of non-native fricatives
    Wang, Yue
    Behne, Dawn M.
    Jiang, Haisheng
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2008, 124 (03): : 1716 - 1726
  • [4] Effects of Non-native Dialects on Spoken Word Recognition
    Le, Jennifer T.
    Best, Catherine T.
    Tyler, Michael D.
    Kroos, Christian
    INTERSPEECH 2007: 8TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION, VOLS 1-4, 2007, : 1417 - 1420
  • [5] Non native speech recognition using audio style transfer
    Radzikowski, Kacper
    Forc, Mateusz
    Wang, Le
    Yoshie, Osamu
    Nowak, Robert M.
    PHOTONICS APPLICATIONS IN ASTRONOMY, COMMUNICATIONS, INDUSTRY, AND HIGH-ENERGY PHYSICS EXPERIMENTS 2019, 2019, 11176
  • [6] Impact of talker variability on word recognition in non-native listeners
    van Dommelen, Wim A.
    Hazan, Valerie
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2012, 132 (03): : 1690 - 1699
  • [7] Lexical competition in non-native spoken-word recognition
    Weber, A
    Cutler, A
    JOURNAL OF MEMORY AND LANGUAGE, 2004, 50 (01) : 1 - 25
  • [8] Effects of Modality and Speaking Style on Mandarin Tone Identification by Non-Native Listeners
    Han, Yueqiao
    Goudbeek, Martijn
    Mos, Maria
    Swerts, Marc
    PHONETICA, 2019, 76 (04) : 263 - 286
  • [9] Quantification of context effects in phoneme and word recognition by non-native listeners
    Shi, Lu-Feng
    Koenig, Laura L.
    Proceedings of Meetings on Acoustics, 2011, 11
  • [10] Effects of non-native word shapes in the recognition and recall of medicine names
    Pires, Carla
    Correia, Susana
    Costa, Marcia
    Cavaco, Afonso
    Vigario, Marina
    WRITTEN LANGUAGE AND LITERACY, 2019, 22 (01): : 95 - 129