Non-native Listeners Benefit Less from Gestures and Visible Speech than Native Listeners During Degraded Speech Comprehension

被引:23
|
作者
Drijvers, Linda [1 ,2 ,3 ]
Ozyurek, Asli [1 ,2 ,3 ]
机构
[1] Radboud Univ Nijmegen, Ctr Language Studies, Nijmegen, Netherlands
[2] Radboud Univ Nijmegen, Donders Inst Brain Cognit & Behav, Nijmegen, Netherlands
[3] Max Planck Inst Psycholinguist, Nijmegen, Netherlands
关键词
non-native language processing; degraded speech; gesture; visible speech; integration; semantic integration; HAND GESTURES; IN-NOISE; PERCEPTION; INFORMATION; CUES;
D O I
10.1177/0023830919831311
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
Native listeners benefit from both visible speech and iconic gestures to enhance degraded speech comprehension (Drijvers & Ozyurek, 2017). We tested how highly proficient non-native listeners benefit from these visual articulators compared to native listeners. We presented videos of an actress uttering a verb in clear, moderately, or severely degraded speech, while her lips were blurred, visible, or visible and accompanied by a gesture. Our results revealed that unlike native listeners, non-native listeners were less likely to benefit from the combined enhancement of visible speech and gestures, especially since the benefit from visible speech was minimal when the signal quality was not sufficient.
引用
收藏
页码:209 / 220
页数:12
相关论文
共 50 条
  • [1] The Lombard intelligibility benefit of native and non-native speech for native and non-native listeners
    Marcoux, Katherine
    Cooke, Martin
    Tucker, Benjamin, V
    Ernestus, Mirjam
    [J]. SPEECH COMMUNICATION, 2022, 136 : 53 - 62
  • [2] The intelligibility of Lombard speech for non-native listeners
    Cooke, Martin
    Garcia Lecumberri, Maria Luisa
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2012, 132 (02): : 1120 - 1129
  • [3] The clear speech effect for non-native listeners
    Bradlow, AR
    Bent, T
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2002, 112 (01): : 272 - 284
  • [4] The effect of native/non-native information on non-native listeners' comprehension
    Hu, Guiling
    Su, Jing
    [J]. LANGUAGE AWARENESS, 2015, 24 (03) : 273 - 281
  • [5] Error patterns of native and non-native listeners' perception of speech in noise
    Zinszer, Benjamin D.
    Riggs, Meredith
    Reetzke, Rachel
    Chandrasekaran, Bharath
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2019, 145 (02): : EL129 - EL135
  • [6] Quantifying the intelligibility of speech in noise for non-native listeners
    van Wijngaarden, SJ
    Steeneken, HJM
    Houtgast, T
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2002, 111 (04): : 1906 - 1916
  • [7] Synthesized speech intelligibility and persuasion: Speech rate and non-native listeners
    Jones, Caroline
    Berry, Lynn
    Stevens, Catherine
    [J]. COMPUTER SPEECH AND LANGUAGE, 2007, 21 (04): : 641 - 651
  • [8] Effects of noise, reverberation and foreign accent on native and non-native listeners' performance of English speech comprehension
    Peng, Z. Ellen
    Wang, Lily M.
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2016, 139 (05): : 2772 - 2783
  • [9] Research Article Prosodic Focus Interpretation in Spectrotemporally Degraded Speech by Non-Native Listeners
    Everhardt, Marita K.
    Sarampalis, Anastasios
    Coler, Matt
    Baskent, Deniz
    Lowie, Wander
    [J]. JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2023, 66 (09): : 3649 - 3664
  • [10] The impact of speech type on listening effort and intelligibility for native and non-native listeners
    Simantiraki, Olympia
    Wagner, Anita E.
    Cooke, Martin
    [J]. FRONTIERS IN NEUROSCIENCE, 2023, 17