Mandarin Tone Identification by Tone-Naive Musicians and Non-musicians in Auditory-Visual and Auditory-Only Conditions

被引:7
|
作者
Han, Yueqiao [1 ]
Goudbeek, Martijn [1 ]
Mos, Maria [1 ]
Swerts, Marc [1 ]
机构
[1] Tilburg Univ, Tilburg Sch Humanities & Digital Sci, Dept Commun & Cognit, Tilburg, Netherlands
关键词
Mandarin tone identification; audiovisual modality; musicians and non-musicians; the Goldsmith Musicality Index; musicality; visual information; CONVERSATIONAL SPEECH; MUSICAL EXPERIENCE; TALKER DIFFERENCES; FOREIGN-LANGUAGE; LEXICAL TONES; PITCH; INTELLIGIBILITY; PERCEPTION; CLEAR; EXPERTISE;
D O I
10.3389/fcomm.2019.00070
中图分类号
G2 [信息与知识传播];
学科分类号
05 ; 0503 ;
摘要
A considerable number of studies have shown that musical ability has a positive effect on language processing. Extending this body of work, this study investigates the effects of musicality and modality on Mandarin tone identification in tone-naive participants. To examine the effects of visual information in speech, Mandarin tones were presented in auditory-only or auditory-visual modalities to participants with or without musical experience. The Goldsmith Musicality Index was used to assess the musical aptitude of the participants. Overall, musicians outperformed non-musicians in the tone identification task in both auditory-visual and auditory-only conditions. Both groups identified tones more accurately in the auditory-visual condition than in the auditory-only condition. In addition, performance differed by tone: musicality holds its main effect on each level of tone; while the influence of modality differs for individual tones; the identification of tone 3 (a low-falling-rising) proved to be the easiest, while tone 4 (a high-falling tone) was the most difficult to identify for all participants. Out of all the musical skills measured by the Goldsmith Musicality Index, the amount of musical training was the only predictor that had an impact on the accuracy of Mandarin tone perception. These findings suggest that learning to perceive Mandarin tones benefits from musical expertise, and visual information can facilitate Mandarin tone identification, but mainly for tone-naive non-musicians.
引用
收藏
页数:14
相关论文
共 38 条
  • [31] Music-space associations are grounded, embodied and situated: examination of cello experts and non-musicians in a standard tone discrimination task
    Martin Lachmair
    Ulrike Cress
    Tim Fissler
    Simone Kurek
    Jan Leininger
    Hans-Christoph Nuerk
    [J]. Psychological Research, 2019, 83 : 894 - 906
  • [32] Music-space associations are grounded, embodied and situated: examination of cello experts and non-musicians in a standard tone discrimination task
    Lachmair, Martin
    Cress, Ulrike
    Fissler, Tim
    Kurek, Simone
    Leininger, Jan
    Nuerk, Hans-Christoph
    [J]. PSYCHOLOGICAL RESEARCH-PSYCHOLOGISCHE FORSCHUNG, 2019, 83 (05): : 894 - 906
  • [33] Sentence Recognition Performance in Visual-Only and Auditory-Visual Conditions by Normal and Hearing Impaired Adults
    Kwak, Jonghyun
    Choi, Jaehee
    Jang, Hyunsook
    [J]. COMMUNICATION SCIENCES AND DISORDERS-CSD, 2019, 24 (04): : 1077 - 1086
  • [34] Distributed auditory cortical representations are modified when non-musicians are trained at pitch discrimination with 40 Hz amplitude modulated tones
    Bosnyak, DJ
    Eaton, RA
    Roberts, LE
    [J]. CEREBRAL CORTEX, 2004, 14 (10) : 1088 - 1099
  • [35] Characteristics of Effective Auditory Training: Implications From Two Training Programs That Successfully Trained Nonnative Cantonese Tone Identification in Monolingual Mandarin and Bilingual Mandarin-Taiwanese Tone Speakers
    Wong, Puisan
    Lam, Ka Yu
    [J]. JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2021, 64 (07): : 2490 - 2512
  • [36] Binaural interaction in human auditory brainstem response compared for tone-pips and rectangular clicks under conditions of auditory and visual attention
    Ikeda, Kazunari
    [J]. HEARING RESEARCH, 2015, 325 : 27 - 34
  • [37] The Effects of Auditory-Visual Vowel Identification Training on Speech Recognition Under Difficult Listening Conditions
    Richie, Carolyn
    Kewley-Port, Diane
    [J]. JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2008, 51 (06): : 1607 - 1619
  • [38] Cross-Modal Association between Auditory and Visuospatial Information in Mandarin Tone Perception in Noise by Native and Non-native Perceivers
    Hannah, Beverly
    Wang, Yue
    Jongman, Allard
    Sereno, Joan A.
    Cao, Jiguo
    Nie, Yunlong
    [J]. FRONTIERS IN PSYCHOLOGY, 2017, 8