Evaluating Different Non-native Pronunciation Scoring Metrics with the Japanese Speakers of the SAMPLE Corpus

被引:0
|
作者
Alvarez, Vandria Alvarez [1 ]
Escudero Mancebo, David [1 ]
Gonzalez Ferreras, Cesar [1 ]
Cardenoso Payo, Valentin [1 ]
机构
[1] Univ Valladolid, Dept Comp Sci, Valladolid, Spain
关键词
Computer Assisted Pronunciation Training (CAPT); Goodness of Pronunciation (GOP); Hidden Markov Models (HMM); Automatic Speech Recognition (ASR); L2; pronunciation;
D O I
10.1007/978-3-319-49169-1_20
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work presents an analysis over the set of results derived from the goodness of pronunciation (GOP) algorithm for the evaluation of pronunciation at phoneme level over the SAMPLE corpus of non native speech. This corpus includes several recordings of uttered sentences by distinct speakers that have been rated in terms of quality by a group of linguists. The utterances have been automatically rated with the GOP algorithm. The phoneme dependence is discussed to suggest the normalization of intermediate results that could enhance the metrics performance. As result, new scoring proposals are presented which are based on computing the log-likelihood values obtained from the GOP algorithm and the application of a set of rules. These new scores show to correlate with the human rates better than the original GOP metric.
引用
收藏
页码:205 / 214
页数:10
相关论文
共 50 条
  • [1] Neural underpinning of Japanese particle processing in non-native speakers
    Kasai, Chise
    Sumiya, Motofumi
    Koike, Takahiko
    Yoshimoto, Takaaki
    Maki, Hideki
    Sadato, Norihiro
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)
  • [2] Comparative evaluation of automated scoring of syntactic competence of non-native speakers
    Zechner, Klaus
    Yoon, Su-Youn
    Bhat, Suma
    Leong, Chee Wee
    [J]. COMPUTERS IN HUMAN BEHAVIOR, 2017, 76 : 672 - 682
  • [3] Neural underpinning of Japanese particle processing in non-native speakers
    Chise Kasai
    Motofumi Sumiya
    Takahiko Koike
    Takaaki Yoshimoto
    Hideki Maki
    Norihiro Sadato
    [J]. Scientific Reports, 12
  • [4] Exploring effective methods for automated essay scoring of non-native speakers
    Poonpon, Kornwipa
    Manorom, Paiboon
    Chansanam, Wirapong
    [J]. CONTEMPORARY EDUCATIONAL TECHNOLOGY, 2023, 15 (04)
  • [5] Development of Japanese read-word database for non-native speakers of Japanese
    Yamakawa, Kimiko
    Amano, Shigeaki
    Kondo, Mariko
    [J]. Oriental COCOSDA 2014 - 17th Conference of the Oriental Chapter of the International Coordinating Committee on Speech Databases and Speech I/O Systems and Assessment / CASLRE (Conference on Asian Spoken Language Research and Evaluation), 2014,
  • [6] DEVELOPMENT OF JAPANESE READ-WORD DATABASE FOR NON-NATIVE SPEAKERS OF JAPANESE
    Yamakawa, Kimiko
    Amana, Shigeaki
    Kondo, Mariko
    [J]. 2014 17TH ORIENTAL CHAPTER OF THE INTERNATIONAL COMMITTEE FOR THE CO-ORDINATION AND STANDARDIZATION OF SPEECH DATABASES AND ASSESSMENT TECHNIQUES (COCOSDA), 2014,
  • [7] Do native and non-native speakers make different judicial decisions?
    Ruhle, Marie-Christine
    Lev-Ari, Shiri
    [J]. BILINGUALISM-LANGUAGE AND COGNITION, 2024,
  • [8] Design and Development of Multimedia Pronunciation Learning Management System for Non-Native English Speakers
    Por, Fei Ping
    Mustafa, Zarina
    Osman, Shuki
    Phoon, Hooi San
    Fong, Soon Fook
    [J]. 12TH INTERNATIONAL EDUCATIONAL TECHNOLOGY CONFERENCE - IETC 2012, 2012, 64 : 584 - 593
  • [9] Emotion Detection in Non-native English Speakers' Text-Only Messages by Native and Non-native Speakers
    Hautasaari, Ari
    Yamashita, Naomi
    [J]. HUMAN-COMPUTER INTERACTION, PT I, 2015, 9296 : 183 - 200
  • [10] iCALL Corpus: Mandarin Chinese Spoken by Non-Native Speakers of European Descent
    Chen, Nancy F.
    Tong, Rong
    Wee, Darren
    Lee, Peixuan
    Ma, Bin
    Li, Haizhou
    [J]. 16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5, 2015, : 324 - 328