Comparison of the ITU-T P.85 Standard to Other Methods for the Evaluation of Text-to-Speech Systems

被引:0
|
作者
Sityaev, Dmitry [1 ]
Knill, Katherine [1 ]
Burrows, Tina [1 ]
机构
[1] Toshiba Res Europe Ltd, Speech Technol Grp, Cambridge Res Lab, Cambridge CB2 3NH, England
关键词
speech synthesis; evaluation;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Evaluation of TTS systems is essential to assess performance. The ITU-T P.85 standard was introduced in 1994 to assess the overall quality of speech synthesis systems. However it has not been widely accepted or used. This paper compares the ITU test to more commonly used tests for intelligibility (semantically unpredictable sentences (SUS)) and naturalness (mean opinion score based). The aim of this research was to determine if the ITU test can provide a better performance measure and/or supplementary information to help evaluate TTS systems.
引用
收藏
页码:1077 / 1080
页数:4
相关论文
共 9 条
  • [1] Subjective evaluation of speech enhancement algorithms using ITU-T P.835 standard
    Gunawan, Teddy Surya
    Ambikairajah, Eliathamby
    2006 10TH IEEE SINGAPORE INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS, VOLS 1 AND 2, 2006, : 759 - +
  • [2] Objective evaluation methods for Chinese Text-To-Speech systems
    Zhang, Teng
    Chen, Zhipeng
    Wu, Ji
    Lail, Sam
    Lei, Wenhui
    Isert, Carsten
    17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES, 2016, : 332 - 336
  • [3] MOS and pair comparison combined methods for quality evaluation of text-to-speech systems
    Salza, PL
    Foti, E
    Nebbia, L
    Oreglia, M
    ACUSTICA, 1996, 82 (04): : 650 - 656
  • [4] P.563 - The ITU-T standard for single-ended speech quality assessment
    Malfait, Ludovic
    Berger, Jens
    Kastner, Martin
    IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2006, 14 (06): : 1924 - 1934
  • [5] Subjective evaluation and comparison of the speech quality of text-to-speech systems for the German language
    Klaus, H
    Fellbaum, K
    Sotscheck, J
    ACUSTICA, 1997, 83 (01): : 124 - 136
  • [6] Subjective evaluation and comparison of the speech quality of text-to-speech systems for the German language
    Klaus, H.
    Fellbaum, K.
    Sotscheck, J.
    Acta Acustica (Stuttgart), 1997, 83 (01): : 124 - 136
  • [7] Comparison of two objective speech quality measures: MBSD and ITU-T recommendation P.861
    Yang, WH
    Yantorno, R
    1998 IEEE SECOND WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, 1998, : 426 - 431
  • [8] Automatic QoE evaluation of DASH streaming using ITU-T Standard P.1203 and Google Puppeteer
    Guzman Castillo, Paola
    Arce Vila, Pau
    Guerri Cebollada, Juan Carlos
    PE-WASUN'19: PROCEEDINGS OF THE 16TH ACM INTERNATIONAL SYMPOSIUM ON PERFORMANCE EVALUATION OF WIRELESS AD HOC, SENSOR, & UBIQUITOUS NETWORKS, 2019, : 79 - 86
  • [9] Bitstream-based Model Standard for 4K/UHD: ITU-T P.1204.3-Model Details, Evaluation, Analysis and Open Source Implementation
    Rao, Rakesh Rao Ramachandra
    Goering, Steve
    List, Peter
    Robitza, Werner
    Feiten, Bernhard
    Wuestenhagen, Ulf
    Raake, Alexander
    2020 TWELFTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2020,