Towards a percept ion-based evaluation model for spoken dialogue systems

被引:0
|
作者
Moeller, Sebastian [1 ]
Engelbrecht, Klaus-Peter [1 ]
机构
[1] TU Berlin, Deutsch Telekom Labs, D-10587 Berlin, Germany
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to facilitate the evaluation of advanced spoken dialogue systems (SDSs), we present the architecture for a new quality prediction model. The architecture follows the perception, judgment and action processes which are assumed to take place in a user interacting with a dialogue system. It is pointed out which components of the model are already available, and how they may be improved in the future.
引用
收藏
页码:306 / 309
页数:4
相关论文
共 50 条
  • [21] Issues in the evaluation of spoken dialogue systems using objective and subjective measures
    Larsen, LB
    ASRU'03: 2003 IEEE WORKSHOP ON AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING ASRU '03, 2003, : 209 - 214
  • [22] Can we talk? Methods for evaluation and training of spoken dialogue systems
    Walker, MA
    LANGUAGE RESOURCES AND EVALUATION, 2005, 39 (01) : 65 - 75
  • [23] Can We Talk? Methods for Evaluation and Training of Spoken Dialogue Systems
    Marilyn A. Walker
    Language Resources and Evaluation, 2005, 39 : 65 - 75
  • [24] Handbook of multimodal and spoken dialogue systems: Resources, terminology, and product evaluation
    van Deemter, K
    JOURNAL OF PRAGMATICS, 2003, 35 (08) : 1281 - 1285
  • [25] A syntactical model of prosody as an aid to spoken dialogue systems in Italian language
    Mumolo, E
    TEXT, SPEECH AND DIALOGUE, PROCEEDINGS, 2000, 1902 : 387 - 392
  • [26] A Sequence-to-Sequence Model for User Simulation in Spoken Dialogue Systems
    El Asri, Layla
    He, Jing
    Suleman, Kaheer
    17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES, 2016, : 1151 - 1155
  • [27] Flexible guidance generation using user model in spoken dialogue systems
    Komatani, K
    Ueno, S
    Kawahara, T
    Okuno, HG
    41ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE, 2003, : 256 - 263
  • [28] MeMo: Towards Automatic Usability Evaluation of Spoken Dialogue Services by User Error Simulations
    Moeller, Sebastian
    Englert, Roman
    Engelbrecht, Klaus
    Hafner, Verena
    Jameson, Anthony
    Oulasvirta, Antti
    Raake, Alexander
    Reithinger, Norbert
    INTERSPEECH 2006 AND 9TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, VOLS 1-5, 2006, : 1786 - +
  • [29] A Study Toward an Evaluation Method for Spoken Dialogue Systems Considering User Criteria
    Mizukami, Etsuo
    Kashioka, Hideki
    Kawai, Hisashi
    Nakamura, Satoshi
    SPOKEN DIALOGUE SYSTEMS FOR AMBIENT ENVIRONMENTS, 2010, 6392 : 176 - 181
  • [30] Real user evaluation of spoken dialogue systems using Amazon Mechanical Turk
    Jurcicek, F.
    Keizer, S.
    Gasic, M.
    Mairesse, F.
    Thomson, B.
    Yu, K.
    Young, S.
    12TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2011 (INTERSPEECH 2011), VOLS 1-5, 2011, : 3068 - 3071