A grammar based method for systematic and generic spoken language understanding systems evaluation

被引：0
|
作者：
Kurdi, MZ [1 ]
Ahafhaf, M [1 ]
机构：
[1] Odense Univ, Univ So Denmark, Nat Interact Syst Lab, DK-5230 Odense M, Denmark
来源：
2003 INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING AND KNOWLEDGE ENGINEERING, PROCEEDINGS | 2003年
关键词：
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
In this paper we present a grammar based framework for deep evaluation of Spoken Language Understanding (SLU) Systems. The key point of our method is the use of a linguistic typology in order to generate an evaluation corpus that covers a significant number of the linguistic phenomena we want to evaluate our system on. This allows to have a more objective and deep evaluation of SLU systems.
引用
收藏
页码：498 / 505
页数：8
相关论文
共 50 条
  • [1] Grammar learning for spoken language understanding
    Wang, YY
    Acero, A
    [J]. ASRU 2001: IEEE WORKSHOP ON AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING, CONFERENCE PROCEEDINGS, 2001, : 292 - 295
  • [2] Evaluation of spoken language understanding and dialogue systems
    Hildebrandt, B
    Rautenstrauch, H
    Sagerer, G
    [J]. ICSLP 96 - FOURTH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, PROCEEDINGS, VOLS 1-4, 1996, : 685 - 688
  • [3] An Evaluation Framework for Natural Language Understanding in Spoken Dialogue Systems
    Gordon, Joshua B.
    Passonneau, Rebecca J.
    [J]. LREC 2010 - SEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2010, : 72 - 77
  • [4] Evaluation of spoken language grammar learning in the ATIS domain
    Wang, YY
    Acero, A
    [J]. 2002 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I-IV, PROCEEDINGS, 2002, : 41 - 44
  • [5] Evaluation of Spoken Language Understanding by Oxygenated Hemoglobin Concentration
    Nozawa, Akio
    Mizuno, Tota
    Asano, Hirotoshi
    Ide, Hideto
    [J]. JOURNAL OF ROBOTICS AND MECHATRONICS, 2010, 22 (01) : 3 - 9
  • [6] Deep Contextual Language Understanding in Spoken Dialogue Systems
    Liu, Chunxi
    Xu, Puyang
    Sarikaya, Ruhi
    [J]. 16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5, 2015, : 120 - 124
  • [7] Extracting clauses for spoken language understanding in conversational systems
    Gupta, NK
    Bangalore, S
    [J]. PROCEEDINGS OF THE 2002 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, 2002, : 273 - 280
  • [8] FAST INTENT CLASSIFICATION FOR SPOKEN LANGUAGE UNDERSTANDING SYSTEMS
    Tyagi, Akshit
    Sharma, Varun
    Gupta, Rahul
    Samson, Lynn
    Zhuang, Nan
    Wang, Zihang
    Campbell, Bill
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 8119 - 8123
  • [9] Role of evaluation in the development of spoken language systems
    Spoken Language Processing Group, LIMSI-CNRS, BP 133, 91403 Orsay Cedex, France
    [J]. Int J Speech Technol, 1 (5-14):
  • [10] Role of evaluation in the development of spoken language systems
    Minker W.
    [J]. International Journal of Speech Technology, 1999, 3 (1) : 5 - 14
12345