A Framework of Evaluation for Question-Answering Systems

被引：0
|
作者：
El Ayari, Sarra [1 ]
Grau, Brigitte [1 ]
机构：
[1] CNRS, LIMSI, F-75700 Paris, France
来源：
ADVANCES IN INFORMATION RETRIEVAL, PROCEEDINGS | 2009年 / 5478卷
关键词：
Glass-box evaluation; question-answering system; relational database; framework; relevance of criteria;
D O I：
暂无
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Evaluating complex system is a complex task. Evaluation campaigns are organized each year to test different systems on global results, but they do not evaluate the relevance of the criteria used. Our purpose consist in modifying the intermediate results created by the components and inserting the new results into the process, without modifying the components. We will describe our framework of glass-box evaluation.
引用
收藏
页码：744 / 748
页数：5
相关论文
共 50 条
  • [21] The effect of answer validation on the performance of Question-Answering systems
    Rodrigo, Alvaro
    Herrera, Jesus
    Penas, Anselmo
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2019, 116 : 351 - 363
  • [22] Redundancy-Based Trust in Question-Answering Systems
    Atkinson, John
    Maurelia, Alvaro
    [J]. COMPUTER, 2017, 50 (01) : 58 - 65
  • [23] A SENTIMENT BASED NON-FACTOID QUESTION-ANSWERING FRAMEWORK
    Ye, Qiaofei
    Misra, Kanishka
    Devarapalli, Hemanth
    Rayz, Julia Taylor
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, : 372 - 377
  • [24] Chinese question-answering system
    Huang, GT
    Yao, HH
    [J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2004, 19 (04) : 479 - 488
  • [25] Chinese question-answering system
    Gai-Tai Huang
    Hsiu-Hsen Yao
    [J]. Journal of Computer Science and Technology, 2004, 19
  • [26] QUESTION-ANSWERING STRATEGIES FOR CHILDREN
    RAPHAEL, TE
    [J]. READING TEACHER, 1982, 36 (02): : 186 - 190
  • [27] Answer formulation for question-answering
    Kosseim, L
    Plamondon, L
    Guillemette, LJ
    [J]. ADVANCES IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2003, 2671 : 24 - 34
  • [28] Using interview data to identify evaluation criteria for interactive, analytical question-answering systems
    Kelly, Diane
    Wacholder, Nina
    Rittman, Robert
    Sun, Ying
    Kantor, Paul
    Small, Sharon
    Strzalkowski, Tomek
    [J]. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2007, 58 (07): : 1032 - 1043
  • [29] Overview of knowledge extraction techniques in five question-answering systems
    Jebbor, Fatine
    Benhlima, Laila
    [J]. 2014 9TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS: THEORIES AND APPLICATIONS (SITA'14), 2014,
  • [30] Information Theoretical Efficiency as a Criterion for Question-Answering Systems.
    Kleinhempel, Werner
    Baier, Paul Walter
    [J]. AEU. Archiv fur Elektronik und Ubertragungstechnik, 1987, 41 (06): : 337 - 340
12345