A Framework of Evaluation for Question-Answering Systems

被引：0
|
作者：
El Ayari, Sarra [1 ]
Grau, Brigitte [1 ]
机构：
[1] CNRS, LIMSI, F-75700 Paris, France
来源：
ADVANCES IN INFORMATION RETRIEVAL, PROCEEDINGS | 2009年 / 5478卷
关键词：
Glass-box evaluation; question-answering system; relational database; framework; relevance of criteria;
D O I：
暂无
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Evaluating complex system is a complex task. Evaluation campaigns are organized each year to test different systems on global results, but they do not evaluate the relevance of the criteria used. Our purpose consist in modifying the intermediate results created by the components and inserting the new results into the process, without modifying the components. We will describe our framework of glass-box evaluation.
引用
收藏
页码：744 / 748
页数：5
相关论文
共 50 条
  • [1] A study about the future evaluation of Question-Answering systems
    Rodrigo, Alvaro
    Penas, Anselmo
    [J]. KNOWLEDGE-BASED SYSTEMS, 2017, 137 : 83 - 93
  • [2] Question-Answering Systems: Development and Prospects
    Lapshin, V. A.
    [J]. AUTOMATIC DOCUMENTATION AND MATHEMATICAL LINGUISTICS, 2012, 46 (03) : 138 - 145
  • [3] A survey on legal question-answering systems
    Martinez-Gil, Jorge
    [J]. COMPUTER SCIENCE REVIEW, 2023, 48
  • [4] Question-answering systems: Development and prospects
    V. A. Lapshin
    [J]. Automatic Documentation and Mathematical Linguistics, 2012, 46 (3) : 138 - 145
  • [5] Question-answering systems in knowledge management
    Moldovan, D
    [J]. IEEE INTELLIGENT SYSTEMS, 2001, 16 (06) : 90 - 92
  • [6] Evaluation of Google question-answering quality
    Zhao, Yiming
    Zhang, Jin
    Xia, Xue
    Le, Taowen
    [J]. LIBRARY HI TECH, 2019, 37 (02) : 312 - 328
  • [7] Question-answering systems as efficient sources of terminological information: an evaluation
    Olvera-Lobo, Maria-Dolores
    Gutierrez-Artacho, Juncal
    [J]. HEALTH INFORMATION AND LIBRARIES JOURNAL, 2010, 27 (04): : 268 - 276
  • [8] Empirical Studies in Question-Answering Systems: A Discussion
    Krueger, Jacob
    Schroeter, Ivonne
    Kenner, Andy
    Leich, Thomas
    [J]. 2017 IEEE/ACM 5TH INTERNATIONAL WORKSHOP ON CONDUCTING EMPIRICAL STUDIES IN INDUSTRY (CESI 2017), 2017, : 23 - 26
  • [9] Knowledge trees and protoforms in question-answering systems
    Yager, RR
    [J]. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2006, 57 (04): : 550 - 563
  • [10] STORAGE ECONOMY OF INFERENTIAL QUESTION-ANSWERING SYSTEMS
    PEARL, J
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1975, 5 (06): : 595 - 602
12345