Performance Analysis in Web-based Question Answering Systems

被引：1

作者：

Olvera-Lobo, Maria-Dolores ^{[1
,2
]}

Gutierrez-Artacho, Juncal ^{[3
]}

机构：

[1] CSIC, Unidad Asociada Grp SCImago, Madrid, Spain

[2] Univ Granada, Dept Informac & Documentac, E-18071 Granada, Spain

[3] Univ Granada, Dept Traducc & Interpretac, E-18071 Granada, Spain

来源：

REVISTA ESPANOLA DE DOCUMENTACION CIENTIFICA | 2013年 / 36卷 / 02期

关键词：

Question-Answering Systems; performance analysis; definitional questions; factoid question; list questions; evaluation;

D O I：

10.3989/redc.2013.2.921

中图分类号：

G25 [图书馆学、图书馆事业]; G35 [情报学、情报工作];

学科分类号：

1205 ; 120501 ;

摘要：

Information overload is felt more strongly on the Web than elsewhere. Question-answering systems (QA systems) are considered as an alternative to traditional information retrieval systems, because they give correct and understandable answers rather than just offering a list of documents. Four answer search systems available online have been analyzed: START, QuALiM, SEMOTE, and TrueKnowledge. They were analyzed through a wide range of questions that prompted responses of definitions, facts, and closed lists pertaining to different thematic areas. The answers were analyzed using several specific measurements (MRR, TRR, FHS, MAP and precision). The results are encouraging and they show that these systems, although each one different, are potentially valid for precise information retrieval of diverse types and thematic areas.

引用

页数：10

共 50 条

[1] A Web-based Chinese question answering with answering validation
Cai, DF
Dong, YJ
Lv, DX
Zhang, GP
Miao, XL
[J]. Proceedings of the 2005 IEEE International Conference on Natural Language Processing and Knowledge Engineering (IEEE NLP-KE'05), 2005, : 499 - 502
[2] Rapid development of web-based monolingual question answering systems
Whittaker, Edward W. D.
Hamonic, Julien
Yang, Dong
Klingberg, Tor
Furui, Sadaoki
[J]. ADVANCES IN INFORMATION RETRIEVAL, 2006, 3936 : 501 - 504
[3] User Feedback for Improving Question Categorization in Web-Based Question Answering Systems
Song, Wanpeng
Liu Wenyin
Gu, Naijie
Quan, Xiaojun
[J]. ADVANCES IN WEB AND NETWORK TECHNOLOGIES, AND INFORMATION MANAGEMENT, 2009, 5731 : 148 - +
[4] Accuracy evaluation of methods and techniques in Web-based question answering systems: a survey
Asad Ali Shah
Sri Devi Ravana
Suraya Hamid
Maizatul Akmar Ismail
[J]. Knowledge and Information Systems, 2019, 58 : 611 - 650
[5] Accuracy evaluation of methods and techniques in Web-based question answering systems: a survey
Shah, Asad Ali
Ravana, Sri Devi
Hamid, Suraya
Ismail, Maizatul Akmar
[J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2019, 58 (03) : 611 - 650
[6] Exploring the learning mechanism of web-based question-answering systems and their design
Yin Zhang
[J]. BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY, 2010, 41 (04) : 624 - 631
[7] A web-based Chinese automatic question answering system
Cai, DF
Cui, H
Miao, XL
Zhao, CG
Ren, XS
[J]. FOURTH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY, PROCEEDINGS, 2004, : 1141 - 1146
[8] Measurement and modeling of a web-based question answering system
Peng, Chunyi
Gong, Zaoyang
Shen, Guobin
[J]. 2006 1ST IEEE WORKSHOP ON HOT TOPICS IN WEB SYSTEMS AND TECHNOLOGIES, 2006, : 82 - +
[9] Trustworthiness and Relevance in Web-based Clinical Question Answering
Cruchet, Sarah
Boyer, Celia
van der Plas, Lonneke
[J]. QUALITY OF LIFE THROUGH QUALITY OF INFORMATION, 2012, 180 : 863 - 867
[10] Web Pages Credibility Scores for Improving Accuracy of Answers in Web-Based Question Answering Systems
Shah, Asad Ali
Ravana, Sri Devi
Hamid, Suraya
Ismail, Maizatul Akmar
[J]. IEEE ACCESS, 2020, 8 : 141456 - 141471

← 1 2 3 4 5 →