Towards an automatic validation of answers in Question answering

被引:0
|
作者
Ligozat, Anne-Laure [1 ]
Grau, Brigitte [1 ]
Vilnat, Anne [1 ]
Robba, Isabelle [1 ]
Grappy, Arnaud [1 ]
机构
[1] LIMSI CNRS, F-91403 Orsay, France
关键词
D O I
10.1109/ICTAI.2007.156
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Question answering (QA) aims at retrieving precise information from a large collection of documents. Different techniques can be used to find relevant information, and to compare these techniques, it is important to evaluate QA systems. The objective of an Answer Validation task is thus to judge the correctness of an answer returned by a QA system for a question, according to the text snippet given to support it. We participated in such a task in 2006 In this article, we present our strategy for deciding if the snippets justify the answers: a strategy based on our own QA system, comparing the answers it returned with the answer to judge. We discuss our results, then we point out the difficulties of this task.
引用
收藏
页码:444 / 447
页数:4
相关论文
共 50 条
  • [1] Lexical validation of answers in question answering
    Ligozat, Anne-Laure
    Grau, Brigitte
    Vilnat, Anne
    Robba, Isabelle
    Grappy, Arnaud
    [J]. PROCEEDINGS OF THE IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE: WI 2007, 2007, : 330 - 333
  • [2] Question answering towards automatic augmentations of ontology instances
    Kim, S
    Lewis, P
    Martinez, K
    Goodall, S
    [J]. SEMANTIC WEB: RESEARCH AND APPLICATIONS, 2004, 3053 : 152 - 166
  • [3] Towards a Unified Model for Generating Answers and Explanations in Visual Question Answering
    Whitehouse, Chenxi
    Weyde, Tillman
    Madhyastha, Pranava
    [J]. 17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 1693 - 1705
  • [4] Multiple answers to a question: a new approach for visual question answering
    Hosseinabad, Sayedshayan Hashemi
    Safayani, Mehran
    Mirzaei, Abdolreza
    [J]. VISUAL COMPUTER, 2021, 37 (01): : 119 - 131
  • [5] Quality of Answers in Healthcare Social Question Answering
    John, Blooma
    Wickramasinghe, Nilmini
    [J]. CONNECTING THE SYSTEM TO ENHANCE THE PRACTITIONER AND CONSUMER EXPERIENCE IN HEALTHCARE, 2018, 252 : 69 - 72
  • [6] Multiple answers to a question: a new approach for visual question answering
    Sayedshayan Hashemi Hosseinabad
    Mehran Safayani
    Abdolreza Mirzaei
    [J]. The Visual Computer, 2021, 37 : 119 - 131
  • [7] Learning to Rank Answers for Definitional Question Answering
    Wu, Shiyu
    Qiu, Xipeng
    Huang, Xuanjing
    Cao, Junkuo
    [J]. CHINESE COMPUTATIONAL LINGUISTICS AND NATURAL LANGUAGE PROCESSING BASED ON NATURALLY ANNOTATED BIG DATA (CCL 2015), 2015, 9427 : 326 - 332
  • [8] Yahoo! Answers for Sentence Retrieval in Question Answering
    Momtazi, Saeedeh
    Klakow, Dietrich
    [J]. LREC 2010 - SEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2010, : D28 - D35
  • [9] Automatic question answering for multiple stakeholders, the epidemic question answering dataset
    Travis R. Goodwin
    Dina Demner-Fushman
    Kyle Lo
    Lucy Lu Wang
    Hoa T. Dang
    Ian M. Soboroff
    [J]. Scientific Data, 9
  • [10] Automatic question answering for multiple stakeholders, the epidemic question answering dataset
    Goodwin, Travis R.
    Demner-Fushman, Dina
    Lo, Kyle
    Wang, Lucy Lu
    Dang, Hoa T.
    Soboroff, Ian M.
    [J]. SCIENTIFIC DATA, 2022, 9 (01)