Building a Question-Answering Corpus Using Social Media and News Articles

被引:5
|
作者
Cavalin, Paulo [1 ]
Figueiredo, Flavio [1 ]
de Bayser, Maira [1 ]
Moyano, Luis [1 ]
Candello, Heloisa [1 ]
Appel, Ana [1 ]
Souza, Renan [1 ]
机构
[1] IBM Res, Sao Paulo, Brazil
关键词
Question and Answer; Social media; Finance;
D O I
10.1007/978-3-319-41552-9_36
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Is it possible to develop a reliable QA-Corpus using social media data? What are the challenges faced when attempting such a task? In this paper, we discuss these questions and present our findings when developing a QA-Corpus on the topic of Brazilian finance. In order to populate our corpus, we relied on opinions from experts on Brazilian finance that are active on the Twitter application. From these experts, we extracted information from news websites that are used as answers in the corpus. Moreover, to effectively provide rankings of answers to questions, we employ novel word vector based similarity measures between short sentences (that accounts for both questions and Tweets). We validated our methods on a recently released dataset of similarity between short Portuguese sentences. Finally, we also discuss the effectiveness of our approach when used to rank answers to questions from real users.
引用
收藏
页码:353 / 358
页数:6
相关论文
共 50 条
  • [21] Query expansion using named entity disambiguation for a question-answering system
    Kandasamy, Saravanakumar
    Cherukuri, Aswani Kumar
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (04):
  • [22] A Question-Answering System for Applicant Support Using Modern Messaging Apps
    Filonov, D. R.
    Chalyy, D. Ju.
    Murin, D. M.
    Durnev, V. G.
    Sokolov, V. A.
    AUTOMATIC CONTROL AND COMPUTER SCIENCES, 2019, 53 (07) : 699 - 704
  • [23] Improving Question-Answering for Portuguese Using Triples Extracted from Corpora
    Rodrigues, Ricardo
    Gomes, Paulo
    COMPUTATIONAL PROCESSING OF THE PORTUGUESE LANGUAGE (PROPOR 2016), 2016, 9727 : 25 - 37
  • [24] A Question-Answering System for Applicant Support Using Modern Messaging Apps
    D. R. Filonov
    D. Ju. Chalyy
    D. M. Murin
    V. G. Durnev
    V. A. Sokolov
    Automatic Control and Computer Sciences, 2019, 53 : 699 - 704
  • [25] Using Semantic Text Similarity calculation for question matching in a rheumatoid arthritis question-answering system
    Li, Meiting
    Shen, Xifeng
    Sun, Yuanyuan
    Zhang, Weining
    Nan, Jiale
    Zhu, Jia'an
    Gao, Dongping
    QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2023, 13 (04) : 2183 - 2196
  • [26] Role play-based question-answering by real users for building chatbots with consistent personalities
    Higashinaka, Ryuichiro
    Mizukami, Masahiro
    Kawabata, Hidetoshi
    Yamaguchi, Emi
    Adachi, Noritake
    Tomita, Junji
    19TH ANNUAL MEETING OF THE SPECIAL INTEREST GROUP ON DISCOURSE AND DIALOGUE (SIGDIAL 2018), 2018, : 264 - 272
  • [27] GameQA: Gamified Mobile App Platform for Building Multiple-Domain Question-Answering Datasets
    Skarpheoinsson, Njall
    Guomundsson, Breki
    Smari, Steinar P.
    Larusdottir, Marta K.
    Einarsson, Hafsteinn
    Khan, Abuzar
    Nyberg, Eric
    Loftsson, Hrafn
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 152 - 160
  • [28] Educational Question Answering based on Social Media Content
    Gurevych, Iryna
    Bernhard, Delphine
    Ignatova, Kateryna
    Toprak, Cigdem
    ARTIFICIAL INTELLIGENCE IN EDUCATION: BUILDING LEARNING SYSTEMS THAT CARE: FROM KNOWLEDGE REPRESENTATION TO AFFECTIVE MODELLING, 2009, 200 : 133 - +
  • [29] TwEETQA: A Social Media Focused Question Answering Dataset
    Xiong, Wenhan
    Wu, Jiawei
    Wang, Hong
    Kulkarni, Vivek
    Yu, Mo
    Chang, Shiyu
    Guo, Xiaoxiao
    Wang, William Yang
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 5020 - 5031
  • [30] Question-answering framework for building codes using fine-tuned and distilled pre-trained transformer models
    Xue, Xiaorui
    Zhang, Jiansong
    Chen, Yunfeng
    AUTOMATION IN CONSTRUCTION, 2024, 168