Multi-Hop Reasoning Question Generation and Its Application

被引:1
|
作者
Yu, Jianxing [1 ,2 ]
Su, Qinliang [1 ]
Quan, Xiaojun [1 ]
Yin, Jian [1 ]
机构
[1] Sun Yat Sen Univ, Guangdong Key Lab Big Data Anal & Proc, Guangzhou 510006, Peoples R China
[2] Pazhou Lab, Guangzhou 510330, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Multi-hop question; question generation (QG); reasoning chain; adaptive QG model; machine reading comprehension;
D O I
10.1109/TKDE.2021.3073227
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article focuses on the topic of multi-hop question generation (QG), which aims to generate the questions requiring multi-hop reasoning skills by understanding the semantics of the given text fully. These questions not only have valid syntax but also need to be logically correlated to the answers. Concretely, we first design a basic QG model based on the sequence-to-sequence framework. In order to improve the syntactic quality of the results, we customize several techniques to regularize the model's output. We then extract a reasoning chain heuristically from the given text and use the evidential relations to promote the logical correlations of the results. Considering that different samples have their own characteristics on the aspects of text contextual structure, the type of question, and logical correlation, it is difficult for such a one-size-fits-all model to generate the best results flexibly. Thus, we propose a new adaptive meta-learner to optimize the basic QG model according to the specific characteristic of the evaluated case. Each case and its similar samples are viewed as a pseudo-QG task. The similar structural contexts contained in the same task can be used as guidance to fine-tune the model robustly and produce the optimal results accordingly. Since each sample contains the text, question, and answer, with unknown semantic correlations among them, we propose a data-driven multi-level recognizer to measure the similarity of such structured inputs. The experimental results on two typical data sets in various domains show the effectiveness of the proposed approach. Moreover, we apply the generated results to the task of machine reading comprehension and achieve significant performance improvements. That demonstrates the capacity of multi-hop question generation in facilitating real-world applications.
引用
收藏
页码:725 / 740
页数:16
相关论文
共 50 条
  • [41] Dynamically Fused Graph Network for Multi-hop Reasoning
    Qiu, Lin
    Xiao, Yunxuan
    Qu, Yanru
    Zhou, Hao
    Li, Lei
    Zhang, Weinan
    Yu, Yong
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 6140 - 6150
  • [42] Understanding Dataset Design Choices for Multi-hop Reasoning
    Chen, Jifan
    Durrett, Greg
    2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 4026 - 4032
  • [43] Multi-Hop Knowledge Graph Reasoning with Reward Shaping
    Lin, Xi Victoria
    Socher, Richard
    Xiong, Caiming
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 3243 - 3253
  • [44] Compositional Questions Do Not Necessitate Multi-hop Reasoning
    Min, Sewon
    Wallace, Eric
    Singh, Sameer
    Gardner, Matt
    Hajishirzi, Hannaneh
    Zettlemoyer, Luke
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 4249 - 4257
  • [45] Interpretable multi-hop knowledge reasoning for gastrointestinal disease
    Wang, Dujuan
    Wang, Xinwei
    Abedin, Mohammad Zoynul
    Wang, Sutong
    Yin, Yunqiang
    ANNALS OF OPERATIONS RESEARCH, 2023,
  • [46] CogKR: Cognitive Graph for Multi-Hop Knowledge Reasoning
    Du, Zhengxiao
    Zhou, Chang
    Yao, Jiangchao
    Tu, Teng
    Cheng, Letian
    Yang, Hongxia
    Zhou, Jingren
    Tang, Jie
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (02) : 1283 - 1295
  • [47] Ruminating Reader: Reasoning with Gated Multi-Hop Attention
    Gong, Yichen
    Bowman, Samuel R.
    MACHINE READING FOR QUESTION ANSWERING, 2018, : 1 - 11
  • [48] Rethinking Label Smoothing on Multi-Hop Question Answering
    Yin, Zhangyue
    Wang, Yuxin
    Hu, Xiannian
    Wu, Yiguang
    Yan, Hang
    Zhang, Xinyu
    Cao, Zhao
    Huang, Xuanjing
    Qiu, Xipeng
    CHINESE COMPUTATIONAL LINGUISTICS, CCL 2023, 2023, 14232 : 72 - 87
  • [49] Hierarchical Graph Network for Multi-hop Question Answering
    Fang, Yuwei
    Sun, Siqi
    Gan, Zhe
    Pillai, Rohit
    Wang, Shuohang
    Liu, Jingjing
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 8823 - 8838
  • [50] Query and Neighbor-Aware Reasoning Based Multi-hop Question Answering over Knowledge Graph
    Ma, Biao
    Chen, Xiaoying
    Xiong, Shengwu
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I, 2022, 13368 : 133 - 145