Multi-view Semantic Reasoning Networks for Multi-hop Question Answering

被引:0
|
作者
Long X. [1 ]
Zhao R. [1 ]
Sun J. [1 ]
Ju S. [1 ]
机构
[1] College of Computer Sci., Sichuan Univ., Chengdu
关键词
graph neural networks; multi-hop knowledge base question answering; multi-view; semantic reasoning; weak supervision;
D O I
10.15961/j.jsuese.202200114
中图分类号
学科分类号
摘要
Due to the complexity of multi-hop KBQA, most existing works capture a wider range of higher-order neighbour information via multilayer GNNs. This approach combines multi-order information that sacrifices node discriminativeness to obtain more global information. Furthermore, it suffers from the over-smoothing problem, since fusing the multi-order information ignores the confidence of the neighbours, as neighbours closer to the node have the higher confidence. Another problem with multi-hop KBQA is that many datasets commonly do not provide the supervision information of intermediate paths. Thus, the weak-supervision problem usually makes the model lack effectual guidance information when conducting path reasonings, which results in reduced model reasoning ability. Aiming to solve the above problems, an approach of Multi-view Semantic Reasoning Networks (Multi-view SRNs) which utilizes information from both global and local views to jointly perform the reasoning was proposed in this paper. Namely, the global view information refers to the multi-order neighbour information of the node, which provides more numbers of crucial evidence for the reasoning, while the local view barely focuses on the first-order neighbour information of the node, which makes the node representation more discriminative, thereby alleviating the over-smoothing problem of the global information. Moreover, the original question was decomposed into multiple sub-questions as the guiding information for intermediate path reasoning. Then, an innovative loss function based on the uniformity and consistency of the semantic composition of the question was designed to improve the question decomposition quality, which promotes the ability of the model for intermediate path reasoning. The extensive experimental results on three benchmark datasets convincingly demonstrate that multi-view semantic information can provide a more comprehensive evidence for the reasoning, and the proposed method of decomposing the question into sub-questions is able to increase the intermediate path reasoning accuracy. © 2023 Editorial Department of Journal of Sichuan University. All rights reserved.
引用
收藏
页码:285 / 297
页数:12
相关论文
共 38 条
  • [1] Kun Xu, Reddy S, Feng Yansong, Et al., Question answering on freebase via relation extraction and textual evidence[C], Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, 1, pp. 2326-2336, (2016)
  • [2] Xiao Huang, Zhang Jingyuan, Li Dingcheng, Et al., Knowledge graph embedding based question answering[C], Proceedings of the Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp. 105-113, (2019)
  • [3] Lin B Y, Chen Xinyue, Chen J, Et al., KagNet:Knowledge–aware graph networks for commonsense reasoning[EB/OL]
  • [4] Sorokin D, Gurevych I., Modeling semantics with gated graph neural networks for knowledge base question answering[EB/OL]
  • [5] Qi Wang, Yongsheng Hao, Jie Cao, ADRL:An attention-based deep reinforcement learning framework for knowledge graph reasoning[J], Knowledge–Based Systems, 197, (2020)
  • [6] Yinquan Lu, Haonan Lu, Fu Guirong, Et al., KELM:knowledge enhanced pre-trained language representations with message passing on hierarchical relational graphs
  • [7] Qimai Li, Zhichao Han, Xiaoming Wu, Deeper insights into graph convolutional networks for semi-supervised learning[J], Proceedings of the AAAI Conference on Artificial Intelligence, 32, 1, pp. 3538-3545, (2018)
  • [8] He Gaole, Lan Yunshi, Jiang Jing, Et al., Improving multi-hop knowledge base question answering by learning intermediate supervision signals[C], Proceedings of the Proceedings of the 14th ACM International Conference on Web Search and Data Mining, pp. 553-561, (2021)
  • [9] Yuyu Zhang, Hanjun Dai, Kozareva Z, Et al., Variational reasoning for question answering with knowledge graph[J], Proceedings of the AAAI Conference on Artificial Intelligence, 32, 1, pp. 6069-6076, (2018)
  • [10] Yih W T, Richardson M, Meek C, Et al., The value of semantic parse labeling for knowledge base question answering[C], Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, 2, pp. 201-206, (2016)