Graph Convolution-Enhanced Multi-Channel Decoding Joint Entity and Relation Extraction Model

被引:0
|
作者
Qiao Y. [1 ,2 ]
Yu Y. [1 ,2 ]
Liu S. [1 ,2 ]
Wang Z. [1 ,2 ]
Xia Z. [1 ,2 ]
Qiao J. [1 ,2 ]
机构
[1] School of Computer Science and Engineering, Northeastern University, Shenyang
[2] Key Laboratory of Intelligent Computing in Medical Image (Northeastern University), Ministry of Education, Shenyang
基金
中国国家自然科学基金;
关键词
Encoder-decoder; Graph convolution neural network; Multi-channel decoding; Relation extraction; Relation overlapping;
D O I
10.7544/issn1000-1239.202110767
中图分类号
学科分类号
摘要
Extracting relational triplets from unstructured natural language texts are the most critical step in building a large-scale knowledge graph, but existing researches still have the following problems: 1) Existing models ignore the problem of relation overlapping caused by multiple triplets sharing the same entity in text; 2) The current joint extraction model based on encoder-decoder does not fully consider the dependency relationship among words in the text; 3) The excessively long sequence of triplets leads to the accumulation and propagation of errors, which affects the precision and efficiency of relation extraction in entity. Based on this, a graph convolution-enhanced multi-channel decoding joint entity and relation extraction model (GMCD-JERE) is proposed. First, the BiLSTM is introduced as a model encoder to strengthen the two-way feature fusion of words in the text; second, the dependency relationship between the words in the sentence is merged through the graph convolution multi-hop mechanism to improve the accuracy of relation classification; third, through multi-channel decoding mechanism, the model solves the problem of relation overlapping, and alleviates the effect of error accumulation and propagation at the same time; fourth, the experiment selects the current three mainstream models for performance verification, and the results on the NYT (New York times) dataset show that the accuracy rate, recall rate, and F1 are increased by 4.3%, 5.1% and 4.8%. Also, the extraction order starting with the relation is verified in the WebNLG (Web natural language generation) dataset. © 2023, Science Press. All right reserved.
引用
收藏
页码:153 / 166
页数:13
相关论文
共 43 条
  • [1] Li Dongmei, Zhang Yang, Li Dongyuan, Et al., Review of entity relation extraction methods, Journal of Computer Research and Development, 57, 7, pp. 1424-1448, (2020)
  • [2] Zeng Daojian, Liu Kang, Lai Siwei, Et al., Relation classification via convolutional deep neural network[C], Proc of the 25th Int Conf on Computational Linguistics, pp. 2335-2344, (2014)
  • [3] Xu Kun, Feng Yansong, Huang Songfang, Et al., Semantic relation classification via convolutional neural networks with simple negative sampling[C], Proc of the 2015 Conf on Empirical Methods in Natural Language Processing, pp. 536-540, (2015)
  • [4] Chan S Y, Roth D., Exploiting syntactico-semantic structures for relation extraction[C], Proc of the 49th Annual Meeting of the ACL, pp. 551-560, (2011)
  • [5] Li Qi, Ji Heng, Incremental joint extraction of entity mentions and relations[C], Proc of the 52nd Annual Meeting of the ACL, pp. 402-412, (2014)
  • [6] Miwa M, Bansal M., End-to-end relation extraction using LSTMs on sequences and tree structures[C], Proc of the 54th Annual Meeting of the ACL, pp. 1105-1116, (2016)
  • [7] Cao Mingyu, Yang Zhihao, Luo Ling, Et al., Joint drug entities and relations extraction based on neural networks, Journal of Computer Research and Development, 56, 7, pp. 1432-1440, (2019)
  • [8] Zhang Meishan, Zhang Yue, Fu Guohong, End-to-end neural relation extraction with global optimization[C], Proc of the 2017 Conf on Empirical Methods in Natural Language Processing, pp. 1730-1740, (2017)
  • [9] Gupta P, Schtze H, Andrassy B., Table filling multi-task recurrent neural network for joint entity and relation extraction[C], Proc of the 26th Int Conf on Computational Linguistics, pp. 2537-2547, (2016)
  • [10] Zheng Suncong, Wang Feng, Bao Hongyun, Et al., Joint extraction of entities and relations based on a novel tagging scheme[C], Proc of the 55th Annual Meeting of the ACL, pp. 1227-1236, (2017)