A novel pipelined end-to-end relation extraction framework with entity mentions and contextual semantic representation

被引:15
|
作者
Liu, Zhaoran [1 ]
Li, Haozhe [1 ]
Wang, Hao [1 ]
Liao, Yilin [1 ]
Liu, Xinggao [1 ]
Wu, Gaojie [2 ]
机构
[1] Zhejiang Univ, Coll Control Sci & Engn, State Key Lab Ind Control Technol, Hangzhou 310027, Peoples R China
[2] Natl Def Univ, Coll Joint Operat, Beijing 100091, Peoples R China
基金
中国国家自然科学基金;
关键词
Relation extraction; Natural language processing; Attention mechanism; Pre -trained model; Deep learning; NEURAL-NETWORK;
D O I
10.1016/j.eswa.2023.120435
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The mainstream method of end-to-end relation extraction is to jointly extract entities and relations by sharing span representation, which, however, may cause feature conflict. The advent of advanced pre-trained models enhances the ability to learn span semantic representation and allows the breaking of the dominance of joint models. We argue the benefits of using separate encoders for entity recognition and relation classification and propose a novel pipelined end-to-end relation extraction framework. By adopting attention mechanisms, the framework has the ability to fuse contextual semantic representation, which is missed in other pipelined models. By introducing explicit entity mentions, the framework is able to capture entities' location information and type information, which are difficult to utilize in joint models. Several elaborate tricks are integrated into the training process of the framework to further improve its performance. Our experiments show that our method increases the state-of-the-art relation F1-score on CoNLL04, ADE and SciERC datasets to 75.6% (+1.2%), 85.0% (+1.2%), 43.9% (+2.3%), respectively, indicating that our pipelined approach is promising in end-to-end relation extraction.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] A Novel End-to-End Framework to Image Cortical Networks from EEG
    Chen, Wanjun
    Wang, Junpu
    Yi, Chanlin
    Li, Fali
    Xu, Peng
    2024 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND VIRTUAL ENVIRONMENTS FOR MEASUREMENT SYSTEMS AND APPLICATIONS, CIVEMSA 2024, 2024,
  • [32] End-to-End Deep Framework for Disease Named Entity Recognition Using Social Media Data
    Miftahutdinov, Zulfat
    Tutubalina, Elena
    2017 IEEE 30TH NEUMANN COLLOQUIUM (NC), 2017, : 47 - 52
  • [33] Contextual Semantic-Guided Entity-Centric GCN for Relation Extraction
    Long, Jun
    Liu, Lei
    Fei, Hongxiao
    Xiang, Yiping
    Li, Haoran
    Huang, Wenti
    Yang, Liu
    MATHEMATICS, 2022, 10 (08)
  • [34] A neural network framework for relation extraction: Learning entity semantic and relation pattern
    Zheng, Suncong
    Xu, Jiaming
    Zhou, Peng
    Bao, Hongyun
    Qi, Zhenyu
    Xu, Bo
    KNOWLEDGE-BASED SYSTEMS, 2016, 114 : 12 - 23
  • [35] Improving Graph Convolutional Networks Based on Relation-Aware Attention for End-to-End Relation Extraction
    Hong, Yin
    Liu, Yanxia
    Yang, Suizhu
    Zhang, Kaiwen
    Wen, Aiqing
    Hu, Jianjun
    IEEE ACCESS, 2020, 8 : 51315 - 51323
  • [36] End-to-end Learning of Logical Rules for Enhancing Document-level Relation Extraction
    Qi, Kunxun
    Du, Jianfeng
    Wan, Hai
    PROCEEDINGS OF THE 62ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1: LONG PAPERS, 2024, : 7247 - 7263
  • [37] End-to-end relation extraction based on bootstrapped multi-level distant supervision
    Ying He
    Zhixu Li
    Qiang Yang
    Zhigang Chen
    An Liu
    Lei Zhao
    Xiaofang Zhou
    World Wide Web, 2020, 23 : 2933 - 2956
  • [38] End-to-end relation extraction based on bootstrapped multi-level distant supervision
    He, Ying
    Li, Zhixu
    Yang, Qiang
    Chen, Zhigang
    Liu, An
    Zhao, Lei
    Zhou, Xiaofang
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2020, 23 (05): : 2933 - 2956
  • [39] A semantic relation-aware deep neural network model for end-to-end conversational recommendation
    Wu, Jiajin
    Yang, Bo
    Li, Dongsheng
    Deng, Lihui
    APPLIED SOFT COMPUTING, 2023, 132
  • [40] Multi-task and multi-view training for end-to-end relation extraction
    Zhang, Junchi
    Zhang, Yue
    Ji, Donghong
    Liu, Mengchi
    NEUROCOMPUTING, 2019, 364 : 245 - 253