A novel pipelined end-to-end relation extraction framework with entity mentions and contextual semantic representation

被引:15
|
作者
Liu, Zhaoran [1 ]
Li, Haozhe [1 ]
Wang, Hao [1 ]
Liao, Yilin [1 ]
Liu, Xinggao [1 ]
Wu, Gaojie [2 ]
机构
[1] Zhejiang Univ, Coll Control Sci & Engn, State Key Lab Ind Control Technol, Hangzhou 310027, Peoples R China
[2] Natl Def Univ, Coll Joint Operat, Beijing 100091, Peoples R China
基金
中国国家自然科学基金;
关键词
Relation extraction; Natural language processing; Attention mechanism; Pre -trained model; Deep learning; NEURAL-NETWORK;
D O I
10.1016/j.eswa.2023.120435
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The mainstream method of end-to-end relation extraction is to jointly extract entities and relations by sharing span representation, which, however, may cause feature conflict. The advent of advanced pre-trained models enhances the ability to learn span semantic representation and allows the breaking of the dominance of joint models. We argue the benefits of using separate encoders for entity recognition and relation classification and propose a novel pipelined end-to-end relation extraction framework. By adopting attention mechanisms, the framework has the ability to fuse contextual semantic representation, which is missed in other pipelined models. By introducing explicit entity mentions, the framework is able to capture entities' location information and type information, which are difficult to utilize in joint models. Several elaborate tricks are integrated into the training process of the framework to further improve its performance. Our experiments show that our method increases the state-of-the-art relation F1-score on CoNLL04, ADE and SciERC datasets to 75.6% (+1.2%), 85.0% (+1.2%), 43.9% (+2.3%), respectively, indicating that our pipelined approach is promising in end-to-end relation extraction.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] END-TO-END NAMED ENTITY AND SEMANTIC CONCEPT EXTRACTION FROM SPEECH
    Ghannay, S.
    Caubriere, A.
    Esteve, Y.
    Camelin, N.
    Simonnet, E.
    Laurent, A.
    Morin, E.
    2018 IEEE WORKSHOP ON SPOKEN LANGUAGE TECHNOLOGY (SLT 2018), 2018, : 692 - 699
  • [2] End-to-end framework for agricultural entity extraction - A hybrid model with transformer
    Mol, E. A. Nismi
    Kumar, M. B. Santosh
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2024, 225
  • [3] Boundaries and edges rethinking: An end-to-end neural model for overlapping entity relation extraction
    Fei, Hao
    Ren, Yafeng
    Ji, Donghong
    INFORMATION PROCESSING & MANAGEMENT, 2020, 57 (06)
  • [4] Injecting Knowledge Base Information into End-to-End Joint Entity and Relation Extraction and Coreference Resolution
    Verlinden, Severine
    Zaporojets, Klim
    Deleu, Johannes
    Demeester, Thomas
    Develder, Chris
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 1952 - 1957
  • [5] A Semantic End-to-end Process Constraint Modeling Framework
    Liu, Shasha
    Kochut, Krys J.
    2014 IEEE INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC), 2014, : 203 - 210
  • [6] Make It Easy: An Effective End-to-End Entity Alignment Framework
    Ge, Congcong
    Liu, Xiaoze
    Chen, Lu
    Zheng, Baihua
    Gao, Yunjun
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 777 - 786
  • [7] An End-to-end Model for Entity-level Relation Extraction using Multi-instance Learning
    Eberts, Markus
    Ulges, Adrian
    16TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2021), 2021, : 3650 - 3660
  • [8] REBEL: Relation Extraction By End-to-end Language generation
    Cabot, Pere-Lluis Huguet
    Navigli, Roberto
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2021, 2021, : 2370 - 2381
  • [9] Separating Retention from Extraction in the Evaluation of End-to-end Relation Extraction
    Taille, Bruno
    Guigue, Vincent
    Scoutheeten, Geoffrey
    Gallinari, Patrick
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 10438 - 10449
  • [10] End-to-End Hierarchical Relation Extraction for Generic Form Understanding
    Tuan Anh Nguyen Dang
    Duc Thanh Hoang
    Quang Bach Tran
    Pan, Chih-Wei
    Thanh Dat Nguyen
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 5238 - 5245