Joint Entity Relation Extraction Based on LSTM via Attention Mechanism

被引:0
|
作者
Cao, Xu [1 ]
Shao, Qing [1 ]
机构
[1] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
基金
中国国家自然科学基金;
关键词
Joint entity relation extraction; Context semantic; Dependency syntax; Feature fusion; Bidirectional Long Short-Term Memory;
D O I
10.1007/s13369-023-08306-6
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Entity relation extraction holds a significant role in extracting structured information from unstructured text, serving as a foundational component for various other tasks within natural language processing. The pipeline method in entity relation extraction separates entity subtask from relation subtask, causing an error propagation. Contemporary researchers are more inclined to amalgamate two subtasks, improve and innovate the structures of models to carry out joint entity relation extraction. However, these models often merely capture surface-level text features, overlooking the profound-level semantics and syntax inherent within sentences, consequently forfeiting valuable knowledge. In this condition, we propose a joint entity relation extraction method that integrates context semantic and dependency syntax. The bidirectional long short-term memory network is employed to explore context semantic features of sentences, and tree-structured LSTM is utilized to extract dependency syntactic features, subsequently two types of features are fused with the attention mechanism for joint extraction. Experiment results demonstrate that compared with other models, the Accuracy, Recall and F1-value of our proposed method are increased evidently, proving that semantic and syntactic information contained in sentences are beneficial for entity relation extraction.
引用
收藏
页码:4353 / 4363
页数:11
相关论文
共 50 条
  • [1] Joint Entity Relation Extraction Based on LSTM via Attention Mechanism
    Xu Cao
    Qing Shao
    Arabian Journal for Science and Engineering, 2024, 49 : 4353 - 4363
  • [2] Entity Relation Extraction Based on Improved Attention Mechanism
    Feng J.-Z.
    Song S.-S.
    Wang Y.-Z.
    Liu Y.-K.
    Wu H.-Y.
    Gong H.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2019, 47 (08): : 1692 - 1700
  • [3] Attention-Based LSTM with Filter Mechanism for Entity Relation Classification
    Jin, Yanliang
    Wu, Dijia
    Guo, Weisi
    SYMMETRY-BASEL, 2020, 12 (10): : 1 - 16
  • [4] Entity Relationship Extraction Based on Bi-LSTM and Attention Mechanism
    Wei, Ming
    Xu, Zhipeng
    Hu, Jiwei
    PROCEEDINGS OF 2021 2ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND INFORMATION SYSTEMS (ICAIIS '21), 2021,
  • [5] Joint Entity Relation Extraction Model Based on Interactive Attention
    Hao, Xiaofang
    Zhang, Chaoqun
    Li, Xiaoxiang
    Wang, Darui
    Computer Engineering and Applications, 2024, 60 (08) : 156 - 164
  • [6] Joint Model of Entity Recognition and Relation Extraction with Self-attention Mechanism
    Liu, Maofu
    Zhang, Yukun
    Li, Wenjie
    Ji, Donghong
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2020, 19 (04)
  • [7] SUBSEQUENCE-LEVEL ENTITY ATTENTION LSTM FOR RELATION EXTRACTION
    Gan, Tao
    Gan, Yunqiang
    He, Yanmin
    2019 16TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICWAMTIP), 2019, : 262 - 265
  • [8] Joint Entity-Relation Extraction via Improved Graph Attention Networks
    Lai, Qinghan
    Zhou, Zihan
    Liu, Song
    SYMMETRY-BASEL, 2020, 12 (10): : 1 - 17
  • [9] Attention Weight is Indispensable in Joint Entity and Relation Extraction
    Ouyang, Jianquan
    Zhang, Jing
    Liu, Tianming
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2022, 34 (03): : 1707 - 1723
  • [10] Joint Extraction of Entities and Relations via Entity and Relation Heterogeneous Graph Attention Networks
    Jiang, Bo
    Cao, Jia
    APPLIED SCIENCES-BASEL, 2023, 13 (02):