Joint Entity Relation Extraction Based on LSTM via Attention Mechanism

被引:0
|
作者
Cao, Xu [1 ]
Shao, Qing [1 ]
机构
[1] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
基金
中国国家自然科学基金;
关键词
Joint entity relation extraction; Context semantic; Dependency syntax; Feature fusion; Bidirectional Long Short-Term Memory;
D O I
10.1007/s13369-023-08306-6
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Entity relation extraction holds a significant role in extracting structured information from unstructured text, serving as a foundational component for various other tasks within natural language processing. The pipeline method in entity relation extraction separates entity subtask from relation subtask, causing an error propagation. Contemporary researchers are more inclined to amalgamate two subtasks, improve and innovate the structures of models to carry out joint entity relation extraction. However, these models often merely capture surface-level text features, overlooking the profound-level semantics and syntax inherent within sentences, consequently forfeiting valuable knowledge. In this condition, we propose a joint entity relation extraction method that integrates context semantic and dependency syntax. The bidirectional long short-term memory network is employed to explore context semantic features of sentences, and tree-structured LSTM is utilized to extract dependency syntactic features, subsequently two types of features are fused with the attention mechanism for joint extraction. Experiment results demonstrate that compared with other models, the Accuracy, Recall and F1-value of our proposed method are increased evidently, proving that semantic and syntactic information contained in sentences are beneficial for entity relation extraction.
引用
收藏
页码:4353 / 4363
页数:11
相关论文
共 50 条
  • [41] AgriBERT: A Joint Entity Relation Extraction Model Based on Agricultural Text
    Chen, Xiaojin
    Chen, Tianyue
    Zhao, Jingbo
    Wang, Yaojun
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT II, KSEM 2024, 2024, 14885 : 254 - 266
  • [42] A Joint Entity Relation Extraction Model Based on Relation Semantic Template Automatically Constructed
    Liu, Wei
    Yin, Meijuan
    Zhang, Jialong
    Cui, Lunchong
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 78 (01): : 975 - 997
  • [43] Specific Relation Attention-Guided Graph Neural Networks for Joint Entity and Relation Extraction in Chinese EMR
    Pang, Yali
    Qin, Xiaohui
    Zhang, Zhichang
    APPLIED SCIENCES-BASEL, 2022, 12 (17):
  • [44] Chinese Entity Relation Extraction Based on Multi-level Gated Recurrent Mechanism and Self-attention
    Zhong, Zicheng
    PROCEEDINGS OF 2021 2ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND INFORMATION SYSTEMS (ICAIIS '21), 2021,
  • [45] Named Entity Recognition via Interlayer Attention Residual LSTM
    Yang, Gang
    Xu, Hongzhe
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [46] ENPAR:Enhancing Entity and Entity Pair Representations for Joint Entity Relation Extraction
    Wang, Yijun
    Sun, Changzhi
    Wu, Yuanbin
    Zhou, Hao
    Li, Lei
    Yan, Junchi
    16TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2021), 2021, : 2877 - 2887
  • [47] Entity Relation Extraction Based on Entity Indicators
    Qin, Yongbin
    Yang, Weizhe
    Wang, Kai
    Huang, Ruizhang
    Tian, Feng
    Ao, Shaolin
    Chen, Yanping
    SYMMETRY-BASEL, 2021, 13 (04):
  • [48] Construction and Application of Text Entity Relation Joint Extraction Model Based on Multi-Head Attention Neural Network
    Xue, Yafei
    Zhu, Jing
    Lyu, Jing
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [49] Few-Shot Relation Extraction via the Entity Feature Enhancement and Attention-Based Prototypical Network
    Li, Ren
    Xiao, Qiao
    Yang, Jianxi
    Ren, Hao
    Chen, Yu
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2023, 2023
  • [50] Construction and Application of Text Entity Relation Joint Extraction Model Based on Multi-Head Attention Neural Network
    Xue, Yafei
    Zhu, Jing
    Lyu, Jing
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022