Joint Entity-Relation Extraction via Improved Graph Attention Networks

被引:8
|
作者
Lai, Qinghan [1 ]
Zhou, Zihan [1 ]
Liu, Song [1 ]
机构
[1] Qilu Univ Technol, Shandong Acad Sci, Sch Comp Sci & Technol, Jinan 250353, Peoples R China
来源
SYMMETRY-BASEL | 2020年 / 12卷 / 10期
关键词
named entity recognition; relation extraction; graph attention network; adversarial training;
D O I
10.3390/sym12101746
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Joint named entity recognition and relation extraction is an essential natural language processing task that aims to identify entities and extract the corresponding relations in an end-to-end manner. At present, compared with the named entity recognition task, the relation extraction task performs poorly on complex text. To solve this problem, we proposed a novel joint model named extracting Entity-Relations viaImproved Graph Attention networks (ERIGAT), which enhances the ability of the relation extraction task. In our proposed model, we introduced the graph attention network to extract entities and relations after graph embedding based on constructing symmetry relations. To mitigate the over-smoothing problem of graph convolutional networks, inspired by matrix factorization, we improved the graph attention network by designing a new multi-head attention mechanism and sharing attention parameters. To enhance the model robustness, we adopted the adversarial training to generate adversarial samples for training by adding tiny perturbations. Comparing with typical baseline models, we comprehensively evaluated our model by conducting experiments on an open domain dataset (CoNLL04) and a medical domain dataset (ADE). The experimental results demonstrate the effectiveness of ERIGAT in extracting entity and relation information.
引用
收藏
页码:1 / 17
页数:17
相关论文
共 50 条
  • [21] GRIAS: an Entity-Relation Graph based Framework for Discovering Entity Aliases
    Jiang, Lili
    Luo, Ping
    Wang, Jianyong
    Xiong, Yuhong
    Lin, Bingduan
    Wang, Min
    An, Ning
    2013 IEEE 13TH INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2013, : 310 - 319
  • [22] Span-based single-stage joint entity-relation extraction model
    Han, Dongchen
    Zheng, Zhaoqian
    Zhao, Hui
    Feng, Shanshan
    Pang, Haiting
    PLOS ONE, 2023, 18 (02):
  • [23] Entity-relation triple extraction based on relation sequence information
    Zhang, Zhanjun
    Zhang, Haoyu
    Wan, Qian
    Liu, Jie
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [24] Knowledge enhanced graph inference network based entity-relation extraction and knowledge graph construction for industrial domain
    Zhulin Han
    Jian Wang
    Frontiers of Engineering Management, 2024, 11 : 143 - 158
  • [25] Entity Relation Extraction Based on Improved Attention Mechanism
    Feng J.-Z.
    Song S.-S.
    Wang Y.-Z.
    Liu Y.-K.
    Wu H.-Y.
    Gong H.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2019, 47 (08): : 1692 - 1700
  • [26] Joint Entity-Relation Extraction Model for Epidemiological Reports Based on SMART Adversarial Training
    Sun, Jiazheng
    Yan, Huaicheng
    Li, Yue
    Li, Hao
    Bai, Ke
    Li, Zhichen
    2024 14TH ASIAN CONTROL CONFERENCE, ASCC 2024, 2024, : 141 - 146
  • [27] Knowledge enhanced graph inference network based entity-relation extraction and knowledge graph construction for industrial domain
    Han, Zhulin
    Wang, Jian
    FRONTIERS OF ENGINEERING MANAGEMENT, 2024, 11 (01) : 143 - 158
  • [28] A Relation-Specific Attention Network for Joint Entity and Relation Extraction
    Yuan, Yue
    Zhou, Xiaofei
    Pan, Shirui
    Zhu, Qiannan
    Song, Zeliang
    Guo, Li
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 4054 - 4060
  • [29] Semantic Graph Application to Call Center for Entity-Relation Search
    Kawamura, Takahiro
    Ohsuga, Akihiko
    ADVANCED SCIENCE LETTERS, 2015, 21 (10) : 3092 - 3098
  • [30] REEGAT: RoBERTa Entity Embedding and Graph Attention Networks Enhanced Sentence Representation for Relation Extraction
    Cai, Fengze
    Hu, Qiang
    Zhou, Renjie
    Xiong, Neal
    ELECTRONICS, 2023, 12 (11)