Distant supervision for relation extraction with hierarchical selective attention

被引:38
|
作者
Zhou, Peng [1 ,2 ]
Xu, Jiaming [1 ]
Qi, Zhenyu [1 ]
Bao, Hongyun [1 ]
Chen, Zhineng [1 ]
Xu, Bo [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Automat, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家高技术研究发展计划(863计划);
关键词
Relation extraction; Distant supervision; Hierarchical attention; Piecewise convolutional neural networks; NEURAL-NETWORKS;
D O I
10.1016/j.neunet.2018.08.016
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Distant supervised relation extraction is an important task in the field of natural language processing. There are two main shortcomings for most state-of-the-art methods. One is that they take all sentences of an entity pair as input, which would result in a large computational cost. But in fact, few of most relevant sentences are enough to recognize the relation of an entity pair. To tackle these problems, we propose a novel hierarchical selective attention network for relation extraction under distant supervision. Our model first selects most relevant sentences by taking coarse sentence-level attention on all sentences of an entity pair and then employs word-level attention to construct sentence representations and fine sentence-level attention to aggregate these sentence representations. Experimental results on a widely used dataset demonstrate that our method performs significantly better than most of existing methods. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:240 / 247
页数:8
相关论文
共 50 条
  • [1] Distant Supervision for Relation Extraction with Hierarchical Attention and Entity Descriptions
    She, Heng
    Wu, Bin
    Wang, Bai
    Chi, Renjun
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [2] Distant supervision for relation extraction with hierarchical attention-based networks
    Zhang, Jing
    Cao, Meilin
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 220
  • [3] Distant Supervised Relation Extraction with Hierarchical Attention Mechanism
    Liu, Jianyi
    Chen, Liandong
    Shi, Rui
    Xu, Jie
    Liu, An
    2021 THE 7TH INTERNATIONAL CONFERENCE ON COMMUNICATION AND INFORMATION PROCESSING, ICCIP 2021, 2021, : 44 - 50
  • [4] Self-selective attention using correlation between instances for distant supervision relation extraction
    Zhou, Yanru
    Pan, Limin
    Bai, Chongyou
    Luo, Senlin
    Wu, Zhouting
    NEURAL NETWORKS, 2021, 142 : 213 - 220
  • [5] Knowledge graph attention mechanism for distant supervision neural relation extraction
    Liu, Meizhen
    Zhou, Fengyu
    He, Jiakai
    Yan, Xiaohui
    KNOWLEDGE-BASED SYSTEMS, 2022, 256
  • [6] Revisiting Distant Supervision for Relation Extraction
    Jiang, Tingsong
    Liu, Jing
    Lin, Chin-Yew
    Sui, Zhifang
    PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2018), 2018, : 3580 - 3585
  • [7] Global Distant Supervision for Relation Extraction
    Han, Xianpei
    Sun, Le
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 2950 - 2956
  • [8] Distant supervision for neural relation extraction integrated with word attention and property features
    Qu, Jianfeng
    Ouyang, Dantong
    Hua, Wen
    Ye, Yuxin
    Li, Ximing
    NEURAL NETWORKS, 2018, 100 : 59 - 69
  • [9] Distant Supervision Relation Extraction with Improved PCNN and Multi-level Attention
    Zou, Yang
    Wang, Qifei
    Wang, Zhen
    Zhou, Jian
    Zeng, Xiaoqin
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I, KSEM 2023, 2023, 14117 : 315 - 327
  • [10] Distant Supervision for Relation Extraction with Sentence-Level Attention and Entity Descriptions
    Ji, Guoliang
    Liu, Kang
    He, Shizhu
    Zhao, Jun
    THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 3060 - 3066