Distant supervision for relation extraction with hierarchical selective attention

被引:38
|
作者
Zhou, Peng [1 ,2 ]
Xu, Jiaming [1 ]
Qi, Zhenyu [1 ]
Bao, Hongyun [1 ]
Chen, Zhineng [1 ]
Xu, Bo [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Automat, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家高技术研究发展计划(863计划);
关键词
Relation extraction; Distant supervision; Hierarchical attention; Piecewise convolutional neural networks; NEURAL-NETWORKS;
D O I
10.1016/j.neunet.2018.08.016
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Distant supervised relation extraction is an important task in the field of natural language processing. There are two main shortcomings for most state-of-the-art methods. One is that they take all sentences of an entity pair as input, which would result in a large computational cost. But in fact, few of most relevant sentences are enough to recognize the relation of an entity pair. To tackle these problems, we propose a novel hierarchical selective attention network for relation extraction under distant supervision. Our model first selects most relevant sentences by taking coarse sentence-level attention on all sentences of an entity pair and then employs word-level attention to construct sentence representations and fine sentence-level attention to aggregate these sentence representations. Experimental results on a widely used dataset demonstrate that our method performs significantly better than most of existing methods. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:240 / 247
页数:8
相关论文
共 50 条
  • [31] Infusion of Labeled Data into Distant Supervision for Relation Extraction
    Pershina, Maria
    Min, Bonan
    Xu, Wei
    Grishman, Ralph
    PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 2, 2014, : 732 - 738
  • [32] Distant Supervision for Relation Extraction with Neural Instance Selector
    Chen, Yubo
    Liu, Hongtao
    Wu, Chuhan
    Yuan, Zhigang
    Jiang, Minyu
    Huang, Yongfeng
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, PT I, 2018, 11108 : 209 - 220
  • [33] Risks of misinterpretation in the evaluation of Distant Supervision for Relation Extraction
    Garcia-Mendoza, Juan-Luis
    Villasenor-Pineda, Luis
    Orihuela-Espina, Felipe
    PROCESAMIENTO DEL LENGUAJE NATURAL, 2022, (68): : 71 - 83
  • [34] A Brief Survey of Relation Extraction Based on Distant Supervision
    Shi, Yong
    Xiao, Yang
    Niu, Lingfeng
    COMPUTATIONAL SCIENCE - ICCS 2019, PT III, 2019, 11538 : 293 - 303
  • [35] Distant Supervision for Relation Extraction via Sparse Representation
    Zeng, Daojian
    Lai, Siwei
    Wang, Xuepeng
    Liu, Kang
    Zhao, Jun
    Lv, Xueqiang
    CHINESE COMPUTATIONAL LINGUISTICS AND NATURAL LANGUAGE PROCESSING BASED ON NATURALLY ANNOTATED BIG DATA, CCL 2014, 2014, 8801 : 151 - 162
  • [37] Adversarial Discriminative Denoising for Distant Supervision Relation Extraction
    Liu, Bing
    Gao, Huan
    Qi, Guilin
    Duan, Shangfu
    Wu, Tianxing
    Wang, Meng
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, 2019, 11448 : 282 - 286
  • [38] Distant Supervision for Relation Extraction via Group Selection
    Xiang, Yang
    Wang, Xiaolong
    Zhang, Yaoyun
    Qin, Yang
    Fan, Shixi
    NEURAL INFORMATION PROCESSING, PT II, 2015, 9490 : 250 - 258
  • [39] Relation Extraction from the Web Using Distant Supervision
    Augenstein, Isabelle
    Maynard, Diana
    Ciravegna, Fabio
    KNOWLEDGE ENGINEERING AND KNOWLEDGE MANAGEMENT, EKAW 2014, 2014, 8876 : 26 - 41
  • [40] Improving Distant Supervision of Relation Extraction with Unsupervised Methods
    Peng, Min
    Huang, Jimin
    Sun, Zhaoyu
    Wang, Shizhong
    Wang, Hua
    Zhuo, Guangping
    Tian, Gang
    WEB INFORMATION SYSTEMS ENGINEERING - WISE 2016, PT I, 2016, 10041 : 561 - 568