Distant supervision for relation extraction with hierarchical selective attention

被引:38
|
作者
Zhou, Peng [1 ,2 ]
Xu, Jiaming [1 ]
Qi, Zhenyu [1 ]
Bao, Hongyun [1 ]
Chen, Zhineng [1 ]
Xu, Bo [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Automat, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家高技术研究发展计划(863计划);
关键词
Relation extraction; Distant supervision; Hierarchical attention; Piecewise convolutional neural networks; NEURAL-NETWORKS;
D O I
10.1016/j.neunet.2018.08.016
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Distant supervised relation extraction is an important task in the field of natural language processing. There are two main shortcomings for most state-of-the-art methods. One is that they take all sentences of an entity pair as input, which would result in a large computational cost. But in fact, few of most relevant sentences are enough to recognize the relation of an entity pair. To tackle these problems, we propose a novel hierarchical selective attention network for relation extraction under distant supervision. Our model first selects most relevant sentences by taking coarse sentence-level attention on all sentences of an entity pair and then employs word-level attention to construct sentence representations and fine sentence-level attention to aggregate these sentence representations. Experimental results on a widely used dataset demonstrate that our method performs significantly better than most of existing methods. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:240 / 247
页数:8
相关论文
共 50 条
  • [21] Biomedical Relation Extraction Using Distant Supervision
    Boudjellal, Nada
    Zhang, Huaping
    Khan, Asif
    Ahmad, Arshad
    SCIENTIFIC PROGRAMMING, 2020, 2020
  • [22] Distant Supervision for Relation Extraction with Matrix Completion
    Fan, Miao
    Zhao, Deli
    Zhou, Qiang
    Liu, Zhiyuan
    Zheng, Thomas Fang
    Chang, Edward Y.
    PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1, 2014, : 839 - 849
  • [23] Distant supervision of relation extraction in sparse data
    Ranjbar-Sahraei, Bijan
    Rahmani, Hossein
    Weiss, Gerhard
    Tuyls, Karl
    INTELLIGENT DATA ANALYSIS, 2019, 23 (05) : 1145 - 1166
  • [24] Distant Supervision for Relation Extraction with Gate Mechanism
    Li X.
    Chen Y.
    Xu J.
    Zhang Y.
    Beijing Daxue Xuebao (Ziran Kexue Ban)/Acta Scientiarum Naturalium Universitatis Pekinensis, 2020, 56 (01): : 39 - 44
  • [25] Distant-supervised Relation Extraction with Hierarchical Attention Based on Knowledge Graph
    Yao, Hong
    Dong, Lijun
    Zhen, Shiqi
    Kang, Xiaojun
    Li, Xinchuan
    Liang, Qingzhong
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 229 - 236
  • [26] H-FND: Hierarchical False-Negative Denoising for Distant Supervision Relation Extraction
    Chen, Jhih-Wei
    Fu, Tsu-Jui
    Lee, Chen-Kang
    Ma, Wei-Yun
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 2579 - 2593
  • [27] Chemical-induced disease relation extraction via attention-based distant supervision
    Gu, Jinghang
    Sun, Fuqing
    Qian, Longhua
    Zhou, Guodong
    BMC BIOINFORMATICS, 2019, 20 (1)
  • [28] Distant Supervision for Relation Extraction via Piecewise Attention and Bag-Level Contextual Inference
    Phi, Van-Thuy
    Santoso, Joan
    Tran, Van-Hien
    Shindo, Hiroyuki
    Shimbo, Masashi
    Matsumoto, Yuji
    IEEE ACCESS, 2019, 7 : 103570 - 103582
  • [29] Chemical-induced disease relation extraction via attention-based distant supervision
    Jinghang Gu
    Fuqing Sun
    Longhua Qian
    Guodong Zhou
    BMC Bioinformatics, 20
  • [30] Distant Supervision for Relation Extraction beyond the Sentence Boundary
    Quirk, Chris
    Poon, Hoifung
    15TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2017), VOL 1: LONG PAPERS, 2017, : 1171 - 1182