Distant supervision for relation extraction with hierarchical selective attention

被引:38
|
作者
Zhou, Peng [1 ,2 ]
Xu, Jiaming [1 ]
Qi, Zhenyu [1 ]
Bao, Hongyun [1 ]
Chen, Zhineng [1 ]
Xu, Bo [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Automat, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家高技术研究发展计划(863计划);
关键词
Relation extraction; Distant supervision; Hierarchical attention; Piecewise convolutional neural networks; NEURAL-NETWORKS;
D O I
10.1016/j.neunet.2018.08.016
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Distant supervised relation extraction is an important task in the field of natural language processing. There are two main shortcomings for most state-of-the-art methods. One is that they take all sentences of an entity pair as input, which would result in a large computational cost. But in fact, few of most relevant sentences are enough to recognize the relation of an entity pair. To tackle these problems, we propose a novel hierarchical selective attention network for relation extraction under distant supervision. Our model first selects most relevant sentences by taking coarse sentence-level attention on all sentences of an entity pair and then employs word-level attention to construct sentence representations and fine sentence-level attention to aggregate these sentence representations. Experimental results on a widely used dataset demonstrate that our method performs significantly better than most of existing methods. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:240 / 247
页数:8
相关论文
共 50 条
  • [41] Combining Distant and Direct Supervision for Neural Relation Extraction
    Beltagy, Iz
    Lo, Kyle
    Ammar, Waleed
    2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 1858 - 1867
  • [42] A Hybrid Graph Model for Distant Supervision Relation Extraction
    Duan, Shangfu
    Gao, Huan
    Liu, Bing
    Qi, Guilin
    SEMANTIC WEB, ESWC 2019, 2019, 11503 : 36 - 51
  • [43] Distant Supervision for Relation Extraction with Sentence Selection and Interaction Representation
    Chen, Tiantian
    Wang, Nianbin
    Wang, Hongbin
    Zhan, Haomin
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021
  • [44] DSGAN: Generative Adversarial Training for Distant Supervision Relation Extraction
    Qin, Pengda
    Xu, Weiran
    Wang, William Yang
    PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, 2018, : 496 - 505
  • [45] Denoising Distant Supervision for Relation Extraction with Entropy Weight Method
    Lu, Mengyi
    Liu, Pengyuan
    CHINESE COMPUTATIONAL LINGUISTICS, CCL 2019, 2019, 11856 : 294 - 305
  • [46] Distant supervision for relation extraction with weak constraints of entity pairs
    Ouyang D.-T.
    Xiao J.
    Ye Y.-X.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2019, 49 (03): : 912 - 919
  • [47] Bootstrapped Multi-level Distant Supervision for Relation Extraction
    He, Ying
    Li, Zhixu
    Liu, Guanfeng
    Cao, Fangfei
    Chen, Zhigang
    Wang, Ke
    Ma, Jie
    WEB INFORMATION SYSTEMS ENGINEERING, WISE 2018, PT I, 2018, 11233 : 408 - 423
  • [48] Domain Adapted Distant Supervision for Pedagogically Motivated Relation Extraction
    Sain, Oscar
    Lopez de Lacall, Oier
    Aldab, Itziar
    Maritxala, Montse
    PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), 2020, : 2213 - 2222
  • [49] GAN Driven Semi-distant Supervision for Relation Extraction
    Li, Pengshuai
    Zhang, Xinsong
    Jia, Weijia
    Zhao, Hai
    2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 3026 - 3035
  • [50] Distant Supervision for Relation Extraction with Ranking-Based Methods
    Xiang, Yang
    Chen, Qingcai
    Wang, Xiaolong
    Qin, Yang
    ENTROPY, 2016, 18 (06)