Prototypical attention network for few-shot relation classification with entity-aware embedding module

被引:0
|
作者
Li, Xuewei [1 ,2 ,3 ]
Liu, Chao [1 ,2 ,3 ]
Yu, Jian [1 ,2 ,3 ]
Xu, Tianyi [1 ,2 ,3 ]
Zhao, Mankun [1 ,2 ,3 ]
Liu, Hongwei [4 ]
Yu, Mei [1 ,2 ,3 ]
Yu, Ruiguo [1 ,2 ,3 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
[2] Tianjin Key Lab Adv Networking TANKLab, Tianjin, Peoples R China
[3] Tianjin Key Lab Cognit Comp & Applicat, Tianjin, Peoples R China
[4] Tianjin Foreign Studies Univ, Literature & Culture Studies Ctr, Foreign Language, Tianjin, Peoples R China
基金
中国国家自然科学基金;
关键词
Relation classification; Few-shot learning; Prototypical attention network; Entity-aware embedding;
D O I
10.1007/s10489-022-03677-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Relation classification (RC) identifies the semantic relation between entity pairs and plays a critical role in knowledge graph construction and knowledge graph completion. However, insufficient labeled instances of long-tail relations make the training of supervised and distant supervised (DS) relation classification models difficult. Few-shot RC is an effective solution to this problem. At present, metric-based few-shot RC models focus on the representation of relation prototypes and the interaction between instances, ignoring meaningful entity representation and the association of entities and other words in the instance. We propose a prototypical attention network with an entity-aware embedding module (PAN-EAEM) to solve this problem. Firstly, the entity-aware embedding module (EAEM) draws more attention to entity-related words to capture key features. This plug-and-play module can improve the performance of other metric-based models as well. Secondly, the prototypical attention network (PAN) decreases the influence of noise on relation prototype representation by reducing intra-class differences and inter-class ambiguities. Extensive experiments prove that our proposed model obtains state-of-the-art performance on the FewRel dataset.
引用
收藏
页码:10978 / 10994
页数:17
相关论文
共 50 条
  • [1] Prototypical attention network for few-shot relation classification with entity-aware embedding module
    Xuewei Li
    Chao Liu
    Jian Yu
    Tianyi Xu
    Mankun Zhao
    Hongwei Liu
    Mei Yu
    Ruiguo Yu
    Applied Intelligence, 2023, 53 : 10978 - 10994
  • [2] DPNet: domain-aware prototypical network for interdisciplinary few-shot relation classification
    Lv, Bo
    Jin, Li
    Li, Xiaoyu
    Sun, Xian
    Guo, Zhi
    Zhang, Zequn
    Li, Shuchao
    APPLIED INTELLIGENCE, 2022, 52 (13) : 15718 - 15733
  • [3] DPNet: domain-aware prototypical network for interdisciplinary few-shot relation classification
    Bo Lv
    Li Jin
    Xiaoyu Li
    Xian Sun
    Zhi Guo
    Zequn Zhang
    Shuchao Li
    Applied Intelligence, 2022, 52 : 15718 - 15733
  • [4] Taxonomy-Aware Prototypical Network for Few-Shot Relation Extraction
    Wang, Mengru
    Zheng, Jianming
    Chen, Honghui
    MATHEMATICS, 2022, 10 (22)
  • [5] Few-Shot Relation Extraction via the Entity Feature Enhancement and Attention-Based Prototypical Network
    Li, Ren
    Xiao, Qiao
    Yang, Jianxi
    Ren, Hao
    Chen, Yu
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2023, 2023
  • [6] TRANSDUCTIVE PROTOTYPICAL NETWORK FOR FEW-SHOT CLASSIFICATION
    Liu, Xinyue
    Liu, Pengxin
    Zong, Linlin
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 1671 - 1675
  • [7] Enhance Prototypical Network with Text Descriptions for Few-shot Relation Classification
    Yang, Kaijia
    Zheng, Nantao
    Dai, Xinyu
    He, Liang
    Huang, Shujian
    Chen, Jiajun
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 2273 - 2276
  • [8] Global-Aware Prototypical Network for Few-Shot Encrypted Traffic Classification
    Guo, Jingyu
    Cui, Mingxin
    Hou, Chengshang
    Gou, Gaopeng
    Li, Zhen
    Xiong, Gang
    Liu, Chang
    2022 IFIP NETWORKING CONFERENCE (IFIP NETWORKING), 2022,
  • [9] Total Relation Network with Attention for Few-Shot Image Classification
    Li X.-X.
    Liu Z.-Y.
    Wu J.-J.
    Cao J.
    Ma Z.-Y.
    Jisuanji Xuebao/Chinese Journal of Computers, 2023, 46 (02): : 371 - 384
  • [10] Enhanced prototypical network for few-shot relation extraction
    Wen, Wen
    Liu, Yongbin
    Ouyang, Chunping
    Lin, Qiang
    Chung, Tonglee
    INFORMATION PROCESSING & MANAGEMENT, 2021, 58 (04)