Prototypical attention network for few-shot relation classification with entity-aware embedding module

被引:0
|
作者
Li, Xuewei [1 ,2 ,3 ]
Liu, Chao [1 ,2 ,3 ]
Yu, Jian [1 ,2 ,3 ]
Xu, Tianyi [1 ,2 ,3 ]
Zhao, Mankun [1 ,2 ,3 ]
Liu, Hongwei [4 ]
Yu, Mei [1 ,2 ,3 ]
Yu, Ruiguo [1 ,2 ,3 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
[2] Tianjin Key Lab Adv Networking TANKLab, Tianjin, Peoples R China
[3] Tianjin Key Lab Cognit Comp & Applicat, Tianjin, Peoples R China
[4] Tianjin Foreign Studies Univ, Literature & Culture Studies Ctr, Foreign Language, Tianjin, Peoples R China
基金
中国国家自然科学基金;
关键词
Relation classification; Few-shot learning; Prototypical attention network; Entity-aware embedding;
D O I
10.1007/s10489-022-03677-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Relation classification (RC) identifies the semantic relation between entity pairs and plays a critical role in knowledge graph construction and knowledge graph completion. However, insufficient labeled instances of long-tail relations make the training of supervised and distant supervised (DS) relation classification models difficult. Few-shot RC is an effective solution to this problem. At present, metric-based few-shot RC models focus on the representation of relation prototypes and the interaction between instances, ignoring meaningful entity representation and the association of entities and other words in the instance. We propose a prototypical attention network with an entity-aware embedding module (PAN-EAEM) to solve this problem. Firstly, the entity-aware embedding module (EAEM) draws more attention to entity-related words to capture key features. This plug-and-play module can improve the performance of other metric-based models as well. Secondly, the prototypical attention network (PAN) decreases the influence of noise on relation prototype representation by reducing intra-class differences and inter-class ambiguities. Extensive experiments prove that our proposed model obtains state-of-the-art performance on the FewRel dataset.
引用
收藏
页码:10978 / 10994
页数:17
相关论文
共 50 条
  • [31] Structure-Aware Prototypical Neural Process for Few-Shot Graph Classification
    Lin, Xixun
    Li, Zhao
    Zhang, Peng
    Liu, Luchen
    Zhou, Chuan
    Wang, Bin
    Tian, Zhihong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (04) : 4607 - 4621
  • [32] A lightweight dense relation network with attention for hyperspectral image few-shot classification
    Shi, Meilin
    Ren, Jiansi
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [33] A Dual Attention Network with Semantic Embedding for Few-Shot Learning
    Yan, Shipeng
    Zhang, Songyang
    He, Xuming
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 9079 - 9086
  • [34] Prototypical Network With Residual Capsule for Few-Shot Hyperspectral Image Classification
    Fan, Ruihan
    Tong, Lei
    Zhou, Jun
    Guo, Baoqing
    Xiao, Chuangbai
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 1
  • [35] DCPNet: Distribution Calibration Prototypical Network for Few-Shot Image Classification
    Xu, Ranhui
    Jiang, Kaizhong
    Qi, Lulu
    Zhao, Shaojie
    Zheng, Mingming
    IEEE ACCESS, 2024, 12 : 67036 - 67045
  • [36] Granularity-Aware Area Prototypical Network With Bimargin Loss for Few Shot Relation Classification
    Ren, Haopeng
    Cai, Yi
    Lau, Raymond Y. K.
    Leung, Ho-fung
    Li, Qing
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (05) : 4852 - 4866
  • [37] HYBRID ATTENTION-BASED PROTOTYPICAL NETWORKS FOR FEW-SHOT SOUND CLASSIFICATION
    Wang, You
    Anderson, David, V
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 651 - 655
  • [38] Few-shot segmentation with duplex network and attention augmented module
    Zeng, Sifu
    Yang, Jie
    Luo, Wang
    Ruan, Yudi
    FRONTIERS IN NEUROROBOTICS, 2023, 17
  • [39] Relational Embedding for Few-Shot Classification
    Kang, Dahyun
    Kwon, Heeseung
    Min, Juhong
    Cho, Minsu
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8802 - 8813
  • [40] Few-Shot network intrusion detection based on prototypical capsule network with attention mechanism
    Sun, Handi
    Wan, Liang
    Liu, Mengying
    Wang, Bo
    PLOS ONE, 2023, 18 (04):