Hybrid Enhancement-based prototypical networks for few-shot relation classification

被引:1
|
作者
Wang, Lei [1 ]
Qu, Jianfeng [1 ]
Xu, Tianyu [1 ]
Li, Zhixu [2 ]
Chen, Wei [1 ]
Xu, Jiajie [1 ]
Zhao, Lei [1 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215006, Peoples R China
[2] Fudan Univ, Sch Comp Sci, Shanghai 201203, Peoples R China
基金
中国国家自然科学基金;
关键词
Few-shot learning; Relation classification; Prototypical networks; Enhancement-based; Unbiased relation prototypes;
D O I
10.1007/s11280-023-01184-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Few-shot relation classification is to recognize the semantic relation between an entity pair with very few samples. Prototypical network has proven to be a simple yet effective few-shot learning method for relation extraction. However, under the condition of data scarcity, the relation prototypes we achieve are usually biased compared to the real ones computed from all samples within a relation class. To alleviate this issue, we propose hybrid enhancement-based prototypical networks. In particular, our model contains three main enhancement modules: 1) a query-guided prototype enhancement module using rich interactive information between the support instances and the query instance as guidance to obtain more accurate prototype representations; 2) a query enhancement module to diminish the distribution gap between the query set and the support set; 3) a support enhancement module adopting a pseudo-label strategy to expand the scale of available data. On basis of these modules, we further design a novel prototype attention fusion mechanism to fuse information and compute discriminative relation prototypes for classification. In this way, we hope to obtain unbiased representations closer to our expected prototypes by improving the available data scale and data utilization efficiency. Extensive experimental results on the widely-used FewRel dataset demonstrate the superiority of our proposed model.
引用
下载
收藏
页码:3207 / 3226
页数:20
相关论文
共 50 条
  • [1] Hybrid Enhancement-based prototypical networks for few-shot relation classification
    Lei Wang
    Jianfeng Qu
    Tianyu Xu
    Zhixu Li
    Wei Chen
    Jiajie Xu
    Lei Zhao
    World Wide Web, 2023, 26 : 3207 - 3226
  • [2] Hybrid Attention-Based Prototypical Networks for Noisy Few-Shot Relation Classification
    Gao, Tianyu
    Han, Xu
    Liu, Zhiyuan
    Sun, Maosong
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 6407 - 6414
  • [3] HYBRID ATTENTION-BASED PROTOTYPICAL NETWORKS FOR FEW-SHOT SOUND CLASSIFICATION
    Wang, You
    Anderson, David, V
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 651 - 655
  • [4] Enhance prototypical networks with hybrid attention and confusing loss function for few-shot relation classification
    Li, Yibing
    Ma, Zuchang
    Gao, Lisheng
    Wu, Yichen
    Xie, Fei
    Ren, Xiaoye
    NEUROCOMPUTING, 2022, 493 : 362 - 372
  • [5] Few-shot relation classification by context attention-based prototypical networks with BERT
    Bei Hui
    Liang Liu
    Jia Chen
    Xue Zhou
    Yuhui Nian
    EURASIP Journal on Wireless Communications and Networking, 2020
  • [6] Few-shot relation classification by context attention-based prototypical networks with BERT
    Hui, Bei
    Liu, Liang
    Chen, Jia
    Zhou, Xue
    Nian, Yuhui
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2020, 2020 (01)
  • [7] Multi-transformer based on prototypical enhancement network for few-shot relation classification with domain adaptation
    Du, Hongfei
    Zhang, Qinghua
    Li, Keyuan
    Zhao, Fan
    Wang, Guoyin
    NEUROCOMPUTING, 2023, 559
  • [8] Feature Enhancement-Based Few-Shot Bearing Surface Defect Image Classification MethodFeature Enhancement-Based Few-Shot Bearing...Y. Cang and X. Zhang
    Yan Cang
    Xuanshang Zhang
    Neural Processing Letters, 57 (1)
  • [9] Few-Shot Relation Classification Research Based on Prototypical Network and Causal Intervention
    Li, Zhiming
    Ouyang, Feifan
    Zhou, Chunlong
    He, Yihao
    Shen, Limin
    IEEE ACCESS, 2022, 10 : 36995 - 37002
  • [10] HYBRID CONTRASTIVE PROTOTYPICAL NETWORK FOR FEW-SHOT SCENE CLASSIFICATION
    Zhu, Junjie
    Yang, Ke
    Qiu, Chunping
    Dai, Mengyuan
    Guan, Naiyang
    Yi, Xiaodong
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3588 - 3592