Joint Few-Shot Text Classification Aided by Label Semantic and Sentence-Aware Interaction

被引:1
|
作者
Wang, Suhe [1 ]
Liu, Bo [1 ]
机构
[1] Natl Univ Def Technol, Coll Comp, Changsha, Peoples R China
关键词
meta-learning; few-shot text classification; label semantic; pre-trained language model;
D O I
10.1109/IJCNN55064.2022.9892387
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Meta-learning has achieved remarkable performance to address few-shot text classification. However, previous studies fail to attach importance to the label semantic completely and overlook the implicit interaction between lexical features of sentences. In this paper, we explore three enhancement components of the meta-learner aided by the label semantic and sentence-aware interaction, e.g., the label-augmented encoder, the interaction extractor, and the label semantic discriminator. Significantly, these modules are agnostic to the choice of few-shot text classification methods and can be easily incorporated into various existing meta-learning frameworks to improve the classification performance and adaptive ability of the model. We conduct extensive experiments on five benchmark datasets. The results demonstrate that meta-learning approaches upgraded by the above three enhancement components obtain considerable superiority over state-of-the-art models in all datasets. In particular, the average accuracy of 1-shot classification and 5-shot classification is increased by 3.60% and 2.28%, respectively.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Label Semantic Aware Pre-training for Few-shot Text Classification
    Mueller, Aaron
    Krone, Jason
    Romeo, Salvatore
    Mansour, Saab
    Mansimov, Elman
    Zhang, Yi
    Roth, Dan
    [J]. PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 8318 - 8334
  • [2] Distinct Label Representations for Few-Shot Text Classification
    Ohashi, Sora
    Takayama, Junya
    Kajiwara, Tomoyuki
    Arase, Yuki
    [J]. ACL-IJCNLP 2021: THE 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 2, 2021, : 831 - 836
  • [3] Prompt-Based Label-Aware Framework for Few-Shot Multi-Label Text Classification
    Thaminkaew, Thanakorn
    Lertvittayakumjorn, Piyawat
    Vateekul, Peerapon
    [J]. IEEE ACCESS, 2024, 12 : 28310 - 28322
  • [4] Semantic-Aware Feature Aggregation for Few-Shot Image Classification
    Fusheng Hao
    Fuxiang Wu
    Fengxiang He
    Qieshi Zhang
    Chengqun Song
    Jun Cheng
    [J]. Neural Processing Letters, 2023, 55 : 6595 - 6609
  • [5] Semantic-Aware Feature Aggregation for Few-Shot Image Classification
    Hao, Fusheng
    Wu, Fuxiang
    He, Fengxiang
    Zhang, Qieshi
    Song, Chengqun
    Cheng, Jun
    [J]. NEURAL PROCESSING LETTERS, 2023, 55 (05) : 6595 - 6609
  • [6] Label Hallucination for Few-Shot Classification
    Jian, Yiren
    Torresani, Lorenzo
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 7005 - 7014
  • [7] Joint contrastive learning with semantic enhanced label referents for few-shot NER
    Liu, Xiaoya
    Luo, Senlin
    Wu, Zhouting
    Pan, Limin
    Li, Xinshuai
    [J]. Neurocomputing, 2025, 618
  • [8] Uncertainty-aware Self-training for Few-shot Text Classification
    Mukherjee, Subhabrata
    Awadallah, Ahmed Hassan
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [9] Few-Shot Classification with Semantic Augmented Activators
    Gao, Ruixuan
    Su, Han
    Tang, Peisen
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT VIII, 2024, 14432 : 340 - 352
  • [10] Causal representation for few-shot text classification
    Yang, Maoqin
    Zhang, Xuejie
    Wang, Jin
    Zhou, Xiaobing
    [J]. APPLIED INTELLIGENCE, 2023, 53 (18) : 21422 - 21432