MICD: More intra-class diversity in few-shot text classification with many classes

被引:0
|
作者
Jang, Gwangseon [1 ,3 ]
Jeong, Hyeon Ji [2 ]
Yi, Mun Yong [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Grad Sch Data Sci, Daejeon, South Korea
[2] Kongju Natl Univ, Sch Artificial Intelligence, Cheonan, South Korea
[3] Korea Inst Sci & Technol Informat KISTI, Large Scale AI Res Grp, Daejeon, South Korea
关键词
Few-shot text classification; Many classes; Intra-class diversity; Contrastive loss; Data augmentation;
D O I
10.1016/j.knosys.2024.112851
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning has gained much interest and achieved remarkable performance in handling limited data scenarios. However, existing few-shot text classification methods typically aim at classifying a limited number of classes, usually ranging from 5 to 10, posing a challenge for many real-world tasks that require few-shot text classification for many classes. Few-shot text classification for many classes has rarely been studied and it is a challenging problem. Distinguishing differences among many classes is more challenging than distinguishing differences among small classes. To address this issue, we propose anew few-shot text classification model for many classes called MICD (More Intra-Class Diversity in few-shot text classification with many classes). Our model comprises two crucial components: Intra-Class Diversity Contrastive Learning (ICDCL) and Intra-Class Augmentation (ICA). ICDCL trains an encoder to enhance feature discriminability by maintaining both intraclass diversity and inter-class specificity, effectively improving generalization performance, even when data is limited. ICA addresses data scarcity by selecting diverse support samples and applying intra-class mix-up, enabling robust generalization to out-of-distribution data-an essential consideration in many-class few-shot learning scenarios. Experimental results on four real datasets show that MICD provides significant performance improvement over the other state-of-the-art approaches.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] MITIGATING INTRA-CLASS VARIANCE IN FEW-SHOT POINT CLOUD CLASSIFICATION
    Wu, Yiqi
    Song, Kelin
    Huang, Xuan
    Zhang, Dejun
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 6330 - 6334
  • [2] Few-shot classification with intra-class co-salient learning and holistic metric
    Chen B.
    Zhu R.
    Yu L.
    Zhao Y.
    Neural Computing and Applications, 2024, 36 (23) : 14327 - 14339
  • [3] On filling the intra-class and inter-class gaps for few-shot segmentation
    Zhang, Yuxuan
    Wang, Shuchang
    Shi, Zhenbo
    Yang, Wei
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 261
  • [4] Boosting Generalized Few-Shot Learning by Scattering Intra-class Distribution
    Yu, Yunlong
    Jin, Lisha
    Li, Yingming
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT II, 2023, 14170 : 438 - 453
  • [5] A Closer Look at Few-Shot Classification with Many Novel Classes
    Lin, Zhipeng
    Yang, Wenjing
    Wang, Haotian
    Chi, Haoang
    Lan, Long
    APPLIED SCIENCES-BASEL, 2024, 14 (16):
  • [6] Few-Shot Classification With Intra-Class Unrelated Multi-Prototype Representation and Episode Adaptation Strategy
    Wen Zhijie
    Zhang Qi
    Wang Wei
    Ma Liyan
    2021 IEEE 33RD INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2021), 2021, : 1042 - 1049
  • [7] vMF Loss: Exploring a Scattered Intra-class Hypersphere for Few-Shot Learning
    Liu, Xin
    Wang, Shijing
    Zhou, Kairui
    Lyu, Yilin
    Song, Mingyang
    Jing, Liping
    Zeng, Tieyong
    Yu, Jian
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT II, 2023, 14170 : 454 - 470
  • [8] FGNet: Towards Filling the Intra-class and Inter-class Gaps for Few-shot Segmentation
    Zhang, Yuxuan
    Yang, Wei
    Wang, Shaowei
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 1749 - 1758
  • [9] Causal representation for few-shot text classification
    Yang, Maoqin
    Zhang, Xuejie
    Wang, Jin
    Zhou, Xiaobing
    APPLIED INTELLIGENCE, 2023, 53 (18) : 21422 - 21432
  • [10] Adversarial training for few-shot text classification
    Croce, Danilo
    Castellucci, Giuseppe
    Basili, Roberto
    INTELLIGENZA ARTIFICIALE, 2020, 14 (02) : 201 - 214