MICD: More intra-class diversity in few-shot text classification with many classes

被引:0
|
作者
Jang, Gwangseon [1 ,3 ]
Jeong, Hyeon Ji [2 ]
Yi, Mun Yong [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Grad Sch Data Sci, Daejeon, South Korea
[2] Kongju Natl Univ, Sch Artificial Intelligence, Cheonan, South Korea
[3] Korea Inst Sci & Technol Informat KISTI, Large Scale AI Res Grp, Daejeon, South Korea
关键词
Few-shot text classification; Many classes; Intra-class diversity; Contrastive loss; Data augmentation;
D O I
10.1016/j.knosys.2024.112851
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning has gained much interest and achieved remarkable performance in handling limited data scenarios. However, existing few-shot text classification methods typically aim at classifying a limited number of classes, usually ranging from 5 to 10, posing a challenge for many real-world tasks that require few-shot text classification for many classes. Few-shot text classification for many classes has rarely been studied and it is a challenging problem. Distinguishing differences among many classes is more challenging than distinguishing differences among small classes. To address this issue, we propose anew few-shot text classification model for many classes called MICD (More Intra-Class Diversity in few-shot text classification with many classes). Our model comprises two crucial components: Intra-Class Diversity Contrastive Learning (ICDCL) and Intra-Class Augmentation (ICA). ICDCL trains an encoder to enhance feature discriminability by maintaining both intraclass diversity and inter-class specificity, effectively improving generalization performance, even when data is limited. ICA addresses data scarcity by selecting diverse support samples and applying intra-class mix-up, enabling robust generalization to out-of-distribution data-an essential consideration in many-class few-shot learning scenarios. Experimental results on four real datasets show that MICD provides significant performance improvement over the other state-of-the-art approaches.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Learning to Obstruct Few-Shot Image Classification over Restricted Classes
    Zheng, Amber Yijia
    Yang, Chiao-An
    Yeh, Raymond A.
    COMPUTER VISION - ECCV 2024, PT XX, 2025, 15078 : 20 - 37
  • [42] Meta Learning for Few-Shot One-Class Classification
    Dahia, Gabriel
    Segundo, Mauricio Pamplona
    AI, 2021, 2 (02) : 195 - 208
  • [43] Dual class representation learning for few-shot image classification
    Singh, Pravendra
    Mazumder, Pratik
    KNOWLEDGE-BASED SYSTEMS, 2022, 238
  • [44] SELP: A Semantically-Driven Approach for Separated and Accurate Class Prototypes in Few-Shot Text Classification
    Liang, Wenxin
    Zhang, Tingyu
    Liu, Han
    Zhang, Feng
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: ACL 2024, 2024, : 9732 - 9741
  • [45] MetricPrompt: Prompting Model as a Relevance Metric for Few-shot Text Classification
    Dong, Hongyuan
    Zhang, Weinan
    Che, Wanxiang
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 426 - 436
  • [46] Enhance Prototypical Network with Text Descriptions for Few-shot Relation Classification
    Yang, Kaijia
    Zheng, Nantao
    Dai, Xinyu
    He, Liang
    Huang, Shujian
    Chen, Jiajun
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 2273 - 2276
  • [47] Noisy Channel Language Model Prompting for Few-Shot Text Classification
    Min, Sewon
    Lewis, Mike
    Hajishirzi, Hannaneh
    Zettlemoyer, Luke
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 5316 - 5330
  • [48] Few-Shot Text and Image Classification via Analogical Transfer Learning
    Liu, Wenhe
    Chang, Xiaojun
    Yan, Yan
    Yang, Yi
    Hauptmann, Alexander G.
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2018, 9 (06)
  • [49] Knowledge-Enhanced Prompt Learning for Few-Shot Text Classification
    Liu, Jinshuo
    Yang, Lu
    BIG DATA AND COGNITIVE COMPUTING, 2024, 8 (04)
  • [50] Few-shot text classification by leveraging bi-directional attention and cross-class knowledge
    Ning Pang
    Xiang Zhao
    Wei Wang
    Weidong Xiao
    Deke Guo
    Science China Information Sciences, 2021, 64