MICD: More intra-class diversity in few-shot text classification with many classes

被引:0
|
作者
Jang, Gwangseon [1 ,3 ]
Jeong, Hyeon Ji [2 ]
Yi, Mun Yong [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Grad Sch Data Sci, Daejeon, South Korea
[2] Kongju Natl Univ, Sch Artificial Intelligence, Cheonan, South Korea
[3] Korea Inst Sci & Technol Informat KISTI, Large Scale AI Res Grp, Daejeon, South Korea
关键词
Few-shot text classification; Many classes; Intra-class diversity; Contrastive loss; Data augmentation;
D O I
10.1016/j.knosys.2024.112851
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning has gained much interest and achieved remarkable performance in handling limited data scenarios. However, existing few-shot text classification methods typically aim at classifying a limited number of classes, usually ranging from 5 to 10, posing a challenge for many real-world tasks that require few-shot text classification for many classes. Few-shot text classification for many classes has rarely been studied and it is a challenging problem. Distinguishing differences among many classes is more challenging than distinguishing differences among small classes. To address this issue, we propose anew few-shot text classification model for many classes called MICD (More Intra-Class Diversity in few-shot text classification with many classes). Our model comprises two crucial components: Intra-Class Diversity Contrastive Learning (ICDCL) and Intra-Class Augmentation (ICA). ICDCL trains an encoder to enhance feature discriminability by maintaining both intraclass diversity and inter-class specificity, effectively improving generalization performance, even when data is limited. ICA addresses data scarcity by selecting diverse support samples and applying intra-class mix-up, enabling robust generalization to out-of-distribution data-an essential consideration in many-class few-shot learning scenarios. Experimental results on four real datasets show that MICD provides significant performance improvement over the other state-of-the-art approaches.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Knowledge Guided Metric Learning for Few-Shot Text Classification
    Sui, Dianbo
    Chen, Yubo
    Mao, Binjie
    Qiu, Delai
    Liu, Kang
    Zhao, Jun
    2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), 2021, : 3266 - 3271
  • [32] Boosting Few-Shot Text Classification via Distribution Estimation
    Liu, Han
    Zhang, Feng
    Zhang, Xiaotong
    Zhao, Siyang
    Ma, Fenglong
    Wu, Xiao-Ming
    Chen, Hongyang
    Yu, Hong
    Zhang, Xianchao
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 11, 2023, : 13219 - 13227
  • [33] Intra-inter channel attention for few-shot classification
    Yang L.
    Zhang T.
    Wang Y.
    Gu X.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2023, 31 (21): : 3145 - 3155
  • [34] Hierarchical Attention Prototypical Networks for Few-Shot Text Classification
    Sun, Shengli
    Sun, Qingfeng
    Zhou, Kevin
    Lv, Tengchao
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 476 - 485
  • [35] Few-shot Text Classification Method Based on Feature Optimization
    Peng, Jing
    Huo, Shuquan
    JOURNAL OF WEB ENGINEERING, 2023, 22 (03): : 497 - 514
  • [36] Dynamic Memory Induction Networks for Few-Shot Text Classification
    Geng, Ruiying
    Li, Binhua
    Li, Yongbin
    Sun, Jian
    Zhu, Xiaodan
    58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 1087 - 1094
  • [37] Incremental Few-shot Text Classification with Multi-round New Classes: Formulation, Dataset and System
    Xia, Congying
    Yin, Wenpeng
    Feng, Yihao
    Yu, Philip
    2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), 2021, : 1351 - 1360
  • [38] More diversity, less redundancy: Feature refinement network for few-shot SAR image classification
    Wang, Ziqi
    Li, Yang
    Zhang, Rui
    Wang, Jiabao
    Cui, Haoran
    COMPUTERS & ELECTRICAL ENGINEERING, 2025, 123
  • [39] Confusable Learning for Large-Class Few-Shot Classification
    Li, Bingcong
    Han, Bo
    Wang, Zhuowei
    Jiang, Jing
    Long, Guodong
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2020, PT II, 2021, 12458 : 707 - 723
  • [40] Class feature Sub-space for few-shot classification
    Song, Bin
    Zhu, Hong
    Wang, Bingxin
    Bi, Yuandong
    APPLIED INTELLIGENCE, 2024, 54 (19) : 9177 - 9194