Meta-learning triplet contrast network for few-shot text classification

被引:0
|
作者
Dong, Kaifang [1 ]
Jiang, Baoxing [2 ]
Li, Hongye [1 ]
Zhu, Zhenfang [3 ]
Liu, Peiyu [1 ]
机构
[1] Shandong Normal Univ, Jinan 250358, Shandong, Peoples R China
[2] Sichuan Univ, Chengdu 610005, Sichuan, Peoples R China
[3] Shandong Jiaotong Univ, Jinan 250357, Shandong, Peoples R China
关键词
Few-shot learning; Text classification; Triplet network; Natural language processing;
D O I
10.1016/j.knosys.2024.112440
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot text classification (FSTC) strives to predict classes not involved in the training by learning from a few labeled examples. Currently, most tasks construct meta-tasks in a randomized manner that fails to give more priority to hard-to-identify classes and samples. Besides, some tasks incorporated a contrast strategy, but the sample could only be compared to positive or negative examples individually. In this work, we propose a Meta-learning Triplet Contrast Network (Meta-TCN) with bidirectional contrast capability to solve the above problem. Specifically, Meta-TCN uses external knowledge with labeled information as the class examples, which decouples the embedding of prototypes from the support pool. Meanwhile, the class examples combine the support samples to construct triplet pairs used for learning. Unlike previous studies, the model can learn negative and positive knowledge simultaneously, ensuring that understanding is enriched and enhances learning. Further, we improve the shortcomings of randomness in the meta-task construction process by proposing a Dynamic Rate of Change (DRC) sampling strategy. DRC enhances the model's focus on difficult-to- classify samples. We conducted extensive experiments on six benchmark datasets such as Huffpost and RCV1. Experiments show that the average accuracy of Meta-TCN can achieve state-of-the-art performance in the vast majority of tasks.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification
    Han, ChengCheng
    Fan, Zeqiu
    Zhang, Dongxiang
    Qiu, Minghui
    Gao, Ming
    Zhou, Aoying
    [J]. FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 1664 - 1673
  • [2] MEDA: Meta-Learning with Data Augmentation for Few-Shot Text Classification
    Sun, Pengfei
    Ouyang, Yawen
    Zhang, Wenming
    Dai, Xin-yu
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 3929 - 3935
  • [3] Fair Meta-Learning For Few-Shot Classification
    Zhao, Chen
    Li, Changbin
    Li, Jincheng
    Chen, Feng
    [J]. 11TH IEEE INTERNATIONAL CONFERENCE ON KNOWLEDGE GRAPH (ICKG 2020), 2020, : 275 - 282
  • [4] Dual adversarial network with meta-learning for domain-generalized few-shot text classification
    Wang, Xuyang
    Du, Yajun
    Chen, Danroujing
    Li, Xianyong
    Chen, Xiaoliang
    Fan, Yongquan
    Xie, Chunzhi
    Li, Yanli
    Liu, Jia
    Li, Hui
    [J]. APPLIED SOFT COMPUTING, 2023, 146
  • [5] Few-Shot Directed Meta-Learning for Image Classification
    Ouyang, Jihong
    Duan, Ganghai
    Liu, Siguang
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (01)
  • [6] Meta-Learning for Few-Shot Time Series Classification
    Narwariya, Jyoti
    Malhotra, Pankaj
    Vig, Lovekesh
    Shroff, Gautam
    Vishnu, T. V.
    [J]. PROCEEDINGS OF THE 7TH ACM IKDD CODS AND 25TH COMAD (CODS-COMAD 2020), 2020, : 28 - 36
  • [7] Unsupervised Meta-Learning for Few-Shot Image Classification
    Khodadadeh, Siavash
    Boloni, Ladislau
    Shah, Mubarak
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [8] Contrastive Meta-Learning for Few-shot Node Classification
    Wang, Song
    Tan, Zhen
    Liu, Huan
    Li, Jundong
    [J]. PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2386 - 2397
  • [9] Few-shot Edge Classification in Graph Meta-learning
    Yang, Xiaoxiao
    Xu, Jungang
    [J]. 2022 IEEE 9TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2022, : 166 - 172
  • [10] META-LEARNING FOR FEW-SHOT TIME SERIES CLASSIFICATION
    Wang, Sherrie
    Russwurm, Marc
    Koerner, Marco
    Lobell, David B.
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 7041 - 7044