Multi-granularity episodic contrastive learning for few-shot learning

被引:17
|
作者
Zhu, Pengfei [1 ,2 ]
Zhu, Zhilin [1 ]
Wang, Yu [1 ,2 ]
Zhang, Jinglin [3 ]
Zhao, Shuai [1 ,4 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[2] Haihe Lab Informat Technol Applicat Innovat, Tianjin, Peoples R China
[3] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[4] ICV Data Dept China Automot Data Co Ltd, Beijing, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Multi-granularity computing; Episodic contrastive learning; Few-shot learning; Deep learning;
D O I
10.1016/j.patcog.2022.108820
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning (FSL) aims at fast adaptation to novel classes with few training samples. Among FSL methods, meta-learning and transfer learning-based methods are the most powerful ones. However, most of them rely to some extent on cross-entropy loss, which leads to representations that are overly concerned with the classes already seen, and in turn leads to sub-optimal generalization on novel classes. In this study, we are inspired by meta-learning and transfer learning-based methods and believe good feature representations are vital for FSL. To this end, we propose a new multi-granularity episodic contrastive learning method (MGECL) that introduces contrastive learning into the episode training process. In particular, by enforcing our proposed contrastive loss on both class and instance granularities, the model is able to extract category-independent discriminative patterns and learn richer and more transferable feature representations. Extensive experiments demonstrate that our proposed method achieves state-of-the-art performance on three popular few-shot benchmarks. Our code is available at https://github.com/z1358/MGECL_PR. (C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Few-Shot Learning With Multi-Granularity Knowledge Fusion and Decision-Making
    Su, Yuling
    Zhao, Hong
    Zheng, Yifeng
    Wang, Yu
    [J]. IEEE TRANSACTIONS ON BIG DATA, 2024, 10 (04) : 486 - 497
  • [2] Many-Class Few-Shot Learning on Multi-Granularity Class Hierarchy
    Liu, Lu
    Zhou, Tianyi
    Long, Guodong
    Jiang, Jing
    Zhang, Chengqi
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (05) : 2293 - 2305
  • [3] Few-shot learning based on hierarchical classification via multi-granularity relation networks
    Su, Yuling
    Zhao, Hong
    Lin, Yaojin
    [J]. INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2022, 142 : 417 - 429
  • [4] Few-Shot Classification with Contrastive Learning
    Yang, Zhanyuan
    Wang, Jinghua
    Zhu, Yingying
    [J]. COMPUTER VISION, ECCV 2022, PT XX, 2022, 13680 : 293 - 309
  • [5] Learning a Few-shot Embedding Model with Contrastive Learning
    Liu, Chen
    Fu, Yanwei
    Xu, Chengming
    Yang, Siqian
    Li, Jilin
    Wang, Chengjie
    Zhang, Li
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 8635 - 8643
  • [6] Augmenting Few-Shot Learning With Supervised Contrastive Learning
    Lee, Taemin
    Yoo, Sungjoo
    [J]. IEEE ACCESS, 2021, 9 : 61466 - 61474
  • [7] Bi-Granularity Contrastive Learning for Post-Training in Few-Shot Scene
    Luo, Ruikun
    Huang, Guanhuan
    Quan, Xiaojun
    [J]. FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 1733 - 1742
  • [8] Diversified Contrastive Learning For Few-Shot Classification
    Lu, Guangtong
    Li, Fanzhang
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT I, 2023, 14254 : 147 - 158
  • [9] Interpretable Few-Shot Learning with Contrastive Constraint
    Zhang, Lingling
    Chen, Yiwei
    Wu, Wenjun
    Wei, Bifan
    Luo, Xuan
    Chang, Xiaojun
    Liu, Jun
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (12): : 2573 - 2584
  • [10] Spatial Contrastive Learning for Few-Shot Classification
    Ouali, Yassine
    Hudelot, Celine
    Tami, Myriam
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, 2021, 12975 : 671 - 686