Multi-granularity episodic contrastive learning for few-shot learning

被引:17
|
作者
Zhu, Pengfei [1 ,2 ]
Zhu, Zhilin [1 ]
Wang, Yu [1 ,2 ]
Zhang, Jinglin [3 ]
Zhao, Shuai [1 ,4 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[2] Haihe Lab Informat Technol Applicat Innovat, Tianjin, Peoples R China
[3] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[4] ICV Data Dept China Automot Data Co Ltd, Beijing, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Multi-granularity computing; Episodic contrastive learning; Few-shot learning; Deep learning;
D O I
10.1016/j.patcog.2022.108820
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning (FSL) aims at fast adaptation to novel classes with few training samples. Among FSL methods, meta-learning and transfer learning-based methods are the most powerful ones. However, most of them rely to some extent on cross-entropy loss, which leads to representations that are overly concerned with the classes already seen, and in turn leads to sub-optimal generalization on novel classes. In this study, we are inspired by meta-learning and transfer learning-based methods and believe good feature representations are vital for FSL. To this end, we propose a new multi-granularity episodic contrastive learning method (MGECL) that introduces contrastive learning into the episode training process. In particular, by enforcing our proposed contrastive loss on both class and instance granularities, the model is able to extract category-independent discriminative patterns and learn richer and more transferable feature representations. Extensive experiments demonstrate that our proposed method achieves state-of-the-art performance on three popular few-shot benchmarks. Our code is available at https://github.com/z1358/MGECL_PR. (C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Contrastive Decoder Generator for Few-Shot Learning in Product Quality Prediction
    Zhang, Donghao
    Liu, Zhenyu
    Jia, Weiqiang
    Liu, Hui
    Tan, Jianrong
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (12) : 11367 - 11379
  • [42] Few-shot disease recognition algorithm based on supervised contrastive learning
    Mu, Jiawei
    Feng, Quan
    Yang, Junqi
    Zhang, Jianhua
    Yang, Sen
    [J]. FRONTIERS IN PLANT SCIENCE, 2024, 15
  • [43] CLUR: Uncertainty Estimation for Few-Shot Text Classification with Contrastive Learning
    He, Jianfeng
    Zhang, Xuchao
    Lei, Shuo
    Alhamadani, Abdulaziz
    Chen, Fanglan
    Xiao, Bei
    Lu, Chang-Tien
    [J]. PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 698 - 710
  • [44] Defect Detection for Wear Debris Based on Few-Shot Contrastive Learning
    Li, Hang
    Li, Li
    Wang, Hongbing
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (23):
  • [45] Self-Attention Message Passing for Contrastive Few-Shot Learning
    Shirekar, Ojas Kishorkumar
    Singh, Anuj
    Jamali-Rad, Hadi
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 5415 - 5425
  • [46] Refined Prototypical Contrastive Learning for Few-Shot Hyperspectral Image Classification
    Liu, Quanyong
    Peng, Jiangtao
    Ning, Yujie
    Chen, Na
    Sun, Weiwei
    Du, Qian
    Zhou, Yicong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [47] Information-guided signal multi-granularity contrastive feature learning for fault diagnosis with few labeled data
    Lin, Yanzhuo
    Wang, Yu
    Zhang, Mingquan
    Wang, Zenghui
    Zhang, Haijun
    Zhao, Ming
    [J]. ADVANCED ENGINEERING INFORMATICS, 2024, 61
  • [48] Free-Lunch for Cross-Domain Few-Shot Learning: Style-Aware Episodic Training with Robust Contrastive Learning
    Zhang, Ji
    Song, Jingkuan
    Gao, Lianli
    Shen, Hengtao
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 2586 - 2594
  • [49] EMO: EPISODIC MEMORY OPTIMIZATION FOR FEW-SHOT META-LEARNING
    Du, Yingjun
    Shen, Jiayi
    Zhen, Xiantong
    Snoek, Cees G. M.
    [J]. CONFERENCE ON LIFELONG LEARNING AGENTS, VOL 232, 2023, 232 : 1 - 20
  • [50] Non-episodic Variational Weight Imprinting for Few-Shot Learning
    Padma V.
    Bhagvati C.
    [J]. SN Computer Science, 4 (3)