Multi-granularity episodic contrastive learning for few-shot learning

被引:17
|
作者
Zhu, Pengfei [1 ,2 ]
Zhu, Zhilin [1 ]
Wang, Yu [1 ,2 ]
Zhang, Jinglin [3 ]
Zhao, Shuai [1 ,4 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[2] Haihe Lab Informat Technol Applicat Innovat, Tianjin, Peoples R China
[3] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[4] ICV Data Dept China Automot Data Co Ltd, Beijing, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Multi-granularity computing; Episodic contrastive learning; Few-shot learning; Deep learning;
D O I
10.1016/j.patcog.2022.108820
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning (FSL) aims at fast adaptation to novel classes with few training samples. Among FSL methods, meta-learning and transfer learning-based methods are the most powerful ones. However, most of them rely to some extent on cross-entropy loss, which leads to representations that are overly concerned with the classes already seen, and in turn leads to sub-optimal generalization on novel classes. In this study, we are inspired by meta-learning and transfer learning-based methods and believe good feature representations are vital for FSL. To this end, we propose a new multi-granularity episodic contrastive learning method (MGECL) that introduces contrastive learning into the episode training process. In particular, by enforcing our proposed contrastive loss on both class and instance granularities, the model is able to extract category-independent discriminative patterns and learn richer and more transferable feature representations. Extensive experiments demonstrate that our proposed method achieves state-of-the-art performance on three popular few-shot benchmarks. Our code is available at https://github.com/z1358/MGECL_PR. (C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Improving Stock Trend Prediction with Multi-granularity Denoising Contrastive Learning
    Wang, Mingjie
    Chen, Feng
    Guo, Jianxiong
    Jia, Weijia
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [32] Few-Shot Few-Shot Learning and the role of Spatial Attention
    Lifchitz, Yann
    Avrithis, Yannis
    Picard, Sylvaine
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2693 - 2700
  • [33] Few-Shot Object Detection via Transfer Learning and Contrastive Reweighting
    Wu, Zhen
    Li, Haowei
    Zhang, Dongyu
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VII, 2023, 14260 : 78 - 87
  • [34] A Proposal-Improved Few-Shot Embedding Model with Contrastive Learning
    Gong, Fucai
    Xie, Yuchen
    Jiang, Le
    Chen, Keming
    Liu, Yunxin
    Ye, Xiaozhou
    Ouyang, Ye
    [J]. MULTIMEDIA MODELING, MMM 2023, PT II, 2023, 13834 : 202 - 214
  • [35] CONTAINER: Few-Shot Named Entity Recognition via Contrastive Learning
    Das, Sarkar Snigdha Sarathi
    Katiyar, Arzoo
    Passonneau, Rebecca J.
    Zhang, Rui
    [J]. PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 6338 - 6353
  • [36] CPCL: Conceptual prototypical contrastive learning for Few-Shot text classification
    Cheng, Tao
    Cheng, Hua
    Fang, Yiquan
    Liu, Yufei
    Gao, Caiting
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (06) : 11963 - 11975
  • [37] Contrastive Learning for Prompt-Based Few-Shot Language Learners
    Jian, Yiren
    Gao, Chongyang
    Vosoughi, Soroush
    [J]. NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 5577 - 5587
  • [38] Evaluating few-shot and contrastive learning methods for code clone detection
    The University of British Columbia Okanagan, Kelowna, Canada
    [J]. Empir Software Eng, 6
  • [39] Domain consensual contrastive learning for few-shot universal domain adaptation
    Liao, Haojin
    Wang, Qiang
    Zhao, Sicheng
    Xing, Tengfei
    Hu, Runbo
    [J]. APPLIED INTELLIGENCE, 2023, 53 (22) : 27191 - 27206
  • [40] Domain consensual contrastive learning for few-shot universal domain adaptation
    Haojin Liao
    Qiang Wang
    Sicheng Zhao
    Tengfei Xing
    Runbo Hu
    [J]. Applied Intelligence, 2023, 53 : 27191 - 27206