Multi-granularity episodic contrastive learning for few-shot learning

被引:17
|
作者
Zhu, Pengfei [1 ,2 ]
Zhu, Zhilin [1 ]
Wang, Yu [1 ,2 ]
Zhang, Jinglin [3 ]
Zhao, Shuai [1 ,4 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[2] Haihe Lab Informat Technol Applicat Innovat, Tianjin, Peoples R China
[3] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[4] ICV Data Dept China Automot Data Co Ltd, Beijing, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Multi-granularity computing; Episodic contrastive learning; Few-shot learning; Deep learning;
D O I
10.1016/j.patcog.2022.108820
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning (FSL) aims at fast adaptation to novel classes with few training samples. Among FSL methods, meta-learning and transfer learning-based methods are the most powerful ones. However, most of them rely to some extent on cross-entropy loss, which leads to representations that are overly concerned with the classes already seen, and in turn leads to sub-optimal generalization on novel classes. In this study, we are inspired by meta-learning and transfer learning-based methods and believe good feature representations are vital for FSL. To this end, we propose a new multi-granularity episodic contrastive learning method (MGECL) that introduces contrastive learning into the episode training process. In particular, by enforcing our proposed contrastive loss on both class and instance granularities, the model is able to extract category-independent discriminative patterns and learn richer and more transferable feature representations. Extensive experiments demonstrate that our proposed method achieves state-of-the-art performance on three popular few-shot benchmarks. Our code is available at https://github.com/z1358/MGECL_PR. (C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] CLG: Contrastive Label Generation with Knowledge for Few-Shot Learning
    Ma, Han
    Fan, Baoyu
    Ng, Benjamin K.
    Lam, Chan-Tong
    [J]. MATHEMATICS, 2024, 12 (03)
  • [22] ContrastNet: A Contrastive Learning Framework for Few-Shot Text Classification
    Chen, Junfan
    Zhang, Richong
    Mao, Yongyi
    Xu, Jie
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 10492 - 10500
  • [23] Few-Shot Action Recognition with Hierarchical Matching and Contrastive Learning
    Zheng, Sipeng
    Chen, Shizhe
    Jin, Qin
    [J]. COMPUTER VISION - ECCV 2022, PT IV, 2022, 13664 : 297 - 313
  • [24] Unsupervised contrastive learning for few-shot TOC prediction and application
    Wang, Huijun
    Lu, Shuangfang
    Qiao, Lu
    Chen, Fangwen
    He, Xipeng
    Gao, Yuqiao
    Mei, Junwei
    [J]. INTERNATIONAL JOURNAL OF COAL GEOLOGY, 2022, 259
  • [25] Boosting Few-Shot Classification with Lie Group Contrastive Learning
    He, Feihong
    Li, Fanzhang
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT I, 2023, 14254 : 99 - 111
  • [26] VISUAL TEMPO CONTRASTIVE LEARNING FOR FEW-SHOT ACTION RECOGNITION
    Wang, Guangge
    Ye, Weirong
    Wang, Xiao
    Jin, Rongrong
    Wang, Hanzi
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1096 - 1100
  • [27] Supervised Graph Contrastive Learning for Few-Shot Node Classification
    Tan, Zhen
    Ding, Kaize
    Guo, Ruocheng
    Liu, Huan
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT II, 2023, 13714 : 394 - 411
  • [28] Contrastive Meta-Learning for Few-shot Node Classification
    Wang, Song
    Tan, Zhen
    Liu, Huan
    Li, Jundong
    [J]. PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2386 - 2397
  • [29] Few-Shot Learning for Misinformation Detection Based on Contrastive Models
    Zheng, Peng
    Chen, Hao
    Hu, Shu
    Zhu, Bin
    Hu, Jinrong
    Lin, Ching-Sheng
    Wu, Xi
    Lyu, Siwei
    Huang, Guo
    Wang, Xin
    [J]. ELECTRONICS, 2024, 13 (04)
  • [30] Multi-Scale Metric Learning for Few-Shot Learning
    Jiang, Wen
    Huang, Kai
    Geng, Jie
    Deng, Xinyang
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (03) : 1091 - 1102