MetaCL: a semi-supervised meta learning architecture via contrastive learning

被引:1
|
作者
Li, Chengyang [1 ,2 ]
Xie, Yongqiang [2 ]
Li, Zhongbo [2 ]
Zhu, Liping [3 ]
机构
[1] PKU, Sch Comp Sci, Beijing, Peoples R China
[2] AMS, Inst Syst Engn, Beijing, Peoples R China
[3] CUP Beijing, Beijing Key Lab Petr Data Min, Beijing, Peoples R China
关键词
Meta learning; Few-shot learning; Contrastive learning; Semi-supervised learning; Image classification;
D O I
10.1007/s13042-023-01904-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Meta learning aims to endow models with the ability to quickly learn new tasks based on existing knowledge. However, recent works have relied on complex structures and prior information to improve performance on few-shot tasks. To this end, we propose MetaCL, a meta learning architecture that uses only a traditional backbone without any priors. MetaCL takes distorted versions of an episode of samples as input and outputs predictions respectively. Besides, we introduce an unsupervised loss to minimize component redundancy and maximize variability, achieving soft-whitening and soft-alignment constraints. We evaluate MetaCL on few-shot tasks of image classification datasets CUB and miniImageNet, and experimetal results proves that MetaCL outperforms other meta-learning methods. MetaCL can be treated as a simple yet effective baseline and also be easily integrated into other few-shot models for additional performance gains.
引用
收藏
页码:227 / 236
页数:10
相关论文
共 50 条
  • [1] MetaCL: a semi-supervised meta learning architecture via contrastive learning
    Chengyang Li
    Yongqiang Xie
    Zhongbo Li
    Liping Zhu
    [J]. International Journal of Machine Learning and Cybernetics, 2024, 15 : 227 - 236
  • [2] CONTRASTIVE SEMI-SUPERVISED LEARNING FOR ASR
    Xiao, Alex
    Fuegen, Christian
    Mohamed, Abdelrahman
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 3870 - 3874
  • [3] Contrastive Regularization for Semi-Supervised Learning
    Lee, Doyup
    Kim, Sungwoong
    Kim, Ildoo
    Cheon, Yeongjae
    Cho, Minsu
    Han, Wook-Shin
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 3910 - 3919
  • [4] Semi-supervised Semantic Segmentation via Prototypical Contrastive Learning
    Chen, Zenggui
    Lian, Zhouhui
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6696 - 6705
  • [5] A Probabilistic Contrastive Framework for Semi-Supervised Learning
    Lin, Huibin
    Zhang, Chun-Yang
    Wang, Shiping
    Guo, Wenzhong
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8767 - 8779
  • [6] CONTRASTIVE LEARNING FOR ONLINE SEMI-SUPERVISED GENERAL CONTINUAL LEARNING
    Michel, Nicolas
    Negrel, Romain
    Chierchia, Giovanni
    Bercher, Jean-Francois
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1896 - 1900
  • [7] Semi-supervised Domain Adaptation via Joint Contrastive Learning with Sensitivity
    Tu, Keyu
    Wang, Zilei
    Li, Junjie
    Zhang, Yixin
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 5645 - 5654
  • [8] NCMatch: Semi-supervised Learning with Noisy Labels via Noisy Sample Filter and Contrastive Learning
    Sun, Yuanbo
    Gao, Can
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT VIII, 2024, 14432 : 15 - 27
  • [9] Semi-supervised vanishing point detection with contrastive learning
    Wang, Yukun
    Gu, Shuo
    Liu, Yinbo
    Kong, Hui
    [J]. PATTERN RECOGNITION, 2024, 153
  • [10] Contrastive Credibility Propagation for Reliable Semi-supervised Learning
    Kutt, Brody
    Ramteke, Pralay
    Mignot, Xavier
    Toman, Pamela
    Ramanan, Nandini
    Chhetri, Sujit Rokka
    Huang, Shan
    Du, Min
    Hewlett, William
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 19, 2024, : 21294 - 21303