MetaCL: a semi-supervised meta learning architecture via contrastive learning

被引:1
|
作者
Li, Chengyang [1 ,2 ]
Xie, Yongqiang [2 ]
Li, Zhongbo [2 ]
Zhu, Liping [3 ]
机构
[1] PKU, Sch Comp Sci, Beijing, Peoples R China
[2] AMS, Inst Syst Engn, Beijing, Peoples R China
[3] CUP Beijing, Beijing Key Lab Petr Data Min, Beijing, Peoples R China
关键词
Meta learning; Few-shot learning; Contrastive learning; Semi-supervised learning; Image classification;
D O I
10.1007/s13042-023-01904-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Meta learning aims to endow models with the ability to quickly learn new tasks based on existing knowledge. However, recent works have relied on complex structures and prior information to improve performance on few-shot tasks. To this end, we propose MetaCL, a meta learning architecture that uses only a traditional backbone without any priors. MetaCL takes distorted versions of an episode of samples as input and outputs predictions respectively. Besides, we introduce an unsupervised loss to minimize component redundancy and maximize variability, achieving soft-whitening and soft-alignment constraints. We evaluate MetaCL on few-shot tasks of image classification datasets CUB and miniImageNet, and experimetal results proves that MetaCL outperforms other meta-learning methods. MetaCL can be treated as a simple yet effective baseline and also be easily integrated into other few-shot models for additional performance gains.
引用
收藏
页码:227 / 236
页数:10
相关论文
共 50 条
  • [31] Semi-Supervised Graph Contrastive Learning With Virtual Adversarial Augmentation
    Dong, Yixiang
    Luo, Minnan
    Li, Jundong
    Liu, Ziqi
    Zheng, Qinghua
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (08) : 4232 - 4244
  • [32] Continual semi-supervised learning through contrastive interpolation consistency
    Boschini, Matteo
    Buzzega, Pietro
    Bonicelli, Lorenzo
    Porrello, Angelo
    Calderara, Simone
    [J]. PATTERN RECOGNITION LETTERS, 2022, 162 : 9 - 14
  • [33] HyperMatch: Noise-Tolerant Semi-Supervised Learning via Relaxed Contrastive Constraint
    Zhou, Beitong
    Lu, Jing
    Liu, Kerui
    Xu, Yunlu
    Cheng, Zhanzhan
    Niu, Yi
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 24017 - 24026
  • [34] Semi-Supervised Contrastive Learning With Similarity Co-Calibration
    Zhang, Yuhang
    Zhang, Xiaopeng
    Li, Jie
    Qiu, Robert C.
    Xu, Haohang
    Tian, Qi
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1749 - 1759
  • [35] Semi-Supervised Group Emotion Recognition Based on Contrastive Learning
    Zhang, Jiayi
    Wang, Xingzhi
    Zhang, Dong
    Lee, Dah-Jye
    [J]. ELECTRONICS, 2022, 11 (23)
  • [36] Semi-Supervised Contrastive Learning for Time Series Classification in Healthcare
    Liu, Xiaofeng
    Liu, Zhihong
    Li, Jie
    Zhang, Xiang
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024,
  • [37] A Semi-supervised Classification Method of Parasites Using Contrastive Learning
    Ren, Yanni
    Jiang, Hao
    Zhu, Huilin
    Tian, Yanling
    Hu, Jinglu
    [J]. IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2022, 17 (03) : 445 - 453
  • [38] Semi-supervised medical image segmentation via hard positives oriented contrastive learning
    Tang, Cheng
    Zeng, Xinyi
    Zhou, Luping
    Zhou, Qizheng
    Wang, Peng
    Wu, Xi
    Ren, Hongping
    Zhou, Jiliu
    Wang, Yan
    [J]. PATTERN RECOGNITION, 2024, 146
  • [39] Semi-supervised CT image segmentation via contrastive learning based on entropy constraints
    Xiao, Zhiyong
    Sun, Hao
    Liu, Fei
    [J]. BIOMEDICAL ENGINEERING LETTERS, 2024, 14 (05) : 1023 - 1035
  • [40] Semi-Supervised Meta-Learning via Self-Training
    Zhou, Meng
    Li, Yaoyi
    Lu, Hongtao
    Cai Nengbin
    Zhao Xuejun
    [J]. 2020 THE 3RD INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS'2020), 2020, : 1 - 7