Unsupervised meta-learning for few-shot learning

被引:45
|
作者
Xu, Hui [1 ]
Wang, Jiaxing [2 ]
Li, Hao [1 ]
Ouyang, Deqiang [1 ]
Shao, Jie [1 ,3 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Ctr Future Media, Chengdu 611731, Peoples R China
[2] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
[3] Sichuan Artificial Intelligence Res Inst, Yibin 644000, Peoples R China
基金
中国国家自然科学基金;
关键词
Unsupervised learning; Meta-learning; Few-shot learning; ADAPTATION;
D O I
10.1016/j.patcog.2021.107951
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Meta-learning is an effective tool to address the few-shot learning problem, which requires new data to be classified considering only a few training examples. However, when used for classification, it requires large labeled datasets, which are not always available in practice. In this paper, we propose an unsupervised meta-learning algorithm that learns from an unlabeled dataset and adapts to downstream human specific tasks with few labeled data. The proposed algorithm constructs tasks using clustering embedding methods and data augmentation functions to satisfy two critical class distinction requirements. To alleviate the biases and the weak diversity problem introduced by data augmentation functions, the proposed algorithm uses two methods, which are shifting the feeding data between the inner-outer loops and a novel data augmentation function. We further provide theoretical analysis of the effect of augmentation data in the inner/outer loop. Experiments on the MiniImagenet and Omniglot datasets demonstrate that the proposed unsupervised meta-learning approach outperforms other tested unsupervised representation learning approaches and two recent unsupervised meta-learning baselines. Compared with supervised meta-learning approaches, certain results produced by our method are quite close to those produced by such methods trained on the human-designed labeled tasks. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Unsupervised Meta-Learning for Few-Shot Image Classification
    Khodadadeh, Siavash
    Boloni, Ladislau
    Shah, Mubarak
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [2] Revisiting Unsupervised Meta-Learning via the Characteristics of Few-Shot Tasks
    Ye, Han-Jia
    Han, Lu
    Zhan, De-Chuan
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) : 3721 - 3737
  • [3] Task Agnostic Meta-Learning for Few-Shot Learning
    Jamal, Muhammad Abdullah
    Qi, Guo-Jun
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11711 - 11719
  • [4] META-LEARNING WITH ATTENTION FOR IMPROVED FEW-SHOT LEARNING
    Hou, Zejiang
    Walid, Anwar
    Kung, Sun-Yuan
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2725 - 2729
  • [5] Meta-Learning for Few-Shot NMT Adaptation
    Sharaf, Amr
    Hassan, Hany
    Daume, Hal, III
    [J]. NEURAL GENERATION AND TRANSLATION, 2020, : 43 - 53
  • [6] Fair Meta-Learning For Few-Shot Classification
    Zhao, Chen
    Li, Changbin
    Li, Jincheng
    Chen, Feng
    [J]. 11TH IEEE INTERNATIONAL CONFERENCE ON KNOWLEDGE GRAPH (ICKG 2020), 2020, : 275 - 282
  • [7] Unsupervised descriptor selection based meta-learning networks for few-shot classification
    Hu, Zhengping
    Li, Zijun
    Wang, Xueyu
    Zheng, Saiyue
    [J]. PATTERN RECOGNITION, 2022, 122
  • [8] MetaDiff: Meta-Learning with Conditional Diffusion for Few-Shot Learning
    Zhang, Baoquan
    Luo, Chuyao
    Yu, Demin
    Li, Xutao
    Lin, Huiwei
    Ye, Yunming
    Zhang, Bowen
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16687 - 16695
  • [9] Stress Testing of Meta-learning Approaches for Few-shot Learning
    Aimen, Aroof
    Sidheekh, Sahil
    Madan, Vineet
    Krishnan, Narayanan C.
    [J]. AAAI WORKSHOP ON META-LEARNING AND METADL CHALLENGE, VOL 140, 2021, 140 : 38 - 44
  • [10] Adversarially Robust Few-Shot Learning: A Meta-Learning Approach
    Goldblum, Micah
    Fowl, Liam
    Goldstein, Tom
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS (NEURIPS 2020), 2020, 33