Improving Augmentation Efficiency for Few-Shot Learning

被引:1
|
作者
Cho, Wonhee [1 ]
Kim, Eunwoo [1 ]
机构
[1] Chung Ang Univ, Sch Comp Sci & Engn, Seoul 06974, South Korea
基金
新加坡国家研究基金会;
关键词
Task analysis; Training; Deep learning; Measurement; Benchmark testing; Training data; Prototypes; Few-shot learning; automatic search; efficient augmentation;
D O I
10.1109/ACCESS.2022.3151057
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
While human intelligence can easily recognize some characteristics of classes with one or few examples, learning from few examples is a challenging task in machine learning. Recently emerging deep learning generally requires hundreds of thousands of samples to achieve generalization ability. Despite recent advances in deep learning, it is not easy to generalize new classes with little supervision. Few-shot learning (FSL) aims to learn how to recognize new classes with few examples per class. However, learning with few examples makes the model difficult to generalize and is susceptible to overfitting. To overcome the difficulty, data augmentation techniques have been applied to FSL. It is well-known that existing data augmentation approaches rely heavily on human experts with prior knowledge to find effective augmentation strategies manually. In this work, we propose an efficient data augmentation network, called EDANet, to automatically select the most effective augmentation approaches to achieve optimal performance of FSL without human intervention. Our method overcomes the disadvantages of relying on domain knowledge and requiring expensive labor to design data augmentation rules manually. We demonstrate the proposed approach on widely used FSL benchmarks (Omniglot and mini-ImageNet). The experimental results using three popular FSL networks indicate that the proposed approach improves performance over existing baselines through an optimal combination of candidate augmentation strategies.
引用
收藏
页码:17697 / 17706
页数:10
相关论文
共 50 条
  • [1] Few-shot learning through contextual data augmentation
    Arthaud, Farid
    Bawden, Rachel
    Birch, Alexandra
    [J]. 16TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2021), 2021, : 1049 - 1062
  • [2] Few-Shot Learning Based on Metric Learning Using Class Augmentation
    Matsumi, Susumu
    Yamada, Keiichi
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 196 - 201
  • [3] PatchMix Augmentation to Identify Causal Features in Few-Shot Learning
    Xu, Chengming
    Liu, Chen
    Sun, Xinwei
    Yang, Siqian
    Wang, Yabiao
    Wang, Chengjie
    Fu, Yanwei
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (06) : 7639 - 7653
  • [4] Few-Shot Learning With Enhancements to Data Augmentation and Feature Extraction
    Zhang, Yourun
    Gong, Maoguo
    Li, Jianzhao
    Feng, Kaiyuan
    Zhang, Mingyang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [5] A Multitask Latent Feature Augmentation Method for Few-Shot Learning
    Xu, Jian
    Liu, Bo
    Xiao, Yanshan
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (05) : 6976 - 6990
  • [6] FlipDA: Effective and Robust Data Augmentation for Few-Shot Learning
    Zhou, Jing
    Zheng, Yanan
    Tang, Jie
    Li, Jian
    Yang, Zhilin
    [J]. PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 8646 - 8665
  • [7] Few-Shot Few-Shot Learning and the role of Spatial Attention
    Lifchitz, Yann
    Avrithis, Yannis
    Picard, Sylvaine
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2693 - 2700
  • [8] Binocular Mutual Learning for Improving Few-shot Classification
    Zhou, Ziqi
    Qiu, Xi
    Xie, Jiangtao
    Wu, Jianan
    Zhang, Chi
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8382 - 8391
  • [9] A Dropout Style Model Augmentation for Cross Domain Few-Shot Learning
    Tu, Pei-Cheng
    Pao, Hsing-Kuo
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 1138 - 1147
  • [10] Few-Shot Learning with Part Discovery and Augmentation from Unlabeled Images
    Chen, Wentao
    Si, Chenyang
    Wang, Wei
    Wang, Liang
    Wang, Zilei
    Tan, Tieniu
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 2271 - 2277