Automatic Metric Search for Few-Shot Learning

被引:2
|
作者
Zhou, Yuan [1 ]
Hao, Jieke [1 ]
Huo, Shuwei [1 ]
Wang, Boyu [2 ,3 ,4 ]
Ge, Leijiao [1 ]
Kung, Sun-Yuan [5 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Univ Western Ontario, Dept Comp Sci, London, ON N6A 5B7, Canada
[3] Univ Western Ontario, Brain Mind Inst, London, ON N6A 5B7, Canada
[4] Vector Inst, Toronto, ON, Canada
[5] Princeton Univ, Dept Elect Engn, Princeton, NJ 08540 USA
基金
中国国家自然科学基金;
关键词
Automated machine learning; few-shot learning (FSL); image classification; neural architecture search;
D O I
10.1109/TNNLS.2023.3238729
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning (FSL) aims to learn a model that can identify unseen classes using only a few training samples from each class. Most of the existing FSL methods adopt a manually predefined metric function to measure the relationship between a sample and a class, which usually require tremendous efforts and domain knowledge. In contrast, we propose a novel model called automatic metric search (Auto-MS), in which an Auto-MS space is designed for automatically searching task-specific metric functions. This allows us to further develop a new searching strategy to facilitate automated FSL. More specifically, by incorporating the episode-training mechanism into the bilevel search strategy, the proposed search strategy can effectively optimize the network weights and structural parameters of the few-shot model. Extensive experiments on the miniImageNet and tieredImageNet datasets demonstrate that the proposed Auto-MS achieves superior performance in FSL problems.
引用
收藏
页码:10098 / 10109
页数:12
相关论文
共 50 条
  • [31] Multi-level Metric Learning for Few-Shot Image Recognition
    Chen, Haoxing
    Li, Huaxiong
    Li, Yaohui
    Chen, Chunlin
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT I, 2022, 13529 : 243 - 254
  • [32] Transductive Episodic-Wise Adaptive Metric for Few-Shot Learning
    Qiao, Limeng
    Shi, Yemin
    Li, Jia
    Wang, Yaowei
    Huang, Tiejun
    Tian, Yonghong
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3602 - 3611
  • [33] LDAnet:a discriminant subspace for metric-based few-shot learning
    Chen, Dalei
    Liu, Bao-Di
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 1075 - 1080
  • [34] Coarse-to-fine few-shot classification with deep metric learning
    Li, Ping
    Zhao, Guopan
    Xu, Xianghua
    INFORMATION SCIENCES, 2022, 610 : 592 - 604
  • [35] Survey on Few-shot Learning
    Zhao K.-L.
    Jin X.-L.
    Wang Y.-Z.
    Ruan Jian Xue Bao/Journal of Software, 2021, 32 (02): : 349 - 369
  • [36] Variational Few-Shot Learning
    Zhang, Jian
    Zhao, Chenglong
    Ni, Bingbing
    Xu, Minghao
    Yang, Xiaokang
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 1685 - 1694
  • [37] Defensive Few-Shot Learning
    Li, Wenbin
    Wang, Lei
    Zhang, Xingxing
    Qi, Lei
    Huo, Jing
    Gao, Yang
    Luo, Jiebo
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 5649 - 5667
  • [38] Federated Few-shot Learning
    Wang, Song
    Fu, Xingbo
    Ding, Kaize
    Chen, Chen
    Chen, Huiyuan
    Li, Jundong
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2374 - 2385
  • [39] Fractal Few-Shot Learning
    Zhou, Fobao
    Huang, Wenkai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 35 (11) : 1 - 15
  • [40] Interventional Few-Shot Learning
    Yue, Zhongqi
    Zhang, Hanwang
    Sun, Qianru
    Hua, Xian-Sheng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33