Automatic Metric Search for Few-Shot Learning

被引:2
|
作者
Zhou, Yuan [1 ]
Hao, Jieke [1 ]
Huo, Shuwei [1 ]
Wang, Boyu [2 ,3 ,4 ]
Ge, Leijiao [1 ]
Kung, Sun-Yuan [5 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Univ Western Ontario, Dept Comp Sci, London, ON N6A 5B7, Canada
[3] Univ Western Ontario, Brain Mind Inst, London, ON N6A 5B7, Canada
[4] Vector Inst, Toronto, ON, Canada
[5] Princeton Univ, Dept Elect Engn, Princeton, NJ 08540 USA
基金
中国国家自然科学基金;
关键词
Automated machine learning; few-shot learning (FSL); image classification; neural architecture search;
D O I
10.1109/TNNLS.2023.3238729
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning (FSL) aims to learn a model that can identify unseen classes using only a few training samples from each class. Most of the existing FSL methods adopt a manually predefined metric function to measure the relationship between a sample and a class, which usually require tremendous efforts and domain knowledge. In contrast, we propose a novel model called automatic metric search (Auto-MS), in which an Auto-MS space is designed for automatically searching task-specific metric functions. This allows us to further develop a new searching strategy to facilitate automated FSL. More specifically, by incorporating the episode-training mechanism into the bilevel search strategy, the proposed search strategy can effectively optimize the network weights and structural parameters of the few-shot model. Extensive experiments on the miniImageNet and tieredImageNet datasets demonstrate that the proposed Auto-MS achieves superior performance in FSL problems.
引用
收藏
页码:10098 / 10109
页数:12
相关论文
共 50 条
  • [41] Few-Shot Lifelong Learning
    Mazumder, Pratik
    Singh, Pravendra
    Rai, Piyush
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2337 - 2345
  • [42] Few-shot Neural Architecture Search
    Zhao, Yiyang
    Wang, Linnan
    Tian, Yuandong
    Fonseca, Rodrigo
    Guo, Tian
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [43] Metric Based Few-Shot Graph Classification
    Crisostomi, Donato
    Antonelli, Simone
    Maiorca, Valentino
    Moschella, Luca
    Marin, Riccardo
    Rodola, Emanuele
    LEARNING ON GRAPHS CONFERENCE, VOL 198, 2022, 198
  • [44] Automatic pavement texture recognition using lightweight few-shot learning
    Pan, Shuo
    Yan, Hai
    Liu, Zhuo
    Chen, Ning
    Miao, Yinghao
    Hou, Yue
    PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2023, 381 (2254):
  • [45] Automatic Plant Counting and Location Based on a Few-Shot Learning Technique
    Karami, Azam
    Crawford, Melba
    Delp, Edward
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 5872 - 5886
  • [46] Meta Navigator: Search for a Good Adaptation Policy for Few-shot Learning
    Zhang, Chi
    Ding, Henghui
    Lin, Guosheng
    Li, Ruibo
    Wang, Changhu
    Shen, Chunhua
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9415 - 9424
  • [47] Task-specific method-agnostic metric for few-shot learning
    Wang, Heng
    Li, Yong
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (04): : 3115 - 3124
  • [48] Few-Shot Specific Emitter Identification via Deep Metric Ensemble Learning
    Wang, Yu
    Gui, Guan
    Lin, Yun
    Wu, Hsiao-Chun
    Yuen, Chau
    Adachi, Fumiyuki
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (24) : 24980 - 24994
  • [49] Task-specific method-agnostic metric for few-shot learning
    Heng Wang
    Yong Li
    Neural Computing and Applications, 2023, 35 : 3115 - 3124
  • [50] A Multiview Metric Learning Method for Few-Shot Fine-Grained Classification
    Miao, Zhuang
    Zhao, Xun
    Wang, Jiabao
    Xu, Bo
    Li, Yang
    Li, Hang
    IEEE ACCESS, 2022, 10 : 52782 - 52790