Calibrating CNNs for Few-Shot Meta Learning

被引:6
|
作者
Yang, Peng [1 ]
Ren, Shaogang [1 ]
Zhao, Yang [1 ]
Li, Ping [1 ]
机构
[1] Baidu Res, Cognit Comp Lab, 10900 NE 8th St, Bellevue, WA 98004 USA
关键词
D O I
10.1109/WACV51458.2022.00048
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although few-shot meta learning has been extensively studied in machine learning community, the fast adaptation towards new tasks remains a challenge in the few-shot learning scenario. The neuroscience research reveals that the capability of evolving neural network formulation is essential for task adaptation, which has been broadly studied in recent meta-learning researches. In this paper, we present a novel forward-backward meta-learning framework (FBM) to facilitate the model generalization in few-shot learning from a new perspective, i.e., neuron calibration. In particular, FBM models the neurons in deep neural network-based model as calibrated units under a general formulation, where neuron calibration could empower fast adaptation capability to the neural network-based models through influencing both their forward inference path and backward propagation path. The proposed calibration scheme is lightweight and applicable to various feed-forward neural network architectures. Extensive empirical experiments on the challenging few-shot learning benchmarks validate that our approach training with neuron calibration achieves a promising performance, which demonstrates that neuron calibration plays a vital role in improving the few-shot learning performance.
引用
收藏
页码:408 / 417
页数:10
相关论文
共 50 条
  • [31] Meta-Learning for Few-Shot Plant Disease Detection
    Chen, Liangzhe
    Cui, Xiaohui
    Li, Wei
    FOODS, 2021, 10 (10)
  • [32] Meta-Learning for Few-Shot Named Entity Recognition
    de Lichy, Cyprien
    Glaude, Hadrien
    Campbell, William
    1ST WORKSHOP ON META LEARNING AND ITS APPLICATIONS TO NATURAL LANGUAGE PROCESSING (METANLP 2021), 2021, : 44 - 58
  • [33] MetaFake: Few-shot Face Forgery Detection with Meta Learning
    Xu, Nanqing
    Feng, Weiwei
    PROCEEDINGS OF THE 2023 ACM WORKSHOP ON INFORMATION HIDING AND MULTIMEDIA SECURITY, IH&MMSEC 2023, 2023, : 151 - 156
  • [34] Few-Shot Directed Meta-Learning for Image Classification
    Ouyang, Jihong
    Duan, Ganghai
    Liu, Siguang
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (01)
  • [35] Meta-learning for few-shot time series forecasting
    Xiao, Feng
    Liu, Lu
    Han, Jiayu
    Guo, Degui
    Wang, Shang
    Cui, Hai
    Peng, Tao
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 43 (01) : 325 - 341
  • [36] FEW-SHOT ACOUSTIC EVENT DETECTION VIA META LEARNING
    Shi, Bowen
    Sun, Ming
    Puvvada, Krishna C.
    Kao, Chieh-Chi
    Matsoukas, Spyros
    Wang, Chao
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 76 - 80
  • [37] Meta Module Generation for Fast Few-Shot Incremental Learning
    Xie, Shudong
    Li, Yiqun
    Lin, Dongyun
    Nwe, Tin Lay
    Dong, Sheng
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 1381 - 1390
  • [38] Few-shot driver identification via meta-learning
    Lu, Lin
    Xiong, Shengwu
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 203
  • [39] Contrastive Meta-Learning for Few-shot Node Classification
    Wang, Song
    Tan, Zhen
    Liu, Huan
    Li, Jundong
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2386 - 2397
  • [40] Few-shot Edge Classification in Graph Meta-learning
    Yang, Xiaoxiao
    Xu, Jungang
    2022 IEEE 9TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2022, : 166 - 172