Task-aware prototype refinement for improved few-shot learning

被引:1
|
作者
Zhang, Wei [1 ]
Gu, Xiaodong [1 ]
机构
[1] Fudan Univ, Dept Elect Engn, Shanghai 200438, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 35卷 / 24期
基金
中国国家自然科学基金;
关键词
Few-shot learning; Task embedding; Prototype rectification; Metric learning;
D O I
10.1007/s00521-023-08645-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In realistic scenarios, few-shot classification aims to generalize from common classes to novel classes with limited labeled samples. Most of existing transductive methods concentrate on probing into instance-prototype relations in a fixed way, without considering task-relevant information. In this paper, we perform task-aware prototype refinement (TAPR) explicitly for metric-based few-shot learning. Instead of utilizing fixed prior of queries, we adaptively estimate the query distribution, which can accommodate to both balanced and imbalanced situations. Concretely, on the basis of discriminative features from a holistic pre-training and pre-processing stage, we make novel attempts to make the best of task-aware and instance-aware knowledge to conduct selecting and denoising of samples for prototype generation and iterative rectification, which are complementary to each other. Extensive experimental results on four popular benchmark datasets (CUB, CIFAR-FS, miniImageNet and tieredImageNet) demonstrate that our TAPR outperforms most methods in inductive and balanced transductive settings. Besides, it achieves good generalization while maintaining high accuracy in the imbalanced and cross-domain setting.
引用
收藏
页码:17899 / 17913
页数:15
相关论文
共 50 条
  • [31] WPE: Weighted prototype estimation for few-shot learning
    Cao, Jiangzhong
    Yao, Zijie
    Yu, Lianggeng
    Ling, Bingo Wing-Kuen
    [J]. IMAGE AND VISION COMPUTING, 2023, 137
  • [32] Adaptive Prototype Learning and Allocation for Few-Shot Segmentation
    Li, Gen
    Jampani, Varun
    Sevilla-Lara, Laura
    Sun, Deqing
    Kim, Jonghyun
    Kim, Joongkyu
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8330 - 8339
  • [33] Hierarchical Prototype Refinement With Progressive Inter-Categorical Discrimination Maximization for Few-Shot Learning
    Zhou, Yuan
    Guo, Yanrong
    Hao, Shijie
    Hong, Richang
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 3414 - 3429
  • [34] Distributed few-shot learning with prototype distribution correction
    Zhiling Fu
    Dongfang Tang
    Pingchuan Ma
    Zhe Wang
    Wen Gao
    [J]. Applied Intelligence, 2023, 53 : 30552 - 30565
  • [35] Transductive Few-shot Learning with Prototype-based Label Propagation by Iterative Graph Refinement
    Zhu, Hao
    Koniusz, Piotr
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 23996 - 24006
  • [36] NOISE SUPPRESSION FOR IMPROVED FEW-SHOT LEARNING
    Chen, Zhikui
    Ji, Tiandong
    Zhang, Suhua
    Zhong, Fangming
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1900 - 1904
  • [37] Object-Aware Attention in Few-Shot Learning
    Shen, Yeqing
    Mo, Lisha
    Ma, Huimin
    Hu, Tianyu
    Dong, Yuhan
    [J]. IMAGE AND GRAPHICS TECHNOLOGIES AND APPLICATIONS, IGTA 2021, 2021, 1480 : 95 - 108
  • [38] Superclass-aware network for few-shot learning
    Wu, Shuang
    Kankanhalli, Mohan
    Tung, Anthony K. H.
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 216
  • [39] Task-Equivariant Graph Few-shot Learning
    Kim, Sungwon
    Lee, Junseok
    Lee, Namkyeong
    Kim, Wonjoong
    Choi, Seungyoon
    Park, Chanyoung
    [J]. PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 1120 - 1131
  • [40] DETA: Denoised Task Adaptation for Few-Shot Learning
    Zhang, Ji
    Gao, Lianli
    Luo, Xu
    Shen, Hengtao
    Song, Jingkuan
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 11507 - 11517