Task-aware prototype refinement for improved few-shot learning

被引:1
|
作者
Zhang, Wei [1 ]
Gu, Xiaodong [1 ]
机构
[1] Fudan Univ, Dept Elect Engn, Shanghai 200438, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 35卷 / 24期
基金
中国国家自然科学基金;
关键词
Few-shot learning; Task embedding; Prototype rectification; Metric learning;
D O I
10.1007/s00521-023-08645-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In realistic scenarios, few-shot classification aims to generalize from common classes to novel classes with limited labeled samples. Most of existing transductive methods concentrate on probing into instance-prototype relations in a fixed way, without considering task-relevant information. In this paper, we perform task-aware prototype refinement (TAPR) explicitly for metric-based few-shot learning. Instead of utilizing fixed prior of queries, we adaptively estimate the query distribution, which can accommodate to both balanced and imbalanced situations. Concretely, on the basis of discriminative features from a holistic pre-training and pre-processing stage, we make novel attempts to make the best of task-aware and instance-aware knowledge to conduct selecting and denoising of samples for prototype generation and iterative rectification, which are complementary to each other. Extensive experimental results on four popular benchmark datasets (CUB, CIFAR-FS, miniImageNet and tieredImageNet) demonstrate that our TAPR outperforms most methods in inductive and balanced transductive settings. Besides, it achieves good generalization while maintaining high accuracy in the imbalanced and cross-domain setting.
引用
收藏
页码:17899 / 17913
页数:15
相关论文
共 50 条
  • [1] Task-aware prototype refinement for improved few-shot learning
    Wei Zhang
    Xiaodong Gu
    [J]. Neural Computing and Applications, 2023, 35 : 17899 - 17913
  • [2] Learning Task-aware Local Representations for Few-shot Learning
    Dong, Chuanqi
    Li, Wenbin
    Huo, Jing
    Gu, Zheng
    Gao, Yang
    [J]. PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 716 - 722
  • [3] Task-aware Part Mining Network for Few-Shot Learning
    Wu, Jiamin
    Zhang, Tianzhu
    Zhang, Yongdong
    Wu, Feng
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8413 - 8422
  • [4] Learning Instance and Task-Aware Dynamic Kernels for Few-Shot Learning
    Ma, Rongkai
    Fang, Pengfei
    Avraham, Gil
    Zuo, Yan
    Zhu, Tianyu
    Drummond, Tom
    Harandi, Mehrtash
    [J]. COMPUTER VISION, ECCV 2022, PT XX, 2022, 13680 : 257 - 274
  • [5] Task-aware Adaptive Learning for Cross-domain Few-shot Learning
    Guo, Yurong
    Du, Ruoyi
    Dong, Yuan
    Hospedales, Timothy
    Song, Yi-Zhe
    Ma, Zhanyu
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 1590 - 1599
  • [6] Task-aware adaptive attention learning for few-shot semantic segmentation
    Mao, Binjie
    Wang, Lingfeng
    Xiang, Shiming
    Pan, Chunhong
    [J]. NEUROCOMPUTING, 2022, 494 : 104 - 115
  • [7] TASK-AWARE FEW-SHOT VISUAL CLASSIFICATION WITH IMPROVED SELF-SUPERVISED METRIC LEARNING
    Cheng, Chia-Sheng
    Shao, Hao-Chiang
    Lin, Chia-Wen
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 3531 - 3535
  • [8] Few-Shot Learning via Task-Aware Discriminant Local Descriptors Network
    Yan, Leilei
    Li, Fanzhang
    Zheng, Xiaohan
    Zhang, Li
    [J]. PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 2887 - 2894
  • [9] Task-Aware Feature Composition for Few-Shot Relation Classification
    Deng, Sinuo
    Shi, Ge
    Feng, Chong
    Wang, Yashen
    Liao, Lejian
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (07):
  • [10] TAAN: Task-Aware Attention Network for Few-shot Classification
    Wang, Zhe
    Liu, Li
    Li, FanZhang
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 9130 - 9136