Distributed few-shot learning with prototype distribution correction

被引:0
|
作者
Zhiling Fu
Dongfang Tang
Pingchuan Ma
Zhe Wang
Wen Gao
机构
[1] East China University of Science and Technology,Department of Computer Science and Engineering
[2] Huadong Hospital Affiliated to Fudan University,undefined
来源
Applied Intelligence | 2023年 / 53卷
关键词
Few-shot learning; Prototype correction; Distribution correction; Distributed learning;
D O I
暂无
中图分类号
学科分类号
摘要
Few-shot learning aims to learn a classifier that can perform well even if a few labeled samples are used for training. Many methods based on prototype models have recently been proposed and show good performance in few-shot learning. However, in the few-shot scenario, data is scarce. There is a deviation between the prototype calculated employing only a small amount of data in the support set and the actual prototype. Moreover, the features of the novel class extracted from the pre-trained model trained using base class data exhibit a bias. Additionally, the pre-trained model demonstrates high complexity and poor training efficiency. Therefore, we propose the Distributed Few-shot Learning with Prototype Distribution Correction to this end. Specifically, we employ pseudo-labels to fuse the sample features of the query set and modify the prototype to reduce the bias between the support and the query set. Then we utilize the features of the Gaussian distribution to transfer the base class features to the novel class to reduce the bias between novel classes and base classes. Finally, we combine distributed learning to improve the efficiency of the pre-trained model. We evaluate our method on Mini-ImageNet, Tiered-ImageNet, and CUB, three few-shot learning public datasets. The classification accuracy of our method improves in every case on every dataset and achieves state-of-the-art performance. In particular, the accuracy improves by 10.12% on 1-shot Mini-ImageNet.
引用
收藏
页码:30552 / 30565
页数:13
相关论文
共 50 条
  • [1] Distributed few-shot learning with prototype distribution correction
    Fu, Zhiling
    Tang, Dongfang
    Ma, Pingchuan
    Wang, Zhe
    Gao, Wen
    [J]. APPLIED INTELLIGENCE, 2023, 53 (24) : 30552 - 30565
  • [2] Prototype distribution correction for few-shot point cloud classification
    Feng, Yuanzhi
    Xia, Yu
    Guo, Jielong
    Shao, Dongheng
    Zhang, Jianfeng
    Wei, Xian
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (09) : 1243 - 1254
  • [3] Prototype Completion for Few-Shot Learning
    Zhang, Baoquan
    Li, Xutao
    Ye, Yunming
    Feng, Shanshan
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (10) : 12250 - 12268
  • [4] Prototype Reinforcement for Few-Shot Learning
    Xu, Liheng
    Xie, Qian
    Jiang, Baoqing
    Zhang, Jiashuo
    [J]. 2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 4912 - 4916
  • [5] Few-shot learning with representative global prototype
    Liu, Yukun
    Shi, Daming
    Lin, Hexiu
    [J]. NEURAL NETWORKS, 2024, 180
  • [6] Multi-Prototype Few-shot Learning in Histopathology
    Deuschel, Jessica
    Firmbach, Daniel
    Geppert, Carol, I
    Eckstein, Markus
    Hartmann, Arndt
    Bruns, Volker
    Kuritcyn, Petr
    Dexl, Jakob
    Hartmann, David
    Perrin, Dominik
    Wittenberg, Thomas
    Benz, Michaela
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 620 - 628
  • [7] Prototype Completion with Primitive Knowledge for Few-Shot Learning
    Zhang, Baoquan
    Li, Xutao
    Ye, Yunming
    Huang, Zhichao
    Zhang, Lisai
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 3753 - 3761
  • [8] Prototype Relationship Optimization Network for Few-Shot Learning
    Wang, Dengzhong
    Zhong, Yuan
    Ma, Yunfei
    Guo, Chunsheng
    [J]. IEEJ Transactions on Electrical and Electronic Engineering, 2024,
  • [9] WPE: Weighted prototype estimation for few-shot learning
    Cao, Jiangzhong
    Yao, Zijie
    Yu, Lianggeng
    Ling, Bingo Wing-Kuen
    [J]. IMAGE AND VISION COMPUTING, 2023, 137
  • [10] Adaptive Prototype Learning and Allocation for Few-Shot Segmentation
    Li, Gen
    Jampani, Varun
    Sevilla-Lara, Laura
    Sun, Deqing
    Kim, Jonghyun
    Kim, Joongkyu
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8330 - 8339