Self-supervised pairwise-sample resistance model for few-shot classification

被引:0
|
作者
Weigang Li
Lu Xie
Ping Gan
Yuntao Zhao
机构
[1] Wuhan University of Science and Technology,Engineering Research Center of Metallurgical Automation and Measurement Technology of Ministry of Education
[2] Wuhan University of Science and Technology,College of Information Science and Engineering
[3] Qunar,undefined
来源
Applied Intelligence | 2023年 / 53卷
关键词
Few-shot; Self-supervised; Meta-learning; Pairwise-sample; Regularization;
D O I
暂无
中图分类号
学科分类号
摘要
The traditional supervised learning models rely on high-quality labeled samples heavily. In many fields, training the model on limited labeled samples will result in a weak generalization ability of the model. To address this problem, we propose a novel few-shot image classification method by self-supervised and metric learning, which contains two training steps: (1) Training the feature extractor and projection head with strong representational ability by self-supervised technology; (2) taking the trained feature extractor and projection head as the initialization meta-learning model, and fine-tuning the meta-learning model by the proposed loss functions. Specifically, we construct the pairwise-sample meta loss (ML) to consider the influence of each sample on the target sample in the feature space, and propose a novel regularization technique named resistance regularization based on pairwise-samples which is utilized as an auxiliary loss in the meta-learning model. The model performance is evaluated on the 5-way 1-shot and 5-way 5-shot classification tasks of mini-ImageNet and tired-ImageNet. The results demonstrate that the proposed method achieves the state-of-the-art performance.
引用
收藏
页码:20661 / 20674
页数:13
相关论文
共 50 条
  • [1] Self-supervised pairwise-sample resistance model for few-shot classification
    Li, Weigang
    Xie, Lu
    Gan, Ping
    Zhao, Yuntao
    [J]. APPLIED INTELLIGENCE, 2023, 53 (18) : 20661 - 20674
  • [2] Conditional Self-Supervised Learning for Few-Shot Classification
    An, Yuexuan
    Xue, Hui
    Zhao, Xingyu
    Zhang, Lu
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 2140 - 2146
  • [3] Self-supervised Network Evolution for Few-shot Classification
    Tang, Xuwen
    Teng, Zhu
    Zhang, Baopeng
    Fan, Jianping
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 3045 - 3051
  • [4] SELF-SUPERVISED LEARNING FOR FEW-SHOT IMAGE CLASSIFICATION
    Chen, Da
    Chen, Yuefeng
    Li, Yuhong
    Mao, Feng
    He, Yuan
    Xue, Hui
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1745 - 1749
  • [5] Few-Shot Hyperspectral Image Classification With Self-Supervised Learning
    Li, Zhaokui
    Guo, Hui
    Chen, Yushi
    Liu, Cuiwei
    Du, Qian
    Fang, Zhuoqun
    Wang, Yan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [6] SELF-SUPERVISED CLASS-COGNIZANT FEW-SHOT CLASSIFICATION
    Shirekar, Ojas Kishore
    Jamali-Rad, Hadi
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 976 - 980
  • [7] DEEP SELF-SUPERVISED LEARNING FOR FEW-SHOT HYPERSPECTRAL IMAGE CLASSIFICATION
    Li, Yu
    Zhang, Lei
    Wei, Wei
    Zhang, Yanning
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 501 - 504
  • [8] Self-Supervised Tuning for Few-Shot Segmentation
    Zhu, Kai
    Zhai, Wei
    Cao, Yang
    [J]. PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 1019 - 1025
  • [9] SCL: Self-supervised contrastive learning for few-shot image classification
    Lim, Jit Yan
    Lim, Kian Ming
    Lee, Chin Poo
    Tan, Yong Xuan
    [J]. NEURAL NETWORKS, 2023, 165 : 19 - 30
  • [10] Self-Supervised Traffic Classification: Flow Embedding and Few-Shot Solutions
    Horowicz, Eyal
    Shapira, Tal
    Shavitt, Yuval
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (03): : 3054 - 3067