Label smoothing and task-adaptive loss function based on prototype network for few-shot learning

被引:14
|
作者
Gao, Farong [1 ]
Luo, Xingsheng [1 ]
Yang, Zhangyi [1 ]
Zhang, Qizhong [1 ,2 ]
机构
[1] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Peoples R China
[2] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Peoples R China
关键词
Flexible hyperparameters; Improved loss function; Few-shot learning; Image classification; Deep learning; CLASSIFICATION;
D O I
10.1016/j.neunet.2022.09.018
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aiming at solving the problems of prototype network that the label information is not reliable enough and that the hyperparameters of the loss function cannot follow the changes of image feature information, we propose a method that combines label smoothing and hyperparameters. First, the label information of an image is processed by label smoothing regularization. Then, according to different classification tasks, the distance matrix and logarithmic operation of the image feature are used to fuse the distance matrix of the image with the hyperparameters of the loss function. Finally, the hyperparameters are associated with the smoothed label and the distance matrix for predictive classification. The method is validated on the miniImageNet, FC100 and tieredImageNet datasets. The results show that, compared with the unsmoothed label and fixed hyperparameters methods, the classification accuracy of the flexible hyperparameters in the loss function under the condition of few-shot learning is improved by 2%-3%. The result shows that the proposed method can suppress the interference of false labels, and the flexibility of hyperparameters can improve classification accuracy.(c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页码:39 / 48
页数:10
相关论文
共 50 条
  • [21] Task-Adaptive Negative Envision for Few-Shot Open-Set Recognition
    Huang, Shiyuan
    Ma, Jiawei
    Han, Guangxing
    Chang, Shih-Fu
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7161 - 7170
  • [22] MetAdapt: Meta-learned task-adaptive architecture for few-shot classification
    Doveh, Sivan
    Schwartz, Eli
    Xue, Chao
    Feris, Rogerio
    Bronstein, Alex
    Giryes, Raja
    Karlinsky, Leonid
    PATTERN RECOGNITION LETTERS, 2021, 149 : 130 - 136
  • [23] Task-Adaptive Multi-Source Representations for Few-Shot Image Recognition
    Liu, Ge
    Zhang, Zhongqiang
    Fang, Xiangzhong
    INFORMATION, 2024, 15 (06)
  • [24] TAE-Net: Task-Adaptive Embedding Network for Few-Shot Remote Sensing Scene Classification
    Huang, Wendong
    Yuan, Zhengwu
    Yang, Aixia
    Tang, Chan
    Luo, Xiaobo
    REMOTE SENSING, 2022, 14 (01)
  • [25] Prototype Relationship Optimization Network for Few-Shot Learning
    Wang, Dengzhong
    Zhong, Yuan
    Ma, Yunfei
    Guo, Chunsheng
    IEEJ Transactions on Electrical and Electronic Engineering, 2024,
  • [26] Prototype Relationship Optimization Network for Few-Shot Learning
    Wang, Dengzhong
    Zhong, Yuan
    Ma, Yunfei
    Guo, Chunsheng
    IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2025, 20 (03) : 405 - 414
  • [27] Task-Adaptive Embedding Learning with Dynamic Kernel Fusion for Few-Shot Remote Sensing Scene Classification
    Zhang, Pei
    Fan, Guoliang
    Wu, Chanyue
    Wang, Dong
    Li, Ying
    REMOTE SENSING, 2021, 13 (21)
  • [28] A Multialignment Task-Adaptive Method for MFR Mode Recognition on Few-Shot Open-Set Learning
    Zhai, Qihang
    Liu, Jiabin
    Zhang, Zilin
    Li, Yan
    Wang, Shafei
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2024, 60 (06) : 7559 - 7574
  • [29] TART: Improved Few-shot Text Classification Using Task-Adaptive Reference Transformation
    Lei, Shuo
    Zhang, Xuchao
    He, Jianfeng
    Chen, Fanglan
    Lu, Chang-Tien
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023): LONG PAPERS, VOL 1, 2023, : 11014 - 11026
  • [30] Task-adaptive Spatial-Temporal Video Sampler for Few-shot Action Recognition
    Liu, Huabin
    Lv, Weixian
    See, John
    Lin, Weiyao
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6230 - 6240