SPNet: Siamese-Prototype Network for Few-Shot Remote Sensing Image Scene Classification

被引:98
|
作者
Cheng, Gong [1 ,2 ]
Cai, Liming [1 ,2 ]
Lang, Chunbo [1 ,2 ]
Yao, Xiwen [1 ]
Chen, Jinyong [2 ]
Guo, Lei [1 ]
Han, Junwei [1 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Xian 710072, Peoples R China
[2] CETC Key Lab Aerosp Informat Applicat, Shijiazhuang 050081, Hebei, Peoples R China
基金
美国国家科学基金会;
关键词
Prototypes; Remote sensing; Task analysis; Training; Feature extraction; Integrated circuit modeling; Calibration; Few-shot learning; remote sensing image scene classification; Siamese-prototype network (SPNet);
D O I
10.1109/TGRS.2021.3099033
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Few-shot image classification has attracted extensive attention, which aims to recognize unseen classes given only a few labeled samples. Due to the large intraclass variances and interclass similarity of remote sensing scenes, the task under such circumstance is much more challenging than general few-shot image classification. Most existing prototype-based few-shot algorithms usually calculate prototypes directly from support samples and ignore the validity of prototypes, which results in a decline in the accuracy of subsequent inferences based on prototypes. To tackle this problem, we propose a Siamese-prototype network (SPNet) with prototype self-calibration (SC) and intercalibration (IC). First, to acquire more accurate prototypes, we utilize the supervision information from support labels to calibrate the prototypes generated from support features. This process is called SC. Second, we propose to consider the confidence scores of the query samples as another type of prototypes, which are then used to predict the support samples in the same way. Thus, the information interaction between support and query samples is implicitly a further calibration for prototypes (so-called IC). Our model is optimized with three losses, of which two additional losses help the model to learn more representative prototypes and make more accurate predictions. With no additional parameters to be learned, our model is very lightweight and convenient to employ. The experiments on three public remote sensing image datasets demonstrate competitive performance compared with other advanced few-shot image classification approaches. The source code is available at https://github.com/zoraup/SPNet.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Prototype Calibration with Feature Generation for Few-Shot Remote Sensing Image Scene Classification
    Zeng, Qingjie
    Geng, Jie
    Huang, Kai
    Jiang, Wen
    Guo, Jun
    [J]. REMOTE SENSING, 2021, 13 (14)
  • [2] Dual Contrastive Network for Few-Shot Remote Sensing Image Scene Classification
    Ji, Zhong
    Hou, Liyuan
    Wang, Xuan
    Wang, Gang
    Pang, Yanwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [3] Subspace prototype learning for few-Shot remote sensing scene classification
    Wang, Wuli
    Xing, Lei
    Ren, Peng
    Jiang, Yumeng
    Wang, Ge
    Liu, Baodi
    [J]. SIGNAL PROCESSING, 2023, 208
  • [4] Teacher-Student Prototype Enhancement Network for a Few-Shot Remote Sensing Scene Classification
    Zhu, Ye
    Yang, Shanying
    Yu, Yang
    [J]. Photogrammetric Engineering and Remote Sensing, 2024, 90 (10): : 621 - 630
  • [5] Few-Shot Learning For Remote Sensing Scene Classification
    Alajaji, Dalal
    Alhichri, Haikel S.
    Ammour, Nassim
    Alajlan, Naif
    [J]. 2020 MEDITERRANEAN AND MIDDLE-EAST GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (M2GARSS), 2020, : 81 - 84
  • [6] IDLN: Iterative Distribution Learning Network for Few-Shot Remote Sensing Image Scene Classification
    Zeng, Qingjie
    Geng, Jie
    Jiang, Wen
    Huang, Kai
    Wang, Zeyu
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [7] HiReNet: Hierarchical-Relation Network for Few-Shot Remote Sensing Image Scene Classification
    Tian, Feng
    Lei, Sen
    Zhou, Yingbo
    Cheng, Jialin
    Liang, Guohao
    Zou, Zhengxia
    Li, Heng-Chao
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 10
  • [8] IDLN: Iterative Distribution Learning Network for Few-Shot Remote Sensing Image Scene Classification
    Zeng, Qingjie
    Geng, Jie
    Jiang, Wen
    Huang, Kai
    Wang, Zeyu
    [J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19
  • [9] SGMNet: Scene Graph Matching Network for Few-Shot Remote Sensing Scene Classification
    Zhang, Baoquan
    Feng, Shanshan
    Li, Xutao
    Ye, Yunming
    Ye, Rui
    Luo, Chen
    Jiang, Hao
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [10] DLA-MatchNet for Few-Shot Remote Sensing Image Scene Classification
    Li, Lingjun
    Han, Junwei
    Yao, Xiwen
    Cheng, Gong
    Guo, Lei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (09): : 7844 - 7853