Retentive Compensation and Personality Filtering for Few-Shot Remote Sensing Object Detection

被引:2
|
作者
Wu, Jiashan [1 ]
Lang, Chunbo [1 ]
Cheng, Gong [1 ]
Xie, Xingxing [1 ]
Han, Junwei [1 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Xian 710129, Peoples R China
基金
美国国家科学基金会;
关键词
Remote sensing; Prototypes; Object detection; Task analysis; Filtering; Training; Satellite images; Few-shot object detection; remote sensing; fine-tuning; metric learning; TERM;
D O I
10.1109/TCSVT.2024.3367168
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, few-shot object detection (FSOD) in remote sensing images has attracted increasing attention. Numerous studies address the challenges posed by both intra-class and inter-class variance through strategies such as augmenting sample diversity and incorporating multi-scale features. However, these features still encompass a considerable amount of noise attributes due to the complex characteristic of satellite images, persistently and adversely affecting classification. In contrast, we advocate for the belief that a limited yet refined set of features surpasses a multitude of coarse features. Accordingly, we tackle above issues through the meticulous refinement of representative category features, enhancing performance by eliminating irrelevant attributes that interfere with classification. Specifically, two pivotal modules: retentive compensation module (RCM) and personality filtering module (PFM), are introduced. The former module RCM systematically scrutinizes features proximate to the category center, yielding prototypes that exhibit both intra-class compactness and inter-class distinctiveness. Furthermore, the latter module PFM utilizes previous obtained prototypes to supervise the filtering process, diminishing the intra-class variance by excluding personality features which could impede the classification task. The integration of the above two modules enables a holistic feature representation, capturing inherent similarities within individual classes while accentuating distinctions between classes. Experiments have been conducted on the DIOR and NWPU VHR-10.v2 datasets, and the results demonstrate that our proposed approach exceeds several state-of-the-art methods. Code is available at https://github.com/yomik-js/RP-FSOD.
引用
收藏
页码:5805 / 5817
页数:13
相关论文
共 50 条
  • [1] Few-Shot Object Detection on Remote Sensing Images
    Li, Xiang
    Deng, Jingyu
    Fang, Yi
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] Generalized few-shot object detection in remote sensing images
    Zhang, Tianyang
    Zhang, Xiangrong
    Zhu, Peng
    Jia, Xiuping
    Tang, Xu
    Jiao, Licheng
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 195 : 353 - 364
  • [3] Arbitrary Oriented Few-Shot Object Detection in Remote Sensing Images
    Wu, Wei
    Jiang, Chengeng
    Yang, Liao
    Wang, Weisheng
    Chen, Quanjun
    Zhang, Junjian
    Yang, Haiping
    Chen, Zuohui
    [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2024, 17 : 17930 - 17944
  • [4] InfRS: Incremental Few-Shot Object Detection in Remote Sensing Images
    Li, Wuzhou
    Zhou, Jiawei
    Li, Xiang
    Cao, Yi
    Jin, Guang
    Zhang, Xuemin
    [J]. IEEE Transactions on Geoscience and Remote Sensing, 2024, 62
  • [5] Few-Shot Object Detection of Remote Sensing Image via Calibration
    Li, Ruolei
    Zeng, Yilong
    Wu, Jianfeng
    Wang, Yongli
    Zhang, Xiaoli
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [6] Few-Shot Object Detection in Remote Sensing Image Interpretation: Opportunities and Challenges
    Liu, Sixu
    You, Yanan
    Su, Haozheng
    Meng, Gang
    Yang, Wei
    Liu, Fang
    [J]. REMOTE SENSING, 2022, 14 (18)
  • [7] Context Information Refinement for Few-Shot Object Detection in Remote Sensing Images
    Wang, Yan
    Xu, Chaofei
    Liu, Cuiwei
    Li, Zhaokui
    [J]. REMOTE SENSING, 2022, 14 (14)
  • [8] Prototype-CNN for Few-Shot Object Detection in Remote Sensing Images
    Cheng, Gong
    Yan, Bowei
    Shi, Peizhen
    Li, Ke
    Yao, Xiwen
    Guo, Lei
    Han, Junwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [9] Scale Information Enhancement for Few-Shot Object Detection on Remote Sensing Images
    Yang, Zhenyu
    Zhang, Yongxin
    Zheng, Jv
    Yu, Zhibin
    Zheng, Bing
    Piciarelli, Claudio
    Melo-Pinto, Pedro
    [J]. REMOTE SENSING, 2023, 15 (22)
  • [10] Discriminative Prototype Learning for Few-Shot Object Detection in Remote-Sensing Images
    Guo, Manke
    You, Yanan
    Liu, Fang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 13