Few-Shot Object Detection Based on Contrastive Class-Attention Feature Reweighting for Remote Sensing Images

被引:1
|
作者
Miao, Wang [1 ]
Zhao, Zihao [1 ]
Geng, Jie [1 ]
Jiang, Wen [1 ]
机构
[1] Northwest ern Polytech Univ, Sch Elect & Informat, Xian 710129, Peoples R China
基金
中国国家自然科学基金;
关键词
Class-attention reweighting; contrastive learning; few-shot object detection (FSOD); remote sensing image; BIG DATA; CLASSIFICATION; ADAPTATION;
D O I
10.1109/JSTARS.2023.3347561
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing image object detection with deep neural networks has been highly successful, but it heavily relies on a large number of labeled samples for optimal performance. Unfortunately, when faced with limited labeled samples, the performance of object detection deteriorates. In order to overcome these limitations, we propose a few-shot object detection (FSOD) method based on the reweighting of contrastive class-attention features for remote sensing images. A Siamese representation embedding model based on contrastive learning with a distinguishing operator is proposed to deal with interclass feature ambiguity between base classes and novel classes under complex backgrounds. At the same time, the attention class weights method on region of interest (ROI) features is utilized to boost the discrimination of the novel class features. We conducted comprehensive experiments on two widely used remote sensing object detection datasets, RSOD and DIOR. The proposed FSOD model demonstrated superior performance compared to MM-RCNN, achieving an improvement of approximately 4.7% in terms of mAP on the DIOR dataset. In addition, in comparison to the self-adaptive attention network (SAAN), the FSOD model exhibited an improvement of approximately 3.4% in mAP on the RSOD dataset.
引用
下载
收藏
页码:2800 / 2814
页数:15
相关论文
共 50 条
  • [1] Few-shot Object Detection with Feature Attention Highlight Module in Remote Sensing Images
    Xiao, Zixuan
    Zhong, Ping
    Quan, Yuan
    Yin, Xuping
    Xue, Wei
    2020 INTERNATIONAL CONFERENCE ON IMAGE, VIDEO PROCESSING AND ARTIFICIAL INTELLIGENCE, 2020, 11584
  • [2] Few-Shot Object Detection on Remote Sensing Images
    Li, Xiang
    Deng, Jingyu
    Fang, Yi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] Few-shot Object Detection via Feature Reweighting
    Kang, Bingyi
    Liu, Zhuang
    Wang, Xin
    Yu, Fisher
    Feng, Jiashi
    Darrell, Trevor
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 8419 - 8428
  • [4] Generalized few-shot object detection in remote sensing images
    Zhang, Tianyang
    Zhang, Xiangrong
    Zhu, Peng
    Jia, Xiuping
    Tang, Xu
    Jiao, Licheng
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 195 : 353 - 364
  • [5] Few-Shot Object Detection in Remote Sensing Images With Multiscale Spatial Selective Attention
    Yu, Yingnan
    Chen, Si-Bao
    Huang, Li-Li
    Tang, Jin
    Luo, Bin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 1
  • [6] Few-Shot Object Detection via Transfer Learning and Contrastive Reweighting
    Wu, Zhen
    Li, Haowei
    Zhang, Dongyu
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VII, 2023, 14260 : 78 - 87
  • [7] Few-Shot Object Detection With Self-Adaptive Attention Network for Remote Sensing Images
    Xiao, Zixuan
    Qi, Jiahao
    Xue, Wei
    Zhong, Ping
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 4854 - 4865
  • [8] Arbitrary Oriented Few-Shot Object Detection in Remote Sensing Images
    Wu, Wei
    Jiang, Chengeng
    Yang, Liao
    Wang, Weisheng
    Chen, Quanjun
    Zhang, Junjian
    Yang, Haiping
    Chen, Zuohui
    IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2024, 17 : 17930 - 17944
  • [9] InfRS: Incremental Few-Shot Object Detection in Remote Sensing Images
    Li, Wuzhou
    Zhou, Jiawei
    Li, Xiang
    Cao, Yi
    Jin, Guang
    Zhang, Xuemin
    IEEE Transactions on Geoscience and Remote Sensing, 2024, 62
  • [10] Multi-scale Self-attention-based Few-shot Object Detection for Remote Sensing Images
    Wang, Run
    Wang, Qiong
    Yu, Jiawei
    Tong, Jiaxing
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,