Few-Shot Object Detection Based on Contrastive Class-Attention Feature Reweighting for Remote Sensing Images

被引:1
|
作者
Miao, Wang [1 ]
Zhao, Zihao [1 ]
Geng, Jie [1 ]
Jiang, Wen [1 ]
机构
[1] Northwest ern Polytech Univ, Sch Elect & Informat, Xian 710129, Peoples R China
基金
中国国家自然科学基金;
关键词
Class-attention reweighting; contrastive learning; few-shot object detection (FSOD); remote sensing image; BIG DATA; CLASSIFICATION; ADAPTATION;
D O I
10.1109/JSTARS.2023.3347561
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing image object detection with deep neural networks has been highly successful, but it heavily relies on a large number of labeled samples for optimal performance. Unfortunately, when faced with limited labeled samples, the performance of object detection deteriorates. In order to overcome these limitations, we propose a few-shot object detection (FSOD) method based on the reweighting of contrastive class-attention features for remote sensing images. A Siamese representation embedding model based on contrastive learning with a distinguishing operator is proposed to deal with interclass feature ambiguity between base classes and novel classes under complex backgrounds. At the same time, the attention class weights method on region of interest (ROI) features is utilized to boost the discrimination of the novel class features. We conducted comprehensive experiments on two widely used remote sensing object detection datasets, RSOD and DIOR. The proposed FSOD model demonstrated superior performance compared to MM-RCNN, achieving an improvement of approximately 4.7% in terms of mAP on the DIOR dataset. In addition, in comparison to the self-adaptive attention network (SAAN), the FSOD model exhibited an improvement of approximately 3.4% in mAP on the RSOD dataset.
引用
下载
收藏
页码:2800 / 2814
页数:15
相关论文
共 50 条
  • [41] Center Heatmap Attention for Few-Shot Object Detection
    Li, Fanglin
    Yuan, Jie
    Yi, Fengshu
    Cai, Xiaomin
    Gao, Hao
    INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE AND ROBOTICS 2021, 2021, 11884
  • [42] Efficient Feature Enhancement for Few-Shot Object Detection
    Li, Lin
    Lei, Zhou
    Chen, Shengbo
    Xu, Qingguo
    2022 IEEE 6TH ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2022, : 1206 - 1210
  • [43] Small Object Detection in Remote Sensing Images Based on Feature Fusion and Attention
    Zhang Yin
    Zhu Guiyi
    Shi Tianjun
    Zhang Kun
    Yan Junhua
    ACTA OPTICA SINICA, 2022, 42 (24)
  • [44] Feature reconstruction and metric based network for few-shot object detection
    Li, Yuewen
    Feng, Wenquan
    Lyu, Shuchang
    Zhao, Qi
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 227
  • [45] Few-Shot Object Detection of Remote Sensing Images via Two-Stage Fine-Tuning
    Zhao, Zhitao
    Tang, Ping
    Zhao, Lijun
    Zhang, Zheng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [46] NON-LOCAL PROPOSAL DYNAMIC ENHANCEMENT LEARNING FOR FEW-SHOT OBJECT DETECTION IN REMOTE SENSING IMAGES
    Wang, Haoyu
    Zhang, Lei
    Wei, Wei
    Ding, Chen
    Zhang, Yanning
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1888 - 1891
  • [47] Few-Shot Object Detection of Remote Sensing Images via Two-Stage Fine-Tuning
    Zhao, Zhitao
    Tang, Ping
    Zhao, Lijun
    Zhang, Zheng
    IEEE Geoscience and Remote Sensing Letters, 2022, 19
  • [48] Few-Shot Object Detection in Remote Sensing Images via Data Clearing and Stationary Meta-Learning
    Yang, Zijiu
    Guan, Wenbin
    Xiao, Luyang
    Chen, Honggang
    SENSORS, 2024, 24 (12)
  • [49] Few-Shot Scene Classification with Attention Mechanism in Remote Sensing
    Zhang, Duona
    Zhao, Hongjia
    Lu, Yuanyao
    Cui, Jian
    Zhang, Baochang
    Computer Engineering and Applications, 2024, 60 (04) : 173 - 182
  • [50] Better Class Feature Representation for Few-Shot Object Detection: Feature Aggregation and Feature Space Redistribution
    Zhang, Wen
    Xu, Yuping
    Chen, Guorui
    Li, Zhijiang
    JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2023, 67 (02)