Few-Shot Object Detection Based on Contrastive Class-Attention Feature Reweighting for Remote Sensing Images

被引:1
|
作者
Miao, Wang [1 ]
Zhao, Zihao [1 ]
Geng, Jie [1 ]
Jiang, Wen [1 ]
机构
[1] Northwest ern Polytech Univ, Sch Elect & Informat, Xian 710129, Peoples R China
基金
中国国家自然科学基金;
关键词
Class-attention reweighting; contrastive learning; few-shot object detection (FSOD); remote sensing image; BIG DATA; CLASSIFICATION; ADAPTATION;
D O I
10.1109/JSTARS.2023.3347561
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing image object detection with deep neural networks has been highly successful, but it heavily relies on a large number of labeled samples for optimal performance. Unfortunately, when faced with limited labeled samples, the performance of object detection deteriorates. In order to overcome these limitations, we propose a few-shot object detection (FSOD) method based on the reweighting of contrastive class-attention features for remote sensing images. A Siamese representation embedding model based on contrastive learning with a distinguishing operator is proposed to deal with interclass feature ambiguity between base classes and novel classes under complex backgrounds. At the same time, the attention class weights method on region of interest (ROI) features is utilized to boost the discrimination of the novel class features. We conducted comprehensive experiments on two widely used remote sensing object detection datasets, RSOD and DIOR. The proposed FSOD model demonstrated superior performance compared to MM-RCNN, achieving an improvement of approximately 4.7% in terms of mAP on the DIOR dataset. In addition, in comparison to the self-adaptive attention network (SAAN), the FSOD model exhibited an improvement of approximately 3.4% in mAP on the RSOD dataset.
引用
下载
收藏
页码:2800 / 2814
页数:15
相关论文
共 50 条
  • [31] Class Hierarchy-Guided Generalized Few-Shot Ship Detection in Remote Sensing Images
    Zhang, Shuangqing
    Zhang, Zhang
    Li, Da
    Jia, Zhen
    Li, Chenglong
    Wang, Liang
    Zhao, Hanyu
    Wang, Duo
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [32] FSOD4RSI: Few-Shot Object Detection for Remote Sensing Images via Features Aggregation and Scale Attention
    Gao, Honghao
    Wu, Shuping
    Wang, Ye
    Kim, Jung Yoon
    Xu, Yueshen
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 4784 - 4796
  • [33] Few-Shot Object Detection on Remote Sensing Images via Shared Attention Module and Balanced Fine-Tuning Strategy
    Huang, Xu
    He, Bokun
    Tong, Ming
    Wang, Dingwen
    He, Chu
    REMOTE SENSING, 2021, 13 (19)
  • [34] Meta-Feature Relearning with Embedded Label Semantics and Reweighting for Few-Shot Object Detection
    Li P.-F.
    Liu F.
    Li L.-L.
    Liu X.
    Feng Z.-X.
    Jiao L.-C.
    Xiong Y.-M.
    Jisuanji Xuebao/Chinese Journal of Computers, 2022, 45 (12): : 2561 - 2575
  • [35] Text Semantic Fusion Relation Graph Reasoning for Few-Shot Object Detection on Remote Sensing Images
    Zhang, Sanxing
    Song, Fei
    Liu, Xianyuan
    Hao, Xuying
    Liu, Yujia
    Lei, Tao
    Jiang, Ping
    REMOTE SENSING, 2023, 15 (05)
  • [36] MM-RCNN: Toward Few-Shot Object Detection in Remote Sensing Images With Meta Memory
    Li, Jianxiang
    Tian, Yan
    Xu, Yiping
    Hu, Xinli
    Zhang, Zili
    Wang, Hu
    Xiao, Yiwen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [37] A comparative attention framework for better few-shot object detection on aerial images
    Le Jeune, Pierre
    Bahaduri, Bissmella
    Mokraoui, Anissa
    Pattern Recognition, 2025, 161
  • [38] Few-Shot Object Detection in Remote Sensing Image Interpretation: Opportunities and Challenges
    Liu, Sixu
    You, Yanan
    Su, Haozheng
    Meng, Gang
    Yang, Wei
    Liu, Fang
    REMOTE SENSING, 2022, 14 (18)
  • [39] Retentive Compensation and Personality Filtering for Few-Shot Remote Sensing Object Detection
    Wu, Jiashan
    Lang, Chunbo
    Cheng, Gong
    Xie, Xingxing
    Han, Junwei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 5805 - 5817
  • [40] Few-Shot Object Detection with Memory Contrastive Proposal Based on Semantic Priors
    Xiao, Linlin
    Xu, Huahu
    Xiao, Junsheng
    Huang, Yuzhe
    ELECTRONICS, 2023, 12 (18)