Computational Oriented Proposal for Fine-Grained Ship Detection in Complex Remote Sensing Images

被引:0
|
作者
Zhan, Wenjing [1 ]
Liu, Fang [1 ]
Li, Yongke [1 ]
Xiao, Liang [2 ,3 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Jiangsu Key Lab Spectral Imaging & Intelligent Sen, Minist Educ, Nanjing 210094, Peoples R China
[3] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens Inf, Minist Educ, Nanjing 210094, Peoples R China
基金
中国国家自然科学基金;
关键词
Marine vehicles; Remote sensing; Proposals; Shape; Image resolution; YOLO; Task analysis; Arbitrary orientations; computational oriented proposal (COP); fine-grained dataset; multiscale object enhancement; ship (SH) detection;
D O I
10.1109/TIM.2024.3412210
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing images pose great challenges for fine-grained ship (SH) detection due to their bird's-eye view, complex scenes, and low resolution. One challenge of this problem is the difficulty of precisely localizing various SHs at the individual level. For SH detection, horizontal bounding boxes (HBBs) and oriented bounding boxes (OBBs) are the two common methods. However, when the remote sensing image contains SHs with arbitrary orientations and dense coverage, the former method is prone to poor localization and high detection errors, while the latter is inefficient precision in characterizing and adjusting the object orientation as well as high computational complexity. Furthermore, another challenge is the fine-grained nature of the SH categories and the difficulty of collecting training images that reflect realistic ocean scenarios. To address these challenges, this article proposes the computational oriented proposal (COP), where SHs are extracted from images, and their inherent features are used to calculate orientations and predict sizes to directly generate precise OBBs instead of relying on predefined anchors or other data-driven methods. To enhance SHs while suppressing background interference caused by complex backgrounds, a multiscale object enhancement module (MSOEM) is developed through multiscale attention. To further improve fine-grained SH classification accuracy, we propose an improved multitasking loss function with a contrastive embedding classification loss term, which can increase intraclass similarity and decrease interclass similarity. Moreover, a dataset called fine-grained remote sensing SH detection (FRSSD) is created. Experiments on the HRSC2016, FRSSD, and dataset for object detection in aerial images (DOTA) show that the proposed method outperforms other state-of-the-art object detection methods.
引用
收藏
页数:18
相关论文
共 50 条
  • [31] A New Benchmark and an Attribute-Guided Multilevel Feature Representation Network for Fine-Grained Ship Classification in Optical Remote Sensing Images
    Zhang, Xiaohan
    Lv, Yafei
    Yao, Libo
    Xiong, Wei
    Fu, Chunlong
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 1271 - 1285
  • [32] A Unified Multiple Proxy Deep Metric Learning Framework Embedded With Distribution Optimization for Fine-Grained Ship Classification in Remote Sensing Images
    Xu, Jianwen
    Lang, Haitao
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 5604 - 5620
  • [33] Arbitrary-Oriented Ellipse Detector for Ship Detection in Remote Sensing Images
    Zhou, Kexue
    Zhang, Min
    Zhao, Honghui
    Tang, Rui
    Lin, Sheng
    Cheng, Xi
    Wang, Hai
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 7151 - 7162
  • [34] FFPNet: Fine-Grained Feature Perception Network for Semantic Change Detection on Bi-Temporal Remote Sensing Images
    Zhang, Fengwei
    Xia, Kai
    Yin, Jianxin
    Deng, Susu
    Feng, Hailin
    [J]. Remote Sensing, 2024, 16 (21)
  • [35] Arbitrary-Oriented Ship Detection Based on RetinaNet for Remote Sensing Images
    Zhu, Mingming
    Hu, Guoping
    Zhou, Hao
    Wang, Shiqiang
    Zhang, Yule
    Yue, Shijie
    Bai, Yu
    Zang, Kexin
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 6694 - 6706
  • [36] AFA-NET: ADAPTIVE FEATURE AGGREGATION NETWORK FOR AIRCRAFT FINE-GRAINED DETECTION IN CLOUDY REMOTE SENSING IMAGES
    Zhang, Nan
    Xu, Hao
    Liu, Youmeng
    Tian, Tian
    Tian, Jinwen
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1704 - 1707
  • [37] A Deep CNN-Based Detection Method for Multi-Scale Fine-Grained Objects in Remote Sensing Images
    Xie, Qiyang
    Zhou, Daiying
    Tang, Rui
    Feng, Hao
    [J]. IEEE ACCESS, 2024, 12 : 15622 - 15630
  • [38] Ship detection of complex sea background in optical remote sensing images
    [J]. Zhu, Ming (zhu_mingca@163.com), 2018, Chinese Academy of Sciences (26):
  • [39] Ship detection for complex scene images of space optical remote sensing
    Liu, Xinwei
    Piao, Yongjie
    Zheng, Liangliang
    Xu, Wei
    Ji, Haolin
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2023, 31 (06): : 892 - 904
  • [40] Contrastive Learning Network Based on Causal Attention for Fine-Grained Ship Classification in Remote Sensing Scenarios
    Pan, Chaofan
    Li, Runsheng
    Hu, Qing
    Niu, Chaoyang
    Liu, Wei
    Lu, Wanjie
    [J]. REMOTE SENSING, 2023, 15 (13)