Computational Oriented Proposal for Fine-Grained Ship Detection in Complex Remote Sensing Images

被引:0
|
作者
Zhan, Wenjing [1 ]
Liu, Fang [1 ]
Li, Yongke [1 ]
Xiao, Liang [2 ,3 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Jiangsu Key Lab Spectral Imaging & Intelligent Sen, Minist Educ, Nanjing 210094, Peoples R China
[3] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens Inf, Minist Educ, Nanjing 210094, Peoples R China
基金
中国国家自然科学基金;
关键词
Marine vehicles; Remote sensing; Proposals; Shape; Image resolution; YOLO; Task analysis; Arbitrary orientations; computational oriented proposal (COP); fine-grained dataset; multiscale object enhancement; ship (SH) detection;
D O I
10.1109/TIM.2024.3412210
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing images pose great challenges for fine-grained ship (SH) detection due to their bird's-eye view, complex scenes, and low resolution. One challenge of this problem is the difficulty of precisely localizing various SHs at the individual level. For SH detection, horizontal bounding boxes (HBBs) and oriented bounding boxes (OBBs) are the two common methods. However, when the remote sensing image contains SHs with arbitrary orientations and dense coverage, the former method is prone to poor localization and high detection errors, while the latter is inefficient precision in characterizing and adjusting the object orientation as well as high computational complexity. Furthermore, another challenge is the fine-grained nature of the SH categories and the difficulty of collecting training images that reflect realistic ocean scenarios. To address these challenges, this article proposes the computational oriented proposal (COP), where SHs are extracted from images, and their inherent features are used to calculate orientations and predict sizes to directly generate precise OBBs instead of relying on predefined anchors or other data-driven methods. To enhance SHs while suppressing background interference caused by complex backgrounds, a multiscale object enhancement module (MSOEM) is developed through multiscale attention. To further improve fine-grained SH classification accuracy, we propose an improved multitasking loss function with a contrastive embedding classification loss term, which can increase intraclass similarity and decrease interclass similarity. Moreover, a dataset called fine-grained remote sensing SH detection (FRSSD) is created. Experiments on the HRSC2016, FRSSD, and dataset for object detection in aerial images (DOTA) show that the proposed method outperforms other state-of-the-art object detection methods.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Fine-Grained Recognition for Oriented Ship Against Complex Scenes in Optical Remote Sensing Images
    Han, Yaqi
    Yang, Xinyi
    Pu, Tian
    Peng, Zhenming
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] PEDNet: A Proposal Enhancement Dynamic Network for Fine-Grained Ship Detection in Optical Remote Sensing Images
    Zhu, Shengbo
    Wei, Lisheng
    [J]. IEEE ACCESS, 2024, 12 : 129813 - 129825
  • [3] Contrastive Learning for Fine-Grained Ship Classification in Remote Sensing Images
    Chen, Jianqi
    Chen, Keyan
    Chen, Hao
    Li, Wenyuan
    Zou, Zhengxia
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Multigranularity Self-Attention Network for Fine-Grained Ship Detection in Remote Sensing Images
    Ouyang, Lihan
    Fang, Leyuan
    Ji, Xinyu
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 9722 - 9732
  • [5] Fine-Grained Classification of Remote Sensing Ship Images Based on Improved VAN
    Zhou, Guoqing
    Huang, Liang
    Sun, Qiao
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 77 (02): : 1985 - 2007
  • [6] A Public Dataset for Fine-Grained Ship Classification in Optical Remote Sensing Images
    Di, Yanghua
    Jiang, Zhiguo
    Zhang, Haopeng
    [J]. REMOTE SENSING, 2021, 13 (04) : 1 - 12
  • [7] Fine-Grained Feature Enhancement for Object Detection in Remote Sensing Images
    Zhou, Yong
    Wang, Sifan
    Zhao, Jiaqi
    Zhu, Hancheng
    Yao, Rui
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [8] An attention cut classification network for fine-grained ship classification in remote sensing images
    Song, Yixuan
    Song, Fei
    Jin, Lei
    Lei, Tao
    Liu, Gang
    Jiang, Ping
    Peng, Zhenming
    [J]. REMOTE SENSING LETTERS, 2022, 13 (04) : 418 - 427
  • [9] Fine-grained remote sensing ship open set recognition
    Liu, Changyuan
    Li, Ting
    Lan, Chaofeng
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2023, 31 (24): : 3618 - 3629
  • [10] Toward aircraft detection and fine-grained recognition from remote sensing images
    Hu, Qing
    Li, Runsheng
    Xu, Yan
    Pan, Chaofan
    Niu, Chaoyang
    Liu, Wei
    [J]. JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (02)