Hybrid Multiscale SAR Ship Detector With CNN-Transformer and Adaptive Fusion Loss

被引:0
|
作者
Wang, Fei [1 ]
Chen, Chengcheng [1 ]
Zeng, Weiming [1 ]
机构
[1] Shanghai Maritime Univ, Digital Imaging & Intelligent Comp Lab, Shanghai 201306, Peoples R China
关键词
Marine vehicles; Feature extraction; Detectors; Convolution; Transformers; Computational modeling; Synthetic aperture radar; Deep learning; multiscale feature fusion; ship detection; synthetic aperture radar (SAR);
D O I
10.1109/LGRS.2024.3450716
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Ship detection in remote sensing imagery is crucial for various maritime applications such as surveillance and navigation. Convolutional neural networks (CNNs) and transformers have shown significant potential in object detection within the field of image processing. However, existing models applied directly to ship detection in synthetic aperture radar (SAR) imagery encounter challenges due to the varying sizes of ship targets. This often leads to issues such as low detection accuracy, missed detections, and false alarms. In this letter, we propose a new detection network, HMA-Net, to further address these issues. Initially, we introduce the Cwin module, which enhances interference resistance at a relatively low cost, enabling the model to more accurately capture target information. Subsequently, we design a multiscale ship feature extraction module, which uses a parallel multibranch structure to extract features of ships of various sizes and shapes. Finally, we introduce an adaptive fusion loss function that flexibly allocates loss calculation methods to detected targets, thereby enhancing the robustness of the model and achieving high-quality detection boxes. The proposed HMA-Net achieved improvements of 2.0% and 0.9% in mAP(.50:.95) over the baseline models on the SAR Ship Detection dataset and the High-Resolution SAR Images dataset, using only 3.52 M parameters.
引用
收藏
页数:5
相关论文
共 50 条
  • [31] Fault diagnosis method of a cascaded H-bridge inverter based on a multisource adaptive fusion CNN-transformer
    Yang, Weiman
    Wang, Weinian
    Wang, Xinggui
    Gu, Jianfeng
    Wang, Zhuoling
    IET POWER ELECTRONICS, 2024,
  • [32] VS-LSDet: A Multiscale Ship Detector for Spaceborne SAR Images Based on Visual Saliency and Lightweight CNN
    Yu, Hang
    Yang, Shihang
    Zhou, Suiping
    Sun, Yibo
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 1137 - 1154
  • [33] Hybrid CNN-transformer network for interactive learning of challenging musculoskeletal images
    Bi, Lei
    Buehner, Ulrich
    Fu, Xiaohang
    Williamson, Tom
    Choong, Peter
    Kim, Jinman
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2024, 243
  • [34] Hybrid CNN-Transformer Network for Electricity Theft Detection in Smart Grids
    Bai, Yu
    Sun, Haitong
    Zhang, Lili
    Wu, Haoqi
    SENSORS, 2023, 23 (20)
  • [35] SaltFormer: A hybrid CNN-Transformer network for automatic salt dome detection
    Li, Yang
    Peng, Suping
    He, Dengke
    Computers and Geosciences, 2025, 195
  • [36] A CNN-transformer hybrid approach for decoding visual neural activity into text
    Zhang, Jiang
    Li, Chen
    Liu, Ganwanming
    Min, Min
    Wang, Chong
    Li, Jiyi
    Wang, Yuting
    Yan, Hongmei
    Zuo, Zhentao
    Huang, Wei
    Chen, Huafu
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2022, 214
  • [37] CNN-Transformer hybrid network for concrete dam crack patrol inspection
    Li, Mingchao
    Yuan, Jingyue
    Ren, Qiubing
    Luo, Qiling
    Fu, Junen
    Li, Zhitang
    AUTOMATION IN CONSTRUCTION, 2024, 163
  • [38] A CNN-transformer fusion network for COVID-19 CXR image classification
    Cao, Kai
    Deng, Tao
    Zhang, Chuanlin
    Lu, Limeng
    Li, Lin
    PLOS ONE, 2022, 17 (10):
  • [39] Object Detection Algorithm Based on CNN-Transformer Dual Modal Feature Fusion
    Yang Chen
    Hou Zhiqiang
    Li Xinyue
    Ma Sugang
    Yang Xiaobao
    ACTA PHOTONICA SINICA, 2024, 53 (03)
  • [40] LOW LIGHT RGB AND IR IMAGE FUSION WITH SELECTIVE CNN-TRANSFORMER NETWORK
    Jin, Haiyan
    Yang, Yue
    Su, Haonan
    Xiao, Zhaolin
    Wang, Bin
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1255 - 1259