Exploring Data and Models in SAR Ship Image Captioning

被引:2
|
作者
Zhao, Kai [1 ]
Xiong, Wei [1 ]
机构
[1] Space Engn Univ, Sci & Technol Complex Elect Syst Simulat Lab, Beijing 101400, Peoples R China
关键词
Marine vehicles; Synthetic aperture radar; Radar polarimetry; Remote sensing; Seaports; Feature extraction; Decoding; Encoding; Recurrent neural networks; SAR image; image captioning; encoder-decoder; recurrent neural network; long short-term memory network;
D O I
10.1109/ACCESS.2022.3202193
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, considerable progress has been made in ship detection in synthetic aperture radar (SAR) images; however, no research has been conducted on translating SAR ship images into flexible and accurate sentences. To explore image captions in SAR ship images, we conduct the following work: first, to better describe SAR ship images, we propose certain principles for SAR image annotation based on the characteristics of SAR images. Second, to make better use of SAR ship images, a large-scale SAR ship image captioning dataset is carefully constructed. Finally, we explore encoder-decoder models and the attention mechanism and apply these methods to the SAR ship image captioning task. We conduct detailed experiments on the proposed dataset and find that the encoder-decoder model and attention mechanism can obtain good results in the SAR ship image captioning task. The experiments also reveal that the generated sentences can accurately describe SAR ship images. This dataset has already been published on https://github.com/5132210/SSIC.git.
引用
收藏
页码:91150 / 91159
页数:10
相关论文
共 50 条
  • [21] Text Augmentation for Compressed Image Captioning Models
    Atliha, Viktar
    Sesok, Dmitrij
    2022 IEEE OPEN CONFERENCE OF ELECTRICAL, ELECTRONIC AND INFORMATION SCIENCES (ESTREAM), 2022,
  • [22] A Study of Ship Rotation Effects on SAR Image
    Liu, Peng
    Jin, Ya-Qiu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (06): : 3132 - 3144
  • [23] Weak ship detection in polarimetric SAR image
    Guo R.
    Bao M.
    Li J.
    Zang B.
    Xing M.-D.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2011, 33 (06): : 1253 - 1256
  • [24] Discrimination of Ship's Bow in SAR Image
    Hu, Yang
    Xiong, Boli
    Kuang, Gangyao
    2018 2ND INTERNATIONAL CONFERENCE ON ENVIRONMENTAL AND ENERGY ENGINEERING (IC3E 2018), 2018, 146
  • [25] An Optical-to-SAR Transformation Method for SAR Ship Image Augmentation
    Li, Ke
    Luan, Shenshen
    Zhou, Dong
    2020 IEEE 3RD INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND SIGNAL PROCESSING (ICICSP 2020), 2020, : 264 - 268
  • [26] Exploring Transformer and Multilabel Classification for Remote Sensing Image Captioning
    Kandala, Hitesh
    Saha, Sudipan
    Banerjee, Biplab
    Zhu, Xiao Xiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [27] Exploring Spatial-Based Position Encoding for Image Captioning
    Yang, Xiaobao
    He, Shuai
    Wu, Junsheng
    Yang, Yang
    Hou, Zhiqiang
    Ma, Sugang
    MATHEMATICS, 2023, 11 (21)
  • [28] Exploring and Distilling Cross-Modal Information for Image Captioning
    Liu, Fenglin
    Ren, Xuancheng
    Liu, Yuanxin
    Lei, Kai
    Sun, Xu
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 5095 - 5101
  • [29] Social Image Captioning: Exploring Visual Attention and User Attention
    Wang, Leiquan
    Chu, Xiaoliang
    Zhang, Weishan
    Wei, Yiwei
    Sun, Weichen
    Wu, Chunlei
    SENSORS, 2018, 18 (02)
  • [30] A Widespread Assessment and Open Issues on Image Captioning Models
    Padate, Roshni
    Jain, Amit
    Kalla, Mukesh
    Sharma, Arvind
    INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2023, 23 (06)