Remote Sensing Image Mode Translation by Spatial Disentangled Representation Based GAN

被引:0
|
作者
Han Zishuo [1 ]
Wang Chunping [1 ]
Fu Qiang [1 ]
Zhao Bin [1 ]
机构
[1] Army Engn Univ, Dept Elect & Opt Engn, Shijiazhuang Campus, Shijiazhuang 050003, Hebei, Peoples R China
关键词
remote sensing; image translation; synthetic aperture radar; optical remote sensing image; cycleconsistent adversarial networks;
D O I
10.3788/A0S202141.0728003
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Resting on the translation framework of spatially separated images, we proposed a cycle-consistent generative adversarial network (GAN) based on spatial disentangled representation to address the large mode difference and difficult translation between synthetic aperture radar images and optical remote sensing images. The proposed model separates images into style and content features by a deeper network layer and jump connection. Furthermore, the content features arc translated by content mapping learning and combined with target style features for image translation. In addition, PatchGAN, as the discriminator, enhances the image detail generation, and target error loss and generation & reconstruction loss arc introduced to limit the translation task to one-to-one mapping, thus reducing the information added and constraining the GAN. The experimental results in SEN1-2, SARptical, and WHU-SEN-City datasets show that compared with other image translation algorithms, the proposed method can translate two types of remote sensing images and generate images of high resolution, complete detail features, and strong authenticity.
引用
收藏
页数:14
相关论文
共 21 条
  • [1] Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
  • [2] Chang H Y, 2020, DOMAIN SPECIFIC MAPP, P573
  • [3] Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images
    Cheng, Gong
    Zhou, Peicheng
    Han, Junwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12): : 7405 - 7415
  • [4] DuZ X, 2020, J LASER OPTOELECTRON, V57
  • [5] Fu C.Y., 2017, arXiv
  • [6] Fu S L, RECIPROCAL TRANSLATI
  • [7] Goodfellow I., 2020, ADV NEUR IN, V63, P139, DOI [DOI 10.1145/3422622, 10.1145/3422622]
  • [8] Hu LM, 2020, ACTA OPT SIN, V40, DOI [10.1200/EDBK_280955, 10.3788/AOS202040.0510001]
  • [9] Multimodal Unsupervised Image-to-Image Translation
    Huang, Xun
    Liu, Ming-Yu
    Belongie, Serge
    Kautz, Jan
    [J]. COMPUTER VISION - ECCV 2018, PT III, 2018, 11207 : 179 - 196
  • [10] Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization
    Huang, Xun
    Belongie, Serge
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 1510 - 1519