SAR-to-Optical Image Translation and Cloud Removal Based on Conditional Generative Adversarial Networks: Literature Survey, Taxonomy, Evaluation Indicators, Limits and Future Directions

被引:15
|
作者
Xiong, Quan [1 ]
Li, Guoqing [1 ]
Yao, Xiaochuang [2 ]
Zhang, Xiaodong [2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] China Agr Univ, Coll Land Sci & Technol, Beijing 100083, Peoples R China
关键词
synthetic aperture radar (SAR); optical images; translation; cloud removal; data fusion; conditional generative adversarial networks; REMOTE-SENSING IMAGES; SENTINEL-2; IMAGERY; SATELLITE IMAGERY; SHADOW DETECTION; THICK CLOUDS; ERROR; GAN;
D O I
10.3390/rs15041137
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Due to the limitation of optical images that their waves cannot penetrate clouds, such images always suffer from cloud contamination, which causes missing information and limitations for subsequent agricultural applications, among others. Synthetic aperture radar (SAR) is able to provide surface information for all times and all weather. Therefore, translating SAR or fusing SAR and optical images to obtain cloud-free optical-like images are ideal ways to solve the cloud contamination issue. In this paper, we investigate the existing literature and provides two kinds of taxonomies, one based on the type of input and the other on the method used. Meanwhile, in this paper, we analyze the advantages and disadvantages while using different data as input. In the last section, we discuss the limitations of these current methods and propose several possible directions for future studies in this field.
引用
收藏
页数:20
相关论文
共 13 条
  • [1] SAR-to-Optical Image Translation Based on Conditional Generative Adversarial Networks-Optimization, Opportunities and Limits
    Reyes, Mario Fuentes
    Auer, Stefan
    Merkle, Nina
    Henry, Corentin
    Schmitt, Michael
    REMOTE SENSING, 2019, 11 (17)
  • [2] Improved Conditional Generative Adversarial Networks for SAR-to-Optical Image Translation
    Zhan, Tao
    Bian, Jiarong
    Yang, Jing
    Dang, Qianlong
    Zhang, Erlei
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT IV, 2024, 14428 : 279 - 291
  • [3] Cloud Removal in Remote Sensing Images Using Generative Adversarial Networks and SAR-to-Optical Image Translation
    Darbaghshahi, Faramarz Naderi
    Mohammadi, Mohammad Reza
    Soryani, Mohsen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Cloud Removal in Remote Sensing Images Using Generative Adversarial Networks and SAR-to-Optical Image Translation
    Darbaghshahi, Faramarz Naderi
    Mohammadi, Mohammad Reza
    Soryani, Mohsen
    IEEE Transactions on Geoscience and Remote Sensing, 2022, 60
  • [5] Comparative Analysis of Edge Information and Polarization on SAR-to-Optical Translation Based on Conditional Generative Adversarial Networks
    Zhang, Qian
    Liu, Xiangnan
    Liu, Meiling
    Zou, Xinyu
    Zhu, Lihong
    Ruan, Xiaohao
    REMOTE SENSING, 2021, 13 (01) : 1 - 20
  • [6] Edge-Preserving Convolutional Generative Adversarial Networks for SAR-to-Optical Image Translation
    Guo, Jie
    He, Chengyu
    Zhang, Mingjin
    Li, Yunsong
    Gao, Xinbo
    Song, Bangyu
    REMOTE SENSING, 2021, 13 (18)
  • [7] A Survey of Image Translation Based on Conditional Generative Adversarial Networks
    Tu H.
    Wang W.
    Chen J.
    Li G.
    Wu F.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2024, 36 (01): : 14 - 32
  • [8] SAR TO OPTICAL IMAGE SYNTHESIS FOR CLOUD REMOVAL WITH GENERATIVE ADVERSARIAL NETWORKS
    Bermudez, J. D.
    Happ, P. N.
    Oliveira, D. A. B.
    Feitosa, R. Q.
    ISPRS TC I MID-TERM SYMPOSIUM INNOVATIVE SENSING - FROM SENSORS TO METHODS AND APPLICATIONS, 2018, 4-1 : 5 - 11
  • [9] A SAR-to-Optical Image Translation Method Based on Conditional Generation Adversarial Network (cGAN)
    Li, Yu
    Fu, Randi
    Meng, Xiangchao
    Jin, Wei
    Shao, Feng
    IEEE ACCESS, 2020, 8 : 60338 - 60343
  • [10] Multiscale Generative Adversarial Network Based on Wavelet Feature Learning for SAR-to-Optical Image Translation
    Li, Huihui
    Gu, Cang
    Wu, Dongqing
    Cheng, Gong
    Guo, Lei
    Liu, Hang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60