Spatial and Spectral Translation of Landsat 8 to Sentinel-2 Using Conditional Generative Adversarial Networks

被引:0
|
作者
Mukherjee, Rohit [1 ]
Liu, Desheng [2 ]
机构
[1] Univ Arizona, Sch Geog Dev & Environm, Tucson, AZ 85721 USA
[2] Ohio State Univ, Dept Geog, Columbus, OH 43210 USA
关键词
Sentinel-2; Landsat; 8; image translation; generative adversarial network; spectral resolution; spatial resolution; RED-EDGE BANDS; TIME-SERIES; IMAGES; OLI; MSI;
D O I
10.3390/rs15235502
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Satellite sensors like Landsat 8 OLI (L8) and Sentinel-2 MSI (S2) provide valuable multispectral Earth observations that differ in spatial resolution and spectral bands, limiting synergistic use. L8 has a 30 m resolution and a lower revisit frequency, while S2 offers up to a 10 m resolution and more spectral bands, such as red edge bands. Translating observations from L8 to S2 can increase data availability by combining their images to leverage the unique strengths of each product. In this study, a conditional generative adversarial network (CGAN) is developed to perform sensor-specific domain translation focused on green, near-infrared (NIR), and red edge bands. The models were trained on the pairs of co-located L8-S2 imagery from multiple locations. The CGAN aims to downscale 30 m L8 bands to 10 m S2-like green and 20 m S2-like NIR and red edge bands. Two translation methodologies are employed-direct single-step translation from L8 to S2 and indirect multistep translation. The direct approach involves predicting the S2-like bands in a single step from L8 bands. The multistep approach uses two steps-the initial model predicts the corresponding S2-like band that is available in L8, and then the final model predicts the unavailable S2-like red edge bands from the S2-like band predicted in the first step. Quantitative evaluation reveals that both approaches result in lower spectral distortion and higher spatial correlation compared to native L8 bands. Qualitative analysis supports the superior fidelity and robustness achieved through multistep translation. By translating L8 bands to higher spatial and spectral S2-like imagery, this work increases data availability for improved earth monitoring. The results validate CGANs for cross-sensor domain adaptation and provide a reusable computational framework for satellite image translation.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Super-Resolution of Sentinel-2 Imagery Using Generative Adversarial Networks
    Salgueiro Romero, Luis
    Marcello, Javier
    Vilaplana, Veronica
    REMOTE SENSING, 2020, 12 (15)
  • [2] Landsat-8 to Sentinel-2 Satellite Imagery Super-Resolution-Based Multiscale Dilated Transformer Generative Adversarial Networks
    Wang, Chunyang
    Zhang, Xian
    Yang, Wei
    Wang, Gaige
    Zhao, Zongze
    Liu, Xuan
    Lu, Bibo
    REMOTE SENSING, 2023, 15 (22)
  • [3] Farmland Segmentation in Landsat 8 Satellite Images Using Deep Learning and Conditional Generative Adversarial Networks
    Nair, Shruti
    Sharifzadeh, Sara
    Palade, Vasile
    REMOTE SENSING, 2024, 16 (05)
  • [4] Spatial interpolation using conditional generative adversarial neural networks
    Zhu, Di
    Cheng, Ximeng
    Zhang, Fan
    Yao, Xin
    Gao, Yong
    Liu, Yu
    INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, 2020, 34 (04) : 735 - 758
  • [5] Generative Framework Approach to Match Landsat and Sentinel-2 Data
    Roy, Sujit
    Sridhar, Madhu
    Mandel, John
    Freitag, Brian
    Ju, Junchang
    Ramachandran, Rahul
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 5101 - 5104
  • [6] AN APPROACH TO SUPER-RESOLUTION OF SENTINEL-2 IMAGES BASED ON GENERATIVE ADVERSARIAL NETWORKS
    Zhang, Kexin
    Sumbul, Gencer
    Demir, Begum
    2020 MEDITERRANEAN AND MIDDLE-EAST GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (M2GARSS), 2020, : 69 - 72
  • [7] A Survey of Image Translation Based on Conditional Generative Adversarial Networks
    Tu H.
    Wang W.
    Chen J.
    Li G.
    Wu F.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2024, 36 (01): : 14 - 32
  • [8] CLOUD-GAN: CLOUD REMOVAL FOR SENTINEL-2 IMAGERY USING A CYCLIC CONSISTENT GENERATIVE ADVERSARIAL NETWORKS
    Singh, Praveer
    Komodakis, Nikos
    IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 1772 - 1775
  • [9] Comparative Evaluation of the Spectral and Spatial Consistency of Sentinel-2 and Landsat-8 OLI Data for Igneada Longos Forest
    Arekhi, Maliheh
    Goksel, Cigdem
    Sanli, Fusun Balik
    Senel, Gizem
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2019, 8 (02):
  • [10] Conditional Independence Testing using Generative Adversarial Networks
    Bellot, Alexis
    van der Schaar, Mihaela
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32