Spatial and Spectral Translation of Landsat 8 to Sentinel-2 Using Conditional Generative Adversarial Networks

被引:0
|
作者
Mukherjee, Rohit [1 ]
Liu, Desheng [2 ]
机构
[1] Univ Arizona, Sch Geog Dev & Environm, Tucson, AZ 85721 USA
[2] Ohio State Univ, Dept Geog, Columbus, OH 43210 USA
关键词
Sentinel-2; Landsat; 8; image translation; generative adversarial network; spectral resolution; spatial resolution; RED-EDGE BANDS; TIME-SERIES; IMAGES; OLI; MSI;
D O I
10.3390/rs15235502
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Satellite sensors like Landsat 8 OLI (L8) and Sentinel-2 MSI (S2) provide valuable multispectral Earth observations that differ in spatial resolution and spectral bands, limiting synergistic use. L8 has a 30 m resolution and a lower revisit frequency, while S2 offers up to a 10 m resolution and more spectral bands, such as red edge bands. Translating observations from L8 to S2 can increase data availability by combining their images to leverage the unique strengths of each product. In this study, a conditional generative adversarial network (CGAN) is developed to perform sensor-specific domain translation focused on green, near-infrared (NIR), and red edge bands. The models were trained on the pairs of co-located L8-S2 imagery from multiple locations. The CGAN aims to downscale 30 m L8 bands to 10 m S2-like green and 20 m S2-like NIR and red edge bands. Two translation methodologies are employed-direct single-step translation from L8 to S2 and indirect multistep translation. The direct approach involves predicting the S2-like bands in a single step from L8 bands. The multistep approach uses two steps-the initial model predicts the corresponding S2-like band that is available in L8, and then the final model predicts the unavailable S2-like red edge bands from the S2-like band predicted in the first step. Quantitative evaluation reveals that both approaches result in lower spectral distortion and higher spatial correlation compared to native L8 bands. Qualitative analysis supports the superior fidelity and robustness achieved through multistep translation. By translating L8 bands to higher spatial and spectral S2-like imagery, this work increases data availability for improved earth monitoring. The results validate CGANs for cross-sensor domain adaptation and provide a reusable computational framework for satellite image translation.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Cascade conditional generative adversarial nets for spatial-spectral hyperspectral sample generation
    Xiaobo LIU
    Yulin QIAO
    Yonghua XIONG
    Zhihua CAI
    Peng LIU
    Science China(Information Sciences), 2020, 63 (04) : 81 - 96
  • [42] Cascade conditional generative adversarial nets for spatial-spectral hyperspectral sample generation
    Liu, Xiaobo
    Qiao, Yulin
    Xiong, Yonghua
    Cai, Zhihua
    Liu, Peng
    SCIENCE CHINA-INFORMATION SCIENCES, 2020, 63 (04)
  • [43] Anomaly detection of adversarial examples using class-conditional generative adversarial networks
    Wang, Hang
    Miller, David J.
    Kesidis, George
    COMPUTERS & SECURITY, 2023, 124
  • [44] Spatiotemporal Fusion Modelling Using STARFM: Examples of Landsat 8 and Sentinel-2 NDVI in Bavaria
    Dhillon, Maninder Singh
    Dahms, Thorsten
    Kuebert-Flock, Carina
    Steffan-Dewenter, Ingolf
    Zhang, Jie
    Ullmann, Tobias
    REMOTE SENSING, 2022, 14 (03)
  • [45] Fusing Sentinel-2 and Landsat 8 Satellite Images Using a Model-Based Method
    Sigurdsson, Jakob
    Armannsson, Sveinn E.
    Ulfarsson, Magnus O.
    Sveinsson, Johannes R.
    REMOTE SENSING, 2022, 14 (13)
  • [46] Evaluation of soil fertility using combination of Landsat 8 and Sentinel-2 data in agricultural lands
    Zhang, Ming
    Aqdam, Mohammad Khosravi
    Fadel, Hassan Abbas
    Wang, Lei
    Waheeb, Khlood
    Kadhim, Angham
    Hekmati, Jamal
    ENVIRONMENTAL MONITORING AND ASSESSMENT, 2024, 196 (02)
  • [47] Bayesian inversion of a forest reflectance model using Sentinel-2 and Landsat 8 satellite images
    Schraik, Daniel
    Varvia, Petri
    Korhonen, Lauri
    Rautiaine, Miina
    JOURNAL OF QUANTITATIVE SPECTROSCOPY & RADIATIVE TRANSFER, 2019, 233 : 1 - 12
  • [48] Spatial resolution enhancement method for Landsat imagery using a Generative Adversarial Network
    Pham, Vu-Dong
    Bui, Quang-Thanh
    REMOTE SENSING LETTERS, 2021, 12 (07) : 654 - 665
  • [49] SHIFT: speedy histopathological-to-immunofluorescent translation of whole slide images using conditional generative adversarial networks
    Burlingame, Erik A.
    Margolin, Adam A.
    Gray, Joe W.
    Chang, Young Hwan
    MEDICAL IMAGING 2018: DIGITAL PATHOLOGY, 2018, 10581
  • [50] Landsat Super-Resolution Enhancement Using Convolution Neural Networks and Sentinel-2 for Training
    Pouliot, Darren
    Latifovic, Rasim
    Pasher, Jon
    Duffe, Jason
    REMOTE SENSING, 2018, 10 (03)