Spatial and Spectral Translation of Landsat 8 to Sentinel-2 Using Conditional Generative Adversarial Networks

被引:0
|
作者
Mukherjee, Rohit [1 ]
Liu, Desheng [2 ]
机构
[1] Univ Arizona, Sch Geog Dev & Environm, Tucson, AZ 85721 USA
[2] Ohio State Univ, Dept Geog, Columbus, OH 43210 USA
关键词
Sentinel-2; Landsat; 8; image translation; generative adversarial network; spectral resolution; spatial resolution; RED-EDGE BANDS; TIME-SERIES; IMAGES; OLI; MSI;
D O I
10.3390/rs15235502
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Satellite sensors like Landsat 8 OLI (L8) and Sentinel-2 MSI (S2) provide valuable multispectral Earth observations that differ in spatial resolution and spectral bands, limiting synergistic use. L8 has a 30 m resolution and a lower revisit frequency, while S2 offers up to a 10 m resolution and more spectral bands, such as red edge bands. Translating observations from L8 to S2 can increase data availability by combining their images to leverage the unique strengths of each product. In this study, a conditional generative adversarial network (CGAN) is developed to perform sensor-specific domain translation focused on green, near-infrared (NIR), and red edge bands. The models were trained on the pairs of co-located L8-S2 imagery from multiple locations. The CGAN aims to downscale 30 m L8 bands to 10 m S2-like green and 20 m S2-like NIR and red edge bands. Two translation methodologies are employed-direct single-step translation from L8 to S2 and indirect multistep translation. The direct approach involves predicting the S2-like bands in a single step from L8 bands. The multistep approach uses two steps-the initial model predicts the corresponding S2-like band that is available in L8, and then the final model predicts the unavailable S2-like red edge bands from the S2-like band predicted in the first step. Quantitative evaluation reveals that both approaches result in lower spectral distortion and higher spatial correlation compared to native L8 bands. Qualitative analysis supports the superior fidelity and robustness achieved through multistep translation. By translating L8 bands to higher spatial and spectral S2-like imagery, this work increases data availability for improved earth monitoring. The results validate CGANs for cross-sensor domain adaptation and provide a reusable computational framework for satellite image translation.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Text to Image Translation using Generative Adversarial Networks
    Viswanathan, Adithya
    Mehta, Bhavin
    Bhavatarini, M. P.
    Mamatha, H. R.
    2018 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2018, : 1468 - 1474
  • [22] Improved Conditional Generative Adversarial Networks for SAR-to-Optical Image Translation
    Zhan, Tao
    Bian, Jiarong
    Yang, Jing
    Dang, Qianlong
    Zhang, Erlei
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT IV, 2024, 14428 : 279 - 291
  • [23] Enhanced dataset synthesis using conditional generative adversarial networks
    Mert, Ahmet
    BIOMEDICAL ENGINEERING LETTERS, 2023, 13 (01) : 41 - 48
  • [24] Interpreting CNN predictions using conditional Generative Adversarial Networks
    Guna, R. T. Akash
    Sikha, O. K.
    Benitez, Raul
    KNOWLEDGE-BASED SYSTEMS, 2024, 302
  • [25] Using Generative Adversarial Networks for Conditional Creation of Anime Posters
    Sankalpa, Donthi
    Ramesh, Jayroop
    Zualkernan, Imran
    Proceedings of the 2022 IEEE International Conference on Industry 4.0, Artificial Intelligence, and Communications Technology, IAICT 2022, 2022, : 197 - 203
  • [26] Vein Pattern Visualisation using Conditional Generative Adversarial Networks
    Keivanmarz, Ali
    Sharifzadeh, Hamid
    Fleming, Rachel
    2020 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2020, : 1310 - 1316
  • [27] Fringe pattern normalization using conditional Generative Adversarial Networks
    Ram, Viren S.
    Gannavarpu, Rajshekhar
    Optik, 2024, 313
  • [28] Enhanced dataset synthesis using conditional generative adversarial networks
    Ahmet Mert
    Biomedical Engineering Letters, 2023, 13 : 41 - 48
  • [29] Airfoil Inverse Design using Conditional Generative Adversarial Networks
    Tan, Xavier
    Manna, Dai
    Chattoraj, Joyjit
    Liu Yong
    Xu Xinxing
    Ha, Dao My
    Yang Feng
    2022 17TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV), 2022, : 143 - 148
  • [30] Structure Improved Conditional Spectral Normalization Generative Adversarial Networks for Image Recognition
    Xie, Tao
    Du, Yiming
    Wang, Ting
    Hao, Bohui
    Liu, Qing
    Tang, Xianlun
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 842 - 846