Optical Imaging Degradation Simulation and Transformer-Based Image Restoration for Remote Sensing

被引:0
|
作者
Wei, Hua [1 ]
Gao, Kun [2 ]
Wang, Jing [1 ]
Tang, Qiuyan [1 ]
Tang, Xiongxin [1 ]
Xu, Fanjiang [1 ]
机构
[1] Chinese Acad Sci, Inst Software, Beijing 100190, Peoples R China
[2] Beijing Inst Technol, Minist Educ China, Key Lab Photoelect Imaging Technol & Syst, Beijing 100081, Peoples R China
关键词
Image restoration; multilevel feature fusion (MFF); self-attention; Zernike polynomial;
D O I
10.1109/LGRS.2024.3381581
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Due to atmospheric turbulence, optical system limitations, satellite platform jitter, and other reasons, remote-sensing images inevitably undergo different degrees of degradation. Employing the deep-learning method to improve the on-orbit image quality faces many challenges such as lack of data, limited computing resources, network architecture design, and so on. Among these factors, establishing a physics-guided dataset during the image restoration stage and avoiding unforeseen effects such as ringing pose a significant challenge for remote-sensing image restoration. This letter proposes an optical imaging degradation simulation model and transformer-based algorithm to improve remote-sensing image quality. First, we model the degradation result from phase to image of optical remote-sensing imaging using Zernike polynomials, thus, a large-scale paired dataset is constructed. Then, a multilevel feature fusion transformer (MFFormer) is introduced to mitigate the defect during restoration. The proposed algorithm incorporates a multilevel feature fusion (MFF) module to fuse feature information from multiscales effectively. Additionally, a multilevel space and frequency loss function is introduced to enhance the learning of high-frequency information to ensure that the edge suppresses noise amplification and ringing effects during recovery. Finally, experimental results on synthetic data show that our method improved by 25.4% and 22.3% with the blurred images on the peak signal-to-noise ratio (PSNR) and the structural similarity (SSIM) index. Visual results on the GaoFen-1/2A PMS images have enhanced clarity and suppressed artifacts such as ringing which demonstrate the effectiveness and capability of our proposed method.
引用
收藏
页码:1 / 5
页数:5
相关论文
共 50 条
  • [1] Aware-Transformer: A Novel Pure Transformer-Based Model for Remote Sensing Image Captioning
    Cao, Yukun
    Yan, Jialuo
    Tang, Yijia
    He, Zhenyi
    Xu, Kangle
    Cheng, Yu
    [J]. ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT I, 2024, 14495 : 105 - 117
  • [2] Transformer-Based Multistage Enhancement for Remote Sensing Image Super-Resolution
    Lei, Sen
    Shi, Zhenwei
    Mo, Wenjing
    [J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60
  • [3] An Implicit Transformer-based Fusion Method for Hyperspectral and Multispectral Remote Sensing Image
    Zhu, Chunyu
    Zhang, Tinghao
    Wu, Qiong
    Li, Yachao
    Zhong, Qin
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 131
  • [4] Transformer-Based Multistage Enhancement for Remote Sensing Image Super-Resolution
    Lei, Sen
    Shi, Zhenwei
    Mo, Wenjing
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] A method for remote sensing image restoration based on the system degradation model
    Zhang, Pengfei
    Gong, Jinnan
    Jiang, Shikai
    Shi, Tianjun
    Yang, Jiawei
    Bao, Guangzhen
    Zhi, Xiyang
    [J]. RESULTS IN PHYSICS, 2024, 56
  • [6] TCIANet: Transformer-Based Context Information Aggregation Network for Remote Sensing Image Change Detection
    Xu, Xintao
    Li, Jinjiang
    Chen, Zheng
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 1951 - 1971
  • [7] Transformer-Based Regression Network for Pansharpening Remote Sensing Images
    Su, Xunyang
    Li, Jinjiang
    Hua, Zhen
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Imaging Simulation and Learning-Based Image Restoration for Remote Sensing Time Delay and Integration Cameras
    Li, Menghao
    Zhang, Ziran
    Chen, Shiqi
    Xu, Zhihai
    Li, Qi
    Feng, Huajun
    Chen, Yueting
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [9] Deep Multi-Scale Transformer for Remote Sensing Image Restoration
    Li, Yanting
    [J]. 2024 5TH INTERNATIONAL CONFERENCE ON GEOLOGY, MAPPING AND REMOTE SENSING, ICGMRS 2024, 2024, : 138 - 142
  • [10] TransCS: A Transformer-Based Hybrid Architecture for Image Compressed Sensing
    Shen, Minghe
    Gan, Hongping
    Ning, Chao
    Hua, Yi
    Zhang, Tao
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6991 - 7005