Eigenimage2Eigenimage (E2E): A Self-Supervised Deep Learning Network for Hyperspectral Image Denoising

被引:28
|
作者
Zhuang, Lina [1 ]
Ng, Michael K. [2 ]
Gao, Lianru [1 ]
Michalski, Joseph [3 ,4 ]
Wang, Zhicheng [3 ,4 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[2] Univ Hong Kong, Dept Math, Hong Kong, Peoples R China
[3] Univ Hong Kong, Dept Earth Sci, Hong Kong, Peoples R China
[4] Univ Hong Kong, Lab Space Res, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Convolutional neural network; deep neural network; hyperspectral image (HSI) restoration; low-rank representation; self-supervised learning; subspace representation;
D O I
10.1109/TNNLS.2023.3293328
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The performance of deep learning-based denoisers highly depends on the quantity and quality of training data. However, paired noisy-clean training images are generally unavailable in hyperspectral remote sensing areas. To solve this problem, this work resorts to the self-supervised learning technique, where our proposed model can train itself to learn one part of noisy input from another part of noisy input. We study a general hyperspectral image (HSI) denoising framework, called Eigenimage2Eigenimage (E2E), which turns the HSI denoising problem into an eigenimage (i.e., the subspace representation coefficients of the HSI) denoising problem and proposes a learning strategy to generate noisy-noisy paired training eigenimages from noisy eigenimages. Consequently, the E2E denoising framework can be trained without clean data and applied to denoise HSIs without the constraint with the number of frequency bands. Experimental results are provided to demonstrate the performance of the proposed method that is better than the other existing deep learning methods for denoising HSIs. A MATLAB demo of this work is available at https://github.com/LinaZhuang/HSI-denoiser-Eigenimage2Eigenimagehttps://github.com/LinaZhuang/HSI-denoiser-Eigenimage2Eigenimage for the sake of reproducibility.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 50 条
  • [1] NVST Image Denoising Based on Self-Supervised Deep Learning
    Lu Xianwei
    Liu Hui
    Shang Zhenhong
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (06)
  • [2] Comparison between Supervised and Self-supervised Deep Learning for SEM Image Denoising
    Okud, Tomoyuki
    Chen, Jun
    Motoyoshi, Takahiro
    Yumiba, Ryou
    Ishikawa, Masayoshi
    Toyoda, Yasutaka
    [J]. METROLOGY, INSPECTION, AND PROCESS CONTROL XXXVII, 2023, 12496
  • [3] Deep Self-Supervised Hyperspectral Image Reconstruction
    Liu, Zhe
    Han, Xian-Hua
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (03)
  • [4] Self-supervised Hyperspectral and Multispectral Image Fusion in Deep Neural Network
    Gao, Jianhao
    Li, Jie
    Yuan, Qiangqiang
    He, Jiang
    Su, Xin
    [J]. IMAGE AND GRAPHICS (ICIG 2021), PT III, 2021, 12890 : 425 - 436
  • [5] Seismic Data Denoising Using a Self-Supervised Deep Learning Network
    Wang, Detao
    Chen, Guoxiong
    Chen, Jianwei
    Cheng, Qiuming
    [J]. MATHEMATICAL GEOSCIENCES, 2024, 56 (03) : 487 - 510
  • [6] Neighbor2Neighbor: A Self-Supervised Framework for Deep Image Denoising
    Huang, Tao
    Li, Songjiang
    Jia, Xu
    Lu, Huchuan
    Liu, Jianzhuang
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 4023 - 4038
  • [7] Seismic Data Denoising Using a Self-Supervised Deep Learning Network
    Detao Wang
    Guoxiong Chen
    Jianwei Chen
    Qiuming Cheng
    [J]. Mathematical Geosciences, 2024, 56 : 487 - 510
  • [8] Self-Supervised Denoising of single OCT image with Self2Self-OCT Network
    Ge, Chenkun
    Yu, Xiaojun
    Li, Mingshuai
    Mo, Jianhua
    [J]. 2022 IEEE 7TH OPTOELECTRONICS GLOBAL CONFERENCE, OGC, 2022, : 200 - 204
  • [9] Self2Self With Dropout: Learning Self-Supervised Denoising From Single Image
    Quan, Yuhui
    Chen, Mingqin
    Pang, Tongyao
    Ji, Hui
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1887 - 1895
  • [10] Self-Supervised Deep Learning for Low-Dose CT Image Denoising
    Bai, T.
    Nguyen, D.
    Jiang, S.
    [J]. MEDICAL PHYSICS, 2020, 47 (06) : E658 - E658