SMDS-Net: Model Guided Spectral-Spatial Network for Hyperspectral Image Denoising

被引:45
|
作者
Xiong, Fengchao [1 ,2 ,3 ]
Zhou, Jun [4 ]
Tao, Shuyin [1 ]
Lu, Jianfeng [1 ]
Zhou, Jiantao [5 ]
Qian, Yuntao [6 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Nanjing 210094, Peoples R China
[3] Univ Macau, Dept Comp & Informat Sci, State Key Lab Internet Things Smart City, Macau 999078, Peoples R China
[4] Griffith Univ, Sch Informat & Commun Technol, Nathan, Qld 4111, Australia
[5] Univ Macau, Dept Comp & Informat Sci, State Key Lab Internet Things Smart City, Macau 999078, Peoples R China
[6] Zhejiang Univ, Coll Comp Sci, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Noise reduction; Noise measurement; Correlation; Neural networks; Training; Tensors; Sensors; Hyperspectral image denoising; model-based neural network; low-rank representation; multidimensional sparse representation; RESTORATION; REPRESENTATION; ALGORITHM; FILTER; CNN;
D O I
10.1109/TIP.2022.3196826
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning (DL) based hyperspectral images (HSIs) denoising approaches directly learn the nonlinear mapping between noisy and clean HSI pairs. They usually do not consider the physical characteristics of HSIs. This drawback makes the models lack interpretability that is key to understanding their denoising mechanism and limits their denoising ability. In this paper, we introduce a novel model-guided interpretable network for HSI denoising to tackle this problem. Fully considering the spatial redundancy, spectral low-rankness, and spectral-spatial correlations of HSIs, we first establish a subspace-based multidimensional sparse (SMDS) model under the umbrella of tensor notation. After that, the model is unfolded into an end-to-end network named SMDS-Net, whose fundamental modules are seamlessly connected with the denoising procedure and optimization of the SMDS model. This makes SMDS-Net convey clear physical meanings, i.e., learning the low-rankness and sparsity of HSIs. Finally, all key variables are obtained by discriminative training. Extensive experiments and comprehensive analysis on synthetic and real-world HSIs confirm the strong denoising ability, strong learning capability, promising generalization ability, and high interpretability of SMDS-Net against the state-of-the-art HSI denoising methods. The source code and data of this article will be made publicly available at https://github.com/bearshng/smds-net for reproducible research.
引用
收藏
页码:5469 / 5483
页数:15
相关论文
共 50 条
  • [21] Deep Convolutional Capsule Network for Hyperspectral Image Spectral and Spectral-Spatial Classification
    Zhu, Kaiqiang
    Chen, Yushi
    Ghamisi, Pedram
    Jia, Xiuping
    Benediktsson, Jon Atli
    REMOTE SENSING, 2019, 11 (03)
  • [22] Hyperspectral Image Classification using Combined Spectral-Spatial Denoising and Deep Learning Techniques
    Miclea, Andreia Valentina
    Terebes, Romulus
    Ilea, Ioana
    Borda, Monica
    2018 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION, QUALITY AND TESTING, ROBOTICS (AQTR), 2018,
  • [23] Low-Rank and Spectral-Spatial Variation Regularized Hyperspectral Image Denoising Algorithm
    Liu, Yanhui
    Wang, Weiguo
    FOURTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING, ICGIP 2022, 2022, 12705
  • [24] Enhanced Spectral-Spatial Residual Attention Network for Hyperspectral Image Classification
    Zhan, Yanting
    Wu, Ke
    Dong, Yanni
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 7171 - 7186
  • [25] Spectral-spatial dynamic graph convolutional network for hyperspectral image classification
    Chen, Rong
    Li, Guanghui
    Dai, Chenglong
    EARTH SCIENCE INFORMATICS, 2023, 16 (04) : 3679 - 3695
  • [26] Spectral-Spatial MLP Network for Hyperspectral Image Super-Resolution
    Yao, Yunze
    Hu, Jianwen
    Liu, Yaoting
    Zhao, Yushan
    REMOTE SENSING, 2023, 15 (12)
  • [27] Cross-Attention Spectral-Spatial Network for Hyperspectral Image Classification
    Yang, Kai
    Sun, Hao
    Zou, Chunbo
    Lu, Xiaoqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [28] SSBFNet: a spectral-spatial fusion with BiFormer network for hyperspectral image classification
    Wu, Honglin
    Yu, Xinyu
    Zeng, Zhaobin
    VISUAL COMPUTER, 2024,
  • [29] Cooperative Spectral-Spatial Attention Dense Network for Hyperspectral Image Classification
    Dong, Zhimin
    Cai, Yaoming
    Cai, Zhihua
    Liu, Xiaobo
    Yang, Zhaoyu
    Zhuge, Mingchen
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (05) : 866 - 870
  • [30] Spectral-Spatial Graph Attention Network for Semisupervised Hyperspectral Image Classification
    Zhao, Zhengang
    Wang, Hao
    Yu, Xianchuan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19