Learning Deep Resonant Prior for Hyperspectral Image Super-Resolution

被引:8
|
作者
Gong, Zhaori [1 ]
Wang, Nannan [1 ]
Cheng, De [1 ]
Jiang, Xinrui [1 ]
Xin, Jingwei [1 ]
Yang, Xi [1 ]
Gao, Xinbo [2 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, State Key Lab Integrated Serv Networks, Xian 710071, Shaanxi, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Chongqing Key Lab Image Cognit, Chongqing 400065, Peoples R China
基金
中国国家自然科学基金;
关键词
Superresolution; Task analysis; Hyperspectral imaging; Electronics packaging; Convolutional neural networks; Correlation; Spatial resolution; Deep convolutional neural network (DCNN); hyperspectral remote sensing; image super-resolution;
D O I
10.1109/TGRS.2022.3185647
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The hyperspectral image super-resolution (HSISR) task has been widely studied, and significant progress has been made by leveraging the deep convolution neural network (CNN) techniques. Nevertheless, the scarcity of training images hinders the research progress of the HSISR task. Moreover, the differences in imaging conditions and the number of spectral bands among different datasets make it very difficult to construct a unified deep neural network. In this article, we first present a nontraining-based HSISR method based on deep prior knowledge, which captures the image before restoring the high-resolution image by using the intrinsic characteristics of CNN. Then, we append a special network input processing module (IPM) onto the HSISR network to automatically adjust the structure of the input so that the choice of network structure is no longer limited, while the network design focuses on exploiting the spatial information of hyperspectral images (HSIs) and the correlation between spectral bands, making the method more suitable for HSISR tasks and greatly extending its applications. Extensive experimental results on the HSI datasets illustrate the effectiveness of the proposed method, and we have got comparable results with the state-of-the-art methods while requiring no training samples.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] A Review of Hyperspectral Image Super-Resolution Based on Deep Learning
    Chen, Chi
    Wang, Yongcheng
    Zhang, Ning
    Zhang, Yuxi
    Zhao, Zhikang
    [J]. REMOTE SENSING, 2023, 15 (11)
  • [2] Deep Image and Kernel Prior Learning for Blind Super-Resolution
    Yamawaki, Kazuhiro
    Han, Xian-Hua
    [J]. PROCEEDINGS OF THE 4TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA IN ASIA, MMASIA 2022, 2022,
  • [3] Deep Hyperspectral Prior: Single-Image Denoising, Inpainting, Super-Resolution
    Sidorov, Oleksii
    Hardeberg, Jon
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3844 - 3851
  • [4] Deep Blind Hyperspectral Image Super-Resolution
    Zhang, Lei
    Nie, Jiangtao
    Wei, Wei
    Li, Yong
    Zhang, Yanning
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (06) : 2388 - 2400
  • [5] Hyperspectral Image Super-Resolution via Deep Prior Regularization With Parameter Estimation
    Wang, Xiuheng
    Chen, Jie
    Wei, Qi
    Richard, Cedric
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (04) : 1708 - 1723
  • [6] Exploring the Spectral Prior for Hyperspectral Image Super-Resolution
    Hu, Qian
    Wang, Xinya
    Jiang, Junjun
    Zhang, Xiao-Ping
    Ma, Jiayi
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 5260 - 5272
  • [7] Hyperspectral Image Super-Resolution Meets Deep Learning: A Survey and Perspective
    Wang, Xinya
    Hu, Qian
    Cheng, Yingsong
    Ma, Jiayi
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2023, 10 (08) : 1668 - 1691
  • [8] Hyperspectral image super-resolution combining with deep learning and spectral unmixing
    Zou, Changzhong
    Huang, Xusheng
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 84
  • [9] Hyperspectral Image Super-Resolution Meets Deep Learning: A Survey and Perspective
    Xinya Wang
    Qian Hu
    Yingsong Cheng
    Jiayi Ma
    [J]. IEEE/CAA Journal of Automatica Sinica, 2023, 10 (08) : 1668 - 1691
  • [10] Deep learning for image super-resolution
    Yang, Wenming
    Zhou, Fei
    Zhu, Rui
    Fukui, Kazuhiro
    Wang, Guijin
    Xue, Jing-Hao
    [J]. NEUROCOMPUTING, 2020, 398 (398) : 291 - 292