A hyperspectral image reconstruction algorithm based on RGB image using multi-scale atrous residual convolution network

被引:7
|
作者
Hu, Shaoxiang [1 ]
Hou, Rong [2 ]
Ming, Luo [1 ]
Su, Meifang [1 ]
Chen, Peng [2 ]
机构
[1] Univ Elect Sci & Technol China, Sch Elect Sci & Engn, Chengdu, Peoples R China
[2] Sichuan Key Lab Conservat Biol Endangered Wildlife, Chengdu Res Base Giant Panda Breeding, Chengdu, Peoples R China
关键词
hyperspectral image reconstruction; deep learning; atrous convolution; marine science; multi-scale;
D O I
10.3389/fmars.2022.1006452
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Hyperspectral images are a valuable tool for remotely sensing important characteristics of a variety of landscapes, including water quality and the status of marine disasters. However, hyperspectral data are rare or expensive to obtain, which has spurred interest in low-cost, fast methods for reconstructing hyperspectral data from much more common RGB images. We designed a novel algorithm to achieve this goal using multi-scale atrous convolution residual network (MACRN). The algorithm includes three parts: low-level feature extraction, high-level feature extraction, and feature transformation. The high-level feature extraction module is composed of cascading multi-scale atrous convolution residual blocks (ACRB). It stacks multiple modules to form a depth network for extracting high-level features from the RGB image used as an input. The algorithm uses jump connection for residual learning, and the final high-level feature combines the output of the low-level feature extraction module and the output of the cascaded atrous convolution residual block element by element, so as to prevent gradient dispersion and gradient explosion in the deep network. Without adding too many parameters, the model can extract multi-scale features under different receptive fields, make better use of the spatial information in RGB images, and enrich the contextual information. As a proof of concept, we ran an experiment using the algorithm to reconstruct hyperspectral Sentinel-2 satellite data from the northern coast of Australia. The algorithm achieves hyperspectral spectral reconstruction in 443nm-2190nm band with less computational cost, and the results are stable. On the Realworld dataset, the reconstruction error MARE index is less than 0.0645, and the reconstruction time is less than 9.24S. Therefore, in the near infrared band, MACRN reconstruction accuracy is significantly better than other spectral reconstruction algorithms. MACRN hyperspectral reconstruction algorithm has the characteristics of low reconstruction cost and high reconstruction accuracy, and its advantages in ocean spectral reconstruction are more obvious.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Feature ensemble network for medical image segmentation with multi-scale atrous transformer
    Gai, Di
    Geng, Yuhan
    Huang, Xia
    Huang, Zheng
    Xiong, Xin
    Zhou, Ruihua
    Wang, Qi
    IET IMAGE PROCESSING, 2024, 18 (11) : 3082 - 3092
  • [42] An image super-resolution network based on multi-scale convolution fusion
    Yang, Xin
    Zhu, Yitian
    Guo, Yingqing
    Zhou, Dake
    VISUAL COMPUTER, 2022, 38 (12): : 4307 - 4317
  • [43] Single Image Dehazing Method Based on Multi-Scale Convolution Neural Network
    Chen Yong
    Guo Hongguang
    Ai Yapeng
    ACTA OPTICA SINICA, 2019, 39 (10)
  • [44] An image super-resolution network based on multi-scale convolution fusion
    Xin Yang
    Yitian Zhu
    Yingqing Guo
    Dake Zhou
    The Visual Computer, 2022, 38 : 4307 - 4317
  • [45] A 3-D Atrous Convolution Neural Network for Hyperspectral Image Denoising
    Liu, Wei
    Lee, Joonwhoan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (08): : 5701 - 5715
  • [46] Multi-scale generative adversarial network for image compressed sensing and reconstruction algorithm
    Zeng C.-Y.
    Yan K.
    Wang Z.-F.
    Wang Z.-H.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2023, 53 (10): : 2923 - 2931
  • [47] Analysis of hyperspectral image based on multi-scale cascaded convolutional neural network
    Zhu F.-L.
    Liu Y.
    Qiao X.
    He M.-Z.
    Zheng Z.-W.
    Sun L.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2023, 53 (12): : 3547 - 3557
  • [48] Multi-Scale Residual Fusion Network for Super-Resolution Reconstruction of Single Image
    Zhao, Baiting
    Hu, Rui
    Jia, Xiaofen
    Guo, Yongcun
    IEEE ACCESS, 2020, 8 : 155285 - 155295
  • [49] Multi-Scale Aggregation Stereo Matching Network Based on Dense Grouping Atrous Convolution
    Zou, Qijie
    Zhang, Jie
    Chen, Shuang
    Gao, Bing
    Qin, Jing
    Dong, Aotian
    APPLIED SCIENCES-BASEL, 2023, 13 (12):
  • [50] AN END-TO-END MULTI-SCALE RESIDUAL RECONSTRUCTION NETWORK FOR IMAGE COMPRESSIVE SENSING
    Liu, Renhe
    Li, Sumei
    Hou, Chunping
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2070 - 2074