DeepCubeNet: reconstruction of spectrally compressive sensed hyperspectral images with deep neural networks

被引:30
|
作者
Gedalin, Daniel [1 ]
Oiknine, Yaniv [1 ]
Stern, Adrian [1 ]
机构
[1] Ben Gurion Univ Negev, Sch Elect & Comp Engn, Electroopt & Photon Dept, IL-84105 Beer Sheva, Israel
来源
OPTICS EXPRESS | 2019年 / 27卷 / 24期
关键词
LEARNING APPROACH; INVERSE PROBLEMS;
D O I
10.1364/OE.27.035811
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Several hyperspectral (HS) systems based on compressive sensing (CS) theory have been presented to capture HS images with high accuracy and with a lower number of measurements than needed by conventional systems. However, the reconstruction of HS compressed measurements is time-consuming and commonly involves hyperparameter tuning per each scenario. In this paper, we introduce a Convolutional Neural Network (CNN) designed for the reconstruction of HS cubes captured with CS imagers based on spectral modulation. Our Deep Neural Network (DNN), dubbed DeepCubeNet, provides significant reduction in the reconstruction time compared to classical iterative methods. The performance of DeepCubeNet is investigated on simulated data, and we demonstrate for the first time, to the best of our knowledge, real reconstruction of CS HS measurements using DNN. We demonstrate significantly enhanced reconstruction accuracy compared to iterative CS reconstruction, as well as improvement in reconstruction time by many orders of magnitude. (C) 2019 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
引用
收藏
页码:35811 / 35822
页数:12
相关论文
共 50 条
  • [1] Deep neural networks for compressive hyperspectral imaging
    Lee, Dennis J.
    [J]. IMAGING SPECTROMETRY XXIII: APPLICATIONS, SENSORS, AND PROCESSING, 2019, 11130
  • [2] Compressive hyperspectral image reconstruction with deep neural network
    Heiser, Yaron
    Oiknine, Yaniv
    Stern, Adrian
    [J]. BIG DATA: LEARNING, ANALYTICS, AND APPLICATIONS, 2019, 10989
  • [3] Hyperspectral Image Reconstruction of Heritage Artwork Using RGB Images and Deep Neural Networks
    Chen, Ailin
    Jesus, Rui
    Vilarigues, Marcia
    [J]. 19TH INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING, CBMI 2022, 2022, : 97 - 102
  • [4] Convolutional Neural Networks for Noniterative Reconstruction of Compressively Sensed Images
    Lohit, Suhas
    Kulkarni, Kuldeep
    Kerviche, Ronan
    Turaga, Pavan
    Ashok, Amit
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2018, 4 (03) : 326 - 340
  • [5] The application of convolutional neural networks for tomographic reconstruction of hyperspectral images
    Huang, Wei-Chih
    Peters, Mads Svanborg
    Ahlebaek, Mads Juul
    Frandsen, Mads Toudal
    Eriksen, Rene Lynge
    Jorgensen, Bjarke
    [J]. DISPLAYS, 2022, 74
  • [6] PIGMENT UNMIXING OF HYPERSPECTRAL IMAGES OF PAINTINGS USING DEEP NEURAL NETWORKS
    Rohani, Neda
    Pouyet, Emeline
    Walton, Marc
    Cossairt, Oliver
    Katsaggelos, Aggelos K.
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 3217 - 3221
  • [7] SUPERVISED CLASSIFICATION OF HYPERSPECTRAL IMAGES VIA HETEROGENEOUS DEEP NEURAL NETWORKS
    Li, Zhixin
    Shen, Yu
    Huang, Nan
    Xiao, Liang
    [J]. 2017 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2017, : 1812 - 1815
  • [8] SOLVING DEEP NEURAL NETWORKS WITH ORDINARY DIFFERENTIAL EQUATIONS FOR REMOTELY SENSED HYPERSPECTRAL IMAGE CLASSIFICATION
    Paoletti, M. E.
    Haut, J. M.
    Plaza, J.
    Plaza, A.
    [J]. 2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 576 - 579
  • [9] Deep neural networks can differentiate thyroid pathologies on infrared hyperspectral images
    Baffa, Matheus de Freitas Oliveira
    Zezell, Denise Maria
    Bachmann, Luciano
    Pereira, Thiago Martini
    Deserno, Thomas Martin
    Felipe, Joaquim Cezar
    [J]. Computer Methods and Programs in Biomedicine, 2024, 247
  • [10] Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks
    Chen, Yushi
    Jiang, Hanlu
    Li, Chunyang
    Jia, Xiuping
    Ghamisi, Pedram
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (10): : 6232 - 6251