Task-Driven Learned Hyperspectral Data Reduction Using End-to-End Supervised Deep Learning

被引:8
|
作者
Zeegers, Mathe T. [1 ]
Pelt, Daniel M. [1 ,2 ]
van Leeuwen, Tristan [1 ,3 ]
van Liere, Robert [1 ,4 ]
Batenburg, Kees Joost [1 ,2 ]
机构
[1] Ctr Wiskunde & Informat, Sci Pk 123, NL-1098 XG Amsterdam, Netherlands
[2] Leiden Inst Adv Comp Sci, Niels Bohrweg 1, NL-2333 CA Leiden, Netherlands
[3] Univ Utrecht, Math Inst, Budapestlaan 6, NL-3584 CD Utrecht, Netherlands
[4] Tech Univ Eindhoven, Fac Wiskunde & Informat, Groene Loper 5, NL-5612 AZ Eindhoven, Netherlands
关键词
hyperspectral imaging; feature extraction; compression; machine learning; deep learning; convolutional neural network; segmentation; IMAGE CLASSIFICATION; FEATURE-EXTRACTION; FUSION;
D O I
10.3390/jimaging6120132
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
An important challenge in hyperspectral imaging tasks is to cope with the large number of spectral bins. Common spectral data reduction methods do not take prior knowledge about the task into account. Consequently, sparsely occurring features that may be essential for the imaging task may not be preserved in the data reduction step. Convolutional neural network (CNN) approaches are capable of learning the specific features relevant to the particular imaging task, but applying them directly to the spectral input data is constrained by the computational efficiency. We propose a novel supervised deep learning approach for combining data reduction and image analysis in an end-to-end architecture. In our approach, the neural network component that performs the reduction is trained such that image features most relevant for the task are preserved in the reduction step. Results for two convolutional neural network architectures and two types of generated datasets show that the proposed Data Reduction CNN (DRCNN) approach can produce more accurate results than existing popular data reduction methods, and can be used in a wide range of problem settings. The integration of knowledge about the task allows for more image compression and higher accuracies compared to standard data reduction methods.
引用
收藏
页数:28
相关论文
共 50 条
  • [21] Incorporating Deep Learning Model Development With an End-to-End Data Pipeline
    Zhang, Kaichong
    IEEE ACCESS, 2024, 12 : 127522 - 127531
  • [22] An end-to-end deep learning model for solving data-driven newsvendor problem with accessibility to textual review data
    Tian, Yu-Xin
    Zhang, Chuan
    INTERNATIONAL JOURNAL OF PRODUCTION ECONOMICS, 2023, 265
  • [23] End-to-end model for automatic seizure detection using supervised contrastive learning
    Li, Haotian
    Dong, Xingchen
    Zhong, Xiangwen
    Li, Chuanyu
    Cui, Haozhou
    Zhou, Weidong
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
  • [24] End-to-End Deep Learning CT Image Reconstruction for Metal Artifact Reduction
    Bauer, Dominik F.
    Ulrich, Constantin
    Russ, Tom
    Golla, Alena-Kathrin
    Schad, Lothar R.
    Zoellner, Frank G.
    APPLIED SCIENCES-BASEL, 2022, 12 (01):
  • [25] Mining Fashion Outfit Composition Using an End-to-End Deep Learning Approach on Set Data
    Li, Yuncheng
    Cao, Liangliang
    Zhu, Jiang
    Luo, Jiebo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2017, 19 (08) : 1946 - 1955
  • [26] Semisupervised Hyperspectral Classification Using Task-Driven Dictionary Learning With Laplacian Regularization
    Wang, Zhangyang
    Nasrabadi, Nasser M.
    Huang, Thomas S.
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (03): : 1161 - 1173
  • [27] An End-to-End Multi-Task Deep Learning Framework for Skin Lesion Analysis
    Song, Lei
    Lin, Jianzhe
    Wang, Z. Jane
    Wang, Haoqian
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (10) : 2912 - 2921
  • [28] An end-to-end multi-task deep learning framework for bronchoscopy image classification
    Setayeshi, Rojin
    Vahidi, Javad
    Kozegar, Ehsan
    Tan, Tao
    MULTIMEDIA SYSTEMS, 2024, 30 (06)
  • [29] End-to-End Deep Learning for Robotic Following
    Pierre, John M.
    ICMSCE 2018: PROCEEDINGS OF THE 2018 2ND INTERNATIONAL CONFERENCE ON MECHATRONICS SYSTEMS AND CONTROL ENGINEERING, 2015, : 77 - 85
  • [30] End-to-end deep learning with neuromorphic photonics
    Dabos, G.
    Mourgias-Alexandris, G.
    Totovic, A.
    Kirtas, M.
    Passalis, N.
    Tefas, A.
    Pleros, N.
    INTEGRATED OPTICS: DEVICES, MATERIALS, AND TECHNOLOGIES XXV, 2021, 11689