Task-Driven Learned Hyperspectral Data Reduction Using End-to-End Supervised Deep Learning

被引:8
|
作者
Zeegers, Mathe T. [1 ]
Pelt, Daniel M. [1 ,2 ]
van Leeuwen, Tristan [1 ,3 ]
van Liere, Robert [1 ,4 ]
Batenburg, Kees Joost [1 ,2 ]
机构
[1] Ctr Wiskunde & Informat, Sci Pk 123, NL-1098 XG Amsterdam, Netherlands
[2] Leiden Inst Adv Comp Sci, Niels Bohrweg 1, NL-2333 CA Leiden, Netherlands
[3] Univ Utrecht, Math Inst, Budapestlaan 6, NL-3584 CD Utrecht, Netherlands
[4] Tech Univ Eindhoven, Fac Wiskunde & Informat, Groene Loper 5, NL-5612 AZ Eindhoven, Netherlands
关键词
hyperspectral imaging; feature extraction; compression; machine learning; deep learning; convolutional neural network; segmentation; IMAGE CLASSIFICATION; FEATURE-EXTRACTION; FUSION;
D O I
10.3390/jimaging6120132
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
An important challenge in hyperspectral imaging tasks is to cope with the large number of spectral bins. Common spectral data reduction methods do not take prior knowledge about the task into account. Consequently, sparsely occurring features that may be essential for the imaging task may not be preserved in the data reduction step. Convolutional neural network (CNN) approaches are capable of learning the specific features relevant to the particular imaging task, but applying them directly to the spectral input data is constrained by the computational efficiency. We propose a novel supervised deep learning approach for combining data reduction and image analysis in an end-to-end architecture. In our approach, the neural network component that performs the reduction is trained such that image features most relevant for the task are preserved in the reduction step. Results for two convolutional neural network architectures and two types of generated datasets show that the proposed Data Reduction CNN (DRCNN) approach can produce more accurate results than existing popular data reduction methods, and can be used in a wide range of problem settings. The integration of knowledge about the task allows for more image compression and higher accuracies compared to standard data reduction methods.
引用
收藏
页数:28
相关论文
共 50 条
  • [31] End-to-End Optimization of Deep Learning Applications
    Sohrabizadeh, Atefeh
    Wang, Jie
    Cong, Jason
    2020 ACM/SIGDA INTERNATIONAL SYMPOSIUM ON FIELD-PROGRAMMABLE GATE ARRAYS (FPGA '20), 2020, : 133 - 139
  • [32] Spline Filters For End-to-End Deep Learning
    Balestriero, Randall
    Cosentino, Romain
    Glotin, Herve
    Baraniuk, Richard
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [33] End-to-end Deep Learning of Optimization Heuristics
    Cummins, Chris
    Petoumenos, Pavlos
    Wang, Zheng
    Leather, Hugh
    2017 26TH INTERNATIONAL CONFERENCE ON PARALLEL ARCHITECTURES AND COMPILATION TECHNIQUES (PACT), 2017, : 219 - 232
  • [34] Deep Learning in Physical Layer: Review on Data Driven End-to-End Communication Systems and Their Enabling Semantic Applications
    Islam, Nazmul
    Shin, Seokjoo
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2024, 5 : 4207 - 4240
  • [35] End-to-End Multi-Task Learning with Attention
    Liu, Shikun
    Johns, Edward
    Davison, Andrew J.
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 1871 - 1880
  • [36] End-to-end semi-supervised deep learning model for surface crack detection of infrastructures
    Mohammed, Mohammed Ameen
    Han, Zheng
    Li, Yange
    Al-Huda, Zaid
    Li, Changli
    Wang, Weidong
    FRONTIERS IN MATERIALS, 2022, 9
  • [37] Classification of ALS Point Clouds Using End-to-End Deep Learning
    Winiwarter, Lukas
    Mandiburger, Gottfried
    Schmohl, Stefan
    Pfeifer, Norbert
    PFG-JOURNAL OF PHOTOGRAMMETRY REMOTE SENSING AND GEOINFORMATION SCIENCE, 2019, 87 (03): : 75 - 90
  • [38] FinSNet: End-to-End Separation of Overlapped Fingerprints Using Deep Learning
    Yoo, Dongheon
    Cho, Jaebum
    Lee, Juhyun
    Chae, Minseok
    Lee, Byounghyo
    Lee, Byoungho
    IEEE ACCESS, 2020, 8 : 209020 - 209029
  • [39] Agile Autonomous Driving using End-to-End Deep Imitation Learning
    Pan, Yunpeng
    Cheng, Ching-An
    Saigol, Kamil
    Lee, Keuntaek
    Yan, Xinyan
    Theodorou, Evangelos A.
    Boots, Byron
    ROBOTICS: SCIENCE AND SYSTEMS XIV, 2018,
  • [40] An end-to-end approach to autonomous vehicle control using deep learning
    Magera Novello, Gustavo Antonio
    Yamamoto, Henrique Yda
    Lustosa Cabral, Eduardo Lobo
    REVISTA BRASILEIRA DE COMPUTACAO APLICADA, 2021, 13 (03): : 32 - 41