Spatial-spectral feature deep extraction based on a multichannel grouping fusion module for multispectral image compression

被引:1
|
作者
Kong, Fangqiang [1 ]
Wang, Kang [1 ]
Li, Dan [1 ]
Hu, Kedi [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Astronaut, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
deep learning; multispectral image compression; end-to-end compression; lasers; spatial-spectral features; LOSSLESS COMPRESSION;
D O I
10.1117/1.JEI.31.3.033024
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the continuous improvement of spatial and spectral resolution, the application of multispectral images has greatly increased in remote sensing. However, the amount of image data also increases sharply, which brings great pressure to data storage and transmission. To solve this issue, we propose an end-to-end image compression scheme according to spatial- spectral feature extraction, which can be implemented by a spatial-spectral memory unit (SSMU). Furthermore, to improve the feature extraction capability of this deep network, the multichannel grouping fusion module is adopted to reconstruct and fuse the image features. In the encoder of the proposed compression scheme, the SSMU first extracts spatial-spectral features along the spatial direction and the spectral direction, and the multichannel grouping fusion module extracts the spatial and spectral features of different levels by recombination and fusion of band features of multispectral images. Then, the extracted deep spatial and spectral features are compressed by downsampling. Next, the quantizer and entropy coding convert the data into a compressed bitstream. In the decoder, a reverse process is used to restore the original images. The experiments take the multispectral images of Landsat 8 and WorldView3 as the datasets to verify the superiority of our method and compare it with JPEG2000, 3D-SPIHT, and the CNN-based methods. The results show that the proposed method outperforms the JPEG2000, 3D-SPIHT, and CNN-based methods in PSNR, spectral similarity, and spectral angle mapping metrics at different bit rates. (C) 2022 SPIE and IS&T
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Spectral-Spatial Feature Partitioned Extraction Based on CNN for Multispectral Image Compression
    Kong, Fanqiang
    Hu, Kedi
    Li, Yunsong
    Li, Dan
    Zhao, Shunmin
    [J]. REMOTE SENSING, 2021, 13 (01) : 1 - 20
  • [2] Multispectral and hyperspectral image fusion with spatial-spectral sparse representation
    Dian, Renwei
    Li, Shutao
    Fang, Leyuan
    Wei, Qi
    [J]. INFORMATION FUSION, 2019, 49 : 262 - 270
  • [3] Feature Fusion Classification for Optical Image and SAR Image Based on Spatial-spectral Attention
    Jiang, Wen
    Pan, Jie
    Zhu, Jinbiao
    Yue, Xijuan
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (03) : 987 - 995
  • [4] Dual-branch spectral–spatial feature extraction network for multispectral image compression
    Fanqiang Kong
    Jiahui Tang
    Yunsong Li
    Dan Li
    Kedi Hu
    [J]. Multimedia Systems, 2023, 29 : 3579 - 3597
  • [5] PASSNet: A Spatial-Spectral Feature Extraction Network With Patch Attention Module for Hyperspectral Image Classification
    Ji, Renjie
    Tan, Kun
    Wang, Xue
    Pan, Chen
    Xin, Liang
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [6] A Spectral-Spatial Feature Extraction Method With Polydirectional CNN for Multispectral Image Compression
    Kong, Fanqiang
    Hu, Kedi
    Li, Yunsong
    Li, Dan
    Liu, Xin
    Durrani, Tariq S.
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 2745 - 2758
  • [7] Multiscale spatial-spectral transformer network for hyperspectral and multispectral image fusion
    Jia, Sen
    Min, Zhichao
    Fu, Xiyou
    [J]. INFORMATION FUSION, 2023, 96 : 117 - 129
  • [8] Deep CNN-based hyperspectral image classification using discriminative multiple spatial-spectral feature fusion
    Guo, Hao
    Liu, Jianjun
    Xiao, Zhiyong
    Xiao, Liang
    [J]. REMOTE SENSING LETTERS, 2020, 11 (09) : 827 - 836
  • [9] Dual-branch spectral-spatial feature extraction network for multispectral image compression
    Kong, Fanqiang
    Tang, Jiahui
    Li, Yunsong
    Li, Dan
    Hu, Kedi
    [J]. MULTIMEDIA SYSTEMS, 2023, 29 (06) : 3579 - 3597
  • [10] Spectral-Spatial Feature Completely Separated Extraction with Tensor CNN for Multispectral Image Compression
    Cao, Tongbo
    Zhang, Ning
    Zhao, Shunmin
    Hu, Kedi
    Wang, Kang
    [J]. COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, VOL. 1, 2022, 878 : 870 - 875