End-to-end feature domain residual coding network for multispectral image compression based on interspectral prediction

被引:0
|
作者
Kong, Fanqiang [1 ]
Huang, Murong [1 ]
Tang, Jiahui [1 ]
Ren, Guanglong [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Astronaut, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
learned multispectral image compression; residual coding; interspectral prediction; spatial pyramid; autoencoder;
D O I
10.1117/1.JRS.18.036508
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
With the abilities of feature extraction and nonlinear representation, deep neural networks can remove spatial redundancy efficiently and perform well in terms of visible image compression. However, when it comes to multispectral images, it is necessary to consider both spatial and spectral redundancy. Based on this point, we propose an end-to-end feature domain residual coding network for multispectral image compression based on interspectral prediction. Specifically, a spatial-spectral feature extraction network and an interspectral prediction network are designed based on a pyramid structure, which can capture and fuse multi-scale features from coarse to fine. They make the best use of the spectral correlation to predict images accurately while combining with the feature domain residual coding network, which can further reduce the redundancy of spatial-spectral information. A single loss function jointly optimizes all modules in the network. There are lots of experiments with 8-band and 12-band multispectral image datasets. The experimental results demonstrate that the compression performance of the proposed method is superior to traditional compression methods (JPEG2000, 3D-SPIHT, Versatile Video Coding, PCA+JPEG2000) across evaluation indicators and even better than the advanced learned multispectral image compression algorithms.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] NN-based Embedment of Watermark in End-to-end Image Compression
    Lee, EunSeong
    Lee, Jongseok
    Seo, Young-Ho
    Sim, Donggyu
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY, IWAIT 2023, 2023, 12592
  • [32] Image Compression Based on Compressive Sensing: End-to-End Comparison With JPEG
    Yuan, Xin
    Haimi-Cohen, Raziel
    IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (11) : 2889 - 2904
  • [33] FUSENET: END-TO-END MULTISPECTRAL VHR IMAGE FUSION AND CLASSIFICATION
    Bergado, John Ray
    Persello, Claudio
    Stein, Alfred
    IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 2091 - 2094
  • [34] End-to-End Learning-Based Image Compression With a Decoupled Framework
    Zhang, Zhaobin
    Esenlik, Semih
    Wu, Yaojun
    Wang, Meng
    Zhang, Kai
    Zhang, Li
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (05) : 3067 - 3081
  • [35] Learning-based End-to-End Video Compression Using Predictive Coding
    de Oliveira, Matheus C.
    Martins, Luiz G. R.
    Jung, Henrique Costa
    Guerin Jr, Nilson Donizete
    da Silva, Renam Castro
    Peixoto, Eduardo
    Macchiavello, Bruno
    Hung, Edson M.
    Testoni, Vanessa
    Freitas, Pedro Garcia
    2021 34TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2021), 2021, : 160 - 167
  • [36] End-to-End ECG Signal Compression Based on Temporal Information and Residual Compensation
    Liu, Xingyu
    Zheng, Lesong
    Cheng, Yuhao
    Zhu, Wenliang
    Li, Jiacheng
    Liu, Jiangxu
    Lu, Sisi
    You, Binquan
    Wang, Lirong
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2024, : 2779 - 2801
  • [37] Attention-based end-to-end image defogging network
    Yang, Yan
    Zhang, Chen
    Jiang, Peipei
    Yue, Hui
    ELECTRONICS LETTERS, 2020, 56 (15) : 759 - +
  • [38] A deep learning network based end-to-end image composition
    Zhu, Xiaoyu
    Wang, Haodi
    Zhang, Zhiyi
    Wu, Xiuping
    Guo, Junqi
    Wu, Hao
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2022, 101
  • [39] An End-to-End Video Steganography Network Based on a Coding Unit Mask
    Chai, Huanhuan
    Li, Zhaohong
    Li, Fan
    Zhang, Zhenzhen
    ELECTRONICS, 2022, 11 (07)
  • [40] Low Rank Based End-to-End Deep Neural Network Compression
    Jain, Swayambhoo
    Hamidi-Rad, Shahab
    Racape, Fabien
    2021 DATA COMPRESSION CONFERENCE (DCC 2021), 2021, : 233 - 242