RATE-DISTORTION-OPTIMIZATION FOR DEEP IMAGE COMPRESSION

被引:3
|
作者
Schaefer, Michael [1 ]
Pientka, Sophie [1 ]
Pfaff, Jonathan [1 ]
Schwarz, Heiko [1 ]
Marpe, Detlev [1 ]
Wiegand, Thomas [1 ]
机构
[1] Fraunhofer Inst Telecommun, Video Commun & Applicat Dept, Heinrich Hertz Inst, Einsteinufer 37, D-10587 Berlin, Germany
关键词
High Efficiency Video Coding (HEVC); Versatile Video Coding (VVC); Deep Learning; Auto-Encoder; Rate-Distortion-Optimization;
D O I
10.1109/ICIP42928.2021.9506513
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Given the capabilities of massive GPU hardware, there has been a surge of using artificial neural networks (ANN) for still image compression. These compression systems usually consist of convolutional layers and can be considered as non-linear transform coding. Notably, these ANNs are based on an end-to-end approach where the encoder determines a compressed version of the image as features. In contrast to this, existing image and video codecs employ a block-based architecture with signal-dependent encoder optimizations. A basic requirement for designing such optimizations is estimating the impact of the quantization error on the resulting bitrate and distortion. As for non-linear, multi-layered neural networks, this is a difficult problem. This paper presents a performant auto-encoder architecture for still image compression, which represents the compressed features at multiple scales. Then, we demonstrate how an algorithm, which tests multiple feature candidates, can reduce the Lagrangian cost and optimize compression efficiency. The algorithm avoids multiple network executions by pre-estimating the impact of the quantization on the distortion by a higher-order polynomial.
引用
收藏
页码:3737 / 3741
页数:5
相关论文
共 50 条
  • [21] Rate-distortion optimized image compression based on image inpainting
    Jiang, Wei
    MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (02) : 919 - 933
  • [22] Rate-distortion optimized image compression based on image inpainting
    Wei Jiang
    Multimedia Tools and Applications, 2016, 75 : 919 - 933
  • [23] Multi-Exposure Image Compression Considering Rate-Distortion Optimization in Rendered High Dynamic Range Image
    Chiang, Jui-Chiu
    Shang, Hung-Yen
    Qiu, Ji-Jin
    IEEE OPEN JOURNAL OF SIGNAL PROCESSING, 2023, 4 : 132 - 147
  • [24] Rate-distortion optimized image compression using wedgelets
    Wakin, M
    Romberg, J
    Choi, H
    Baraniuk, R
    2002 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL III, PROCEEDINGS, 2002, : 237 - 240
  • [25] Rate-Distortion-Classification Model In Lossy Image Compression
    Zhang, Yuefeng
    Huang, Zhimeng
    2023 DATA COMPRESSION CONFERENCE, DCC, 2023, : 377 - 377
  • [26] A Rate-Distortion-Classification approach for lossy image compression
    Zhang, Yuefeng
    DIGITAL SIGNAL PROCESSING, 2023, 141
  • [27] An improved partial SPIHT with classified weighted rate-distortion optimization for interferential multispectral image compression
    王柯俨
    吴成柯
    孔繁锵
    张磊
    Chinese Optics Letters, 2008, (05) : 331 - 333
  • [28] An improved partial SPIHT with classified weighted rate-distortion optimization for interferential multispectral image compression
    Wang, Keyan
    Wu, Chengke
    Kong, Fanqiang
    Zhang, Lei
    CHINESE OPTICS LETTERS, 2008, 6 (05) : 331 - 333
  • [29] Ensemble Learning-Based Rate-Distortion Optimization for End-to-End Image Compression
    Wang, Yefei
    Liu, Dong
    Ma, Siwei
    Wu, Feng
    Gao, Wen
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (03) : 1193 - 1207
  • [30] A Universal Encoder Rate Distortion Optimization Framework for Learned Compression
    Zhao, Jing
    Li, Bin
    Li, Jiahao
    Xiong, Ruiqin
    Lu, Yan
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 1880 - 1884