An End-to-End Deep Generative Network for Low Bitrate Image Coding

被引:1
|
作者
Pei, Yifei [1 ]
Liu, Ying [1 ]
Ling, Nam [1 ]
Ren, Yongxiong [2 ]
Liu, Lingzhi [2 ]
机构
[1] Santa Clara Univ, Dept Comp Sci & Engn, Santa Clara, CA 95053 USA
[2] Kwai Inc, Heterogenous Comp Grp, Palo Alto, CA USA
关键词
entropy estimation; generative adversarial network; hinge loss; image coding; Wasserstein generative adversarial network; visual communications;
D O I
10.1109/ISCAS46773.2023.10182028
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Generative adversarial network (GAN)-based image compression approaches reconstruct images with highly realistic quality at low bit rates. However, currently there is no published GAN-based image compression approach that utilizes advanced GAN losses, such as the Wasserstein GAN with gradient penalty loss (WGAN-GP), to improve the quality of reconstructed images. Meanwhile, existing deep learning-based image compression approaches require extra convolution layers to estimate and constrain the entropy during training, which makes the network larger and may require extra bits to send information to the decoder. In this paper, we propose a new GAN for image compression with novel discriminator and generator loss functions and a simple entropy estimation approach. Our new loss functions outperform the current GAN loss for low bitrate image compression. Our entropy estimation approach does not require extra convolution layers but still works well to constrain the number of bits during training.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Two Stages End-to-End Generative Network for Single Image Defogging
    二阶段端到端的图像去雾生成网络
    [J]. Liu, Wei (lw@szu.edu.cn), 1600, Institute of Computing Technology (32): : 164 - 172
  • [2] A deep learning network based end-to-end image composition
    Zhu, Xiaoyu
    Wang, Haodi
    Zhang, Zhiyi
    Wu, Xiuping
    Guo, Junqi
    Wu, Hao
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2022, 101
  • [3] AN END-TO-END GENERATIVE CLASSIFICATION MODEL FOR HYPERSPECTRAL IMAGE
    Li, Yaling
    Luo, Xiaoyan
    Sen Li
    Shi, Xiaofeng
    [J]. IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 7621 - 7624
  • [4] An End-to-End Multi-Scale Conditional Generative Adversarial Network for Image Deblurring
    Qi, Fei
    Wang, Chen-Qing
    [J]. Journal of Computers (Taiwan), 2023, 34 (03) : 237 - 250
  • [5] Transform Network Architectures for Deep Learning Based End-to-End Image/Video Coding in Subsampled Color Spaces
    Egilmez, Hilmi E.
    Singh, Ankitesh K.
    Coban, Muhammed
    Karczewicz, Marta
    Zhu, Yinhao
    Yang, Yang
    Said, Amir
    Cohen, Taco S.
    [J]. IEEE OPEN JOURNAL OF SIGNAL PROCESSING, 2021, 2 : 441 - 452
  • [6] Low Rank Based End-to-End Deep Neural Network Compression
    Jain, Swayambhoo
    Hamidi-Rad, Shahab
    Racape, Fabien
    [J]. 2021 DATA COMPRESSION CONFERENCE (DCC 2021), 2021, : 233 - 242
  • [7] End-to-End Deep ROI Image Compression
    Akutsu, Hiroaki
    Naruko, Takahiro
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2020, E103D (05): : 1031 - 1038
  • [8] IMAGE CODING FOR MACHINES: AN END-TO-END LEARNED APPROACH
    Le, Nam
    Zhang, Honglei
    Cricri, Francesco
    Ghaznavi-Youvalari, Ramin
    Rahtu, Esa
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1590 - 1594
  • [9] Encipher GAN: An End-to-End Color Image Encryption System Using a Deep Generative Model
    Panwar, Kirtee
    Singh, Akansha
    Kukreja, Sonal
    Singh, Krishna Kant
    Shakhovska, Nataliya
    Boichuk, Andrii
    [J]. SYSTEMS, 2023, 11 (01):
  • [10] End-to-end deep multispectral image compression based on interspectral prediction network
    Kong, Fanqiang
    Meng, Yuxin
    Li, Dan
    Hu, Kedi
    [J]. JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (03)