A unified efficient deep image compression framework and its application on human-centric Task

被引:2
|
作者
Chen, Xueyuan [1 ]
Hu, Zhihao [1 ]
Lu, Guo [2 ]
Liu, Jiaheng [1 ]
机构
[1] Beihang Univ, Beijing, Peoples R China
[2] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
关键词
Image compression; Neural network; Auto-encoder; Gaussian mixture model;
D O I
10.1007/s11042-023-17696-6
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image compression is a widely used technique to reduce the spatial redundancy in images. Recently, learning based image compression has achieved significant progress by using the powerful representation ability from neural networks. However, the current learning based image compression methods suffer from the huge computational cost, which limits their capacity for practical applications. In this paper, we propose a unified framework called Efficient Deep Image Compression (EDIC) based on three new technologies, including a channel attention module, a Gaussian mixture model and a decoder-side enhancement module. Specifically, we design an auto-encoder style network for learning based image compression. To improve the coding efficiency, we exploit the channel relationship between latent representations by using the channel attention module. Besides, the Gaussian mixture model is introduced for the entropy model and improves the accuracy for bitrate estimation. Furthermore, we introduce the decoder-side enhancement module to further improve image compression performance. Our EDIC method can also be readily incorporated with the Deep Video Compression (DVC) framework (Lu et al. 2019) to further improve the video compression performance. Simultaneously, our EDIC method boosts the coding performance significantly while bringing slightly increased computational cost. More importantly, experimental results demonstrate that the proposed approach outperforms the current image compression methods and is up to more than 150 times faster in terms of decoding speed when compared with Minnen's method (Minnen et al. 2018). Moreover, we also evaluate the performance of the human-centric task (i.e., face recognition) by using different coding strategies.
引用
收藏
页码:73407 / 73425
页数:19
相关论文
共 50 条
  • [1] Unified Human-Centric Model, Framework and Benchmark: A Survey
    Zhao, Xiong
    Sulaiman, Sarina
    Yee Leng, Wong
    IEEE ACCESS, 2024, 12 : 155408 - 155422
  • [2] A human-centric framework for robotic task learning and optimization
    Roveda, Loris
    Veerappan, Palaniappan
    Maccarini, Marco
    Bucca, Giuseppe
    Ajoudani, Arash
    Piga, Dario
    JOURNAL OF MANUFACTURING SYSTEMS, 2023, 67 : 68 - 79
  • [3] A Unified Framework for Human-centric Point Cloud Video Understanding
    Xu, Yiteng
    Ye, Kecheng
    Han, Xiao
    Ren, Yiming
    Zhu, Xinge
    Ma, Yuexin
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 1155 - 1164
  • [4] Unified and Scalable Deep Image Compression Framework for Human and Machine
    Zhang, Gai
    Zhang, Xinfeng
    Tang, Lv
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (10)
  • [5] Human-Centric Image Captioning
    Yang, Zuopeng
    Wang, Pengbo
    Chu, Tianshu
    Yang, Jie
    Pattern Recognition, 2022, 126
  • [6] Human-Centric Image Captioning
    Yang, Zuopeng
    Wang, Pengbo
    Chu, Tianshu
    Yang, Jie
    PATTERN RECOGNITION, 2022, 126
  • [7] An Abstract Human-Centric Framework for Ethical Task-Automation Decisions
    Smith, Trevor Robin
    PROCEEDINGS OF THE 2020 IEEE INTERNATIONAL SYMPOSIUM ON TECHNOLOGY AND SOCIETY (ISTAS), 2021, : 20 - 24
  • [8] UniHCP: A Unified Model for Human-Centric Perceptions
    Ci, Yuanzheng
    Wang, Yizhou
    Chen, Meilin
    Tang, Shixiang
    Bai, Lei
    Zhu, Feng
    Zhao, Rui
    Yu, Fengwei
    Qi, Donglian
    Ouyang, Wanli
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 17840 - 17852
  • [9] A Unified Configurable Architecture for Human-Centric Business Process Management Application in SMEs
    Ao, Yintai
    Xiao, Xuejian
    Song, Bin
    2009 IEEE ASIA-PACIFIC SERVICES COMPUTING CONFERENCE (APSCC 2009), 2009, : 257 - 262
  • [10] An Approach to Modeling and Analyzing Human-Centric Systems and Its Application
    An, Dongdong
    Liu, Jing
    INTERNATIONAL JOURNAL OF COOPERATIVE INFORMATION SYSTEMS, 2018, 27 (01)