Compressed image restoration via deep deblocker driven unified framework

被引:6
|
作者
Ren, Chao [1 ]
Teng, Qizhi [1 ]
He, Xiaohai [1 ]
Qing, Linbo [1 ]
Nguyen, Truong Q. [2 ]
机构
[1] Sichuan Univ, Coll Elect & Informat Engn, Chengdu 610065, Peoples R China
[2] Univ Calif San Diego, Dept Elect & Comp Engn, La Jolla, CA 92093 USA
基金
中国国家自然科学基金;
关键词
Compressed image restoration; Deep deblocker; Adaptive iteration scheme; Unified framework; Convergence analysis; SPARSE REPRESENTATION; QUALITY ASSESSMENT; SUPERRESOLUTION; ARTIFACTS;
D O I
10.1016/j.knosys.2021.107268
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a typical ill-posed problem, JPEG compressed image restoration (CIR) aims to recover a high-quality (HQ) image from the compressed version. Although many model-based and learning-based methods have been proposed for conventional image restoration (IR), proposing a general and effective framework for various CIR tasks is still a challenging work. The model-based methods are flexible for handling different IR tasks, but they suffer from high complexity and the difficulty in designing sophisticated priors. The learning-based methods have shown promising results in various IR tasks. However, most of them need to retrain their models for each IR task separately, which sacrifices methods' flexibility. In this paper, we propose a novel and high-performance deep deblocker driven unified framework to flexibly address various CIR tasks without retraining. First, a novel fidelity (NF) is introduced into CIR, and then the CIR problem is divided into inversion and deblocking subproblems by our improved split Bregman iteration (ISBI) algorithm. Next, we design a set of compact yet effective deep deblockers. Since simultaneously modeling the data fidelity term and implicit priors via deblockers is necessary, these deblockers are used as implicit priors and also used for NF in the CIR problem. The convergence of our method is proved as well. To the best of our knowledge, our method is the first work to use deblockers as implicit priors, and it could also contribute to other deblocking methods to obtain better flexibility. The effectiveness of the proposed method is demonstrated both visually and quantitatively. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] A Unified Deep Learning Framework for ssTEM Image Restoration
    Deng, Shiyu
    Huang, Wei
    Chen, Chang
    Fu, Xueyang
    Xiong, Zhiwei
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (12) : 3734 - 3746
  • [2] A unified framework of deep unfolding for compressed color imaging
    Cheng Zhang
    Feng Wu
    Yuanyuan Zhu
    Jiaxuan Zhou
    Sui Wei
    Soft Computing, 2022, 26 : 5095 - 5103
  • [3] A unified framework of deep unfolding for compressed color imaging
    Zhang, Cheng
    Wu, Feng
    Zhu, Yuanyuan
    Zhou, Jiaxuan
    Wei, Sui
    SOFT COMPUTING, 2022, 26 (11) : 5095 - 5103
  • [4] Whiteness Constraints in a Unified Variational Framework for Image Restoration
    Alessandro Lanza
    Serena Morigi
    Federica Sciacchitano
    Fiorella Sgallari
    Journal of Mathematical Imaging and Vision, 2018, 60 : 1503 - 1526
  • [5] Whiteness Constraints in a Unified Variational Framework for Image Restoration
    Lanza, Alessandro
    Morigi, Serena
    Sciacchitano, Federica
    Sgallari, Fiorella
    JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2018, 60 (09) : 1503 - 1526
  • [6] NEAR-FIELD SAR IMAGE RESTORATION FRAMEWORK VIA DEEP LEARNING
    Zhang, Wensi
    Zhang, Xiaoling
    Shi, Jun
    Wei, Shunjun
    Zeng, Tianjiao
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 5375 - 5378
  • [7] A Flexible Deep CNN Framework for Image Restoration
    Jin, Zhi
    Iqbal, Muhammad Zafar
    Bobkov, Dmytro
    Zou, Wenbin
    Li, Xia
    Steinbach, Eckehard
    IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (04) : 1055 - 1068
  • [8] A Unified Framework for Degraded Thai Historical Document Image Restoration
    Khankasikam, Krisda
    JOURNAL OF COMPUTERS, 2014, 9 (09) : 2146 - 2150
  • [9] A l1-unified variational framework for image restoration
    Bect, J
    Blanc-Feraud, L
    Aubert, G
    Chambolle, A
    COMPUTER VISION - ECCV 2004, PT 4, 2004, 2034 : 1 - 13
  • [10] UniHIST: A Unified Framework for Image Restoration With Marginal Histogram Constraints
    Mei, Xing
    Dong, Weiming
    Hu, Bao-Gang
    Lyu, Siwei
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 3753 - 3761