Generative Bayesian Image Super Resolution With Natural Image Prior

被引:61
|
作者
Zhang, Haichao [1 ]
Zhang, Yanning [1 ]
Li, Haisen [1 ]
Huang, Thomas S. [2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710129, Peoples R China
[2] Univ Illinois, Dept Elect & Comp Engn, Beckman Inst, Urbana, IL 61801 USA
基金
中国国家自然科学基金; 国家高技术研究发展计划(863计划);
关键词
Bayesian minimum mean square error estimation; field-of-experts; Markov chain Monte Carlo (MCMC); Markov random field; natural image statistics; super resolution (SR); KERNEL REGRESSION; SUPERRESOLUTION;
D O I
10.1109/TIP.2012.2199330
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a new single image super resolution (SR) algorithm via Bayesian modeling with a natural image prior modeled by a high-order Markov random field (MRF). SR is one of the long-standing and active topics in image processing community. It is of great use in many practical applications, such as astronomical observation, medical imaging, and the adaptation of low-resolution contents onto high-resolution displays. One category of the conventional approaches for image SR is formulating the problem with Bayesian modeling techniques and then obtaining its maximum-a-posteriori solution, which actually boils down to a regularized regression task. Although straightforward, this approach cannot exploit the full potential offered by the probabilistic modeling, as only the posterior mode is sought. On the other hand, current Bayesian SR approaches using the posterior mean estimation typically use very simple prior models for natural images to ensure the computational tractability. In this paper, we present a Bayesian image SR approach with a flexible high-order MRF model as the prior for natural images. The minimum mean square error (MMSE) criteria are used for estimating the HR image. A Markov chain Monte Carlo-based sampling algorithm is presented for obtaining the MMSE solution. The proposed method cannot only enjoy the benefits offered by the flexible prior, but also has the advantage of making use of the probabilistic modeling to perform a posterior mean estimation, thus is less sensitive to the local minima problem as the MAP solution. Experimental results indicate that the proposed method can generate competitive or better results than state-of-the-art SR algorithms.
引用
收藏
页码:4054 / 4067
页数:14
相关论文
共 50 条
  • [21] A Bayesian Nonparametric Approach to Image Super-Resolution
    Polatkan, Guengoer
    Zhou, Mingyuan
    Carin, Lawrence
    Blei, David
    Daubechies, Ingrid
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (02) : 346 - 358
  • [22] A comparison of Generative Adversarial Networks for image super-resolution
    Cobelli, Patricia
    Nesmachnow, Sergio
    Toutouh, Jamal
    2022 IEEE LATIN AMERICAN CONFERENCE ON COMPUTATIONAL INTELLIGENCE (LA-CCI), 2022, : 30 - 35
  • [23] Generative collaborative networks for single image super-resolution
    Seddik, Mohamed El Amine
    Tamaazousti, Mohamed
    Lin, John
    NEUROCOMPUTING, 2020, 398 : 293 - 303
  • [24] Generative adversarial networks for hyperspectral image spatial super resolution
    Yilin J.
    Ran S.
    Sanqiang T.
    Journal of China Universities of Posts and Telecommunications, 2020, 27 (04): : 8 - 16
  • [25] Single Image Super Resolution Based on Generative Adversarial Networks
    Li, Kai
    Liang, Ye
    Yang, Shenghao
    Jia, Jinfang
    Huang, Jianqiang
    Wang, Xiaoying
    ELEVENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2019), 2019, 11179
  • [26] Generative Adversarial Networks for Medical Image Super-resolution
    Zhao, Min
    Naderian, Amirkhashayar
    Sanei, Saeid
    2021 INTERNATIONAL CONFERENCE ON E-HEALTH AND BIOENGINEERING (EHB 2021), 9TH EDITION, 2021,
  • [27] Genaralizing Generative Models: Application to Image Super-resolution
    Mu, Yanyan
    Dimitrakopoulos, Roussos
    Ferrie, Frank
    2016 13TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV), 2016, : 8 - 15
  • [28] Semantic guided large scale factor remote sensing image super-resolution with generative diffusion prior
    Wang, Ce
    Sun, Wanjie
    ISPRS Journal of Photogrammetry and Remote Sensing, 2025, 220 : 125 - 138
  • [29] Retinal fundus image super-resolution based on generative adversarial network guided with vascular structure prior
    Yanfei Jia
    Guangda Chen
    Haotian Chi
    Scientific Reports, 14 (1)
  • [30] Super-Resolution Reconstruction of Underwater Image Based on Image Sequence Generative Adversarial Network
    Li, Li
    Fan, Zijia
    Zhao, Mingyang
    Wang, Xinlei
    Wang, Zhongyang
    Wang, Zhiqiong
    Guo, Longxiang
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2020, 2020