Generative Bayesian Image Super Resolution With Natural Image Prior

被引:61
|
作者
Zhang, Haichao [1 ]
Zhang, Yanning [1 ]
Li, Haisen [1 ]
Huang, Thomas S. [2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710129, Peoples R China
[2] Univ Illinois, Dept Elect & Comp Engn, Beckman Inst, Urbana, IL 61801 USA
基金
中国国家自然科学基金; 国家高技术研究发展计划(863计划);
关键词
Bayesian minimum mean square error estimation; field-of-experts; Markov chain Monte Carlo (MCMC); Markov random field; natural image statistics; super resolution (SR); KERNEL REGRESSION; SUPERRESOLUTION;
D O I
10.1109/TIP.2012.2199330
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a new single image super resolution (SR) algorithm via Bayesian modeling with a natural image prior modeled by a high-order Markov random field (MRF). SR is one of the long-standing and active topics in image processing community. It is of great use in many practical applications, such as astronomical observation, medical imaging, and the adaptation of low-resolution contents onto high-resolution displays. One category of the conventional approaches for image SR is formulating the problem with Bayesian modeling techniques and then obtaining its maximum-a-posteriori solution, which actually boils down to a regularized regression task. Although straightforward, this approach cannot exploit the full potential offered by the probabilistic modeling, as only the posterior mode is sought. On the other hand, current Bayesian SR approaches using the posterior mean estimation typically use very simple prior models for natural images to ensure the computational tractability. In this paper, we present a Bayesian image SR approach with a flexible high-order MRF model as the prior for natural images. The minimum mean square error (MMSE) criteria are used for estimating the HR image. A Markov chain Monte Carlo-based sampling algorithm is presented for obtaining the MMSE solution. The proposed method cannot only enjoy the benefits offered by the flexible prior, but also has the advantage of making use of the probabilistic modeling to perform a posterior mean estimation, thus is less sensitive to the local minima problem as the MAP solution. Experimental results indicate that the proposed method can generate competitive or better results than state-of-the-art SR algorithms.
引用
收藏
页码:4054 / 4067
页数:14
相关论文
共 50 条
  • [31] Optimization of generative adversarial network based image super-resolution by using image mask
    Jiang, Qilei
    Ma, Yuanxi
    He Jishu/Nuclear Techniques, 2023, 46 (05): : 93 - 101
  • [32] Image super-resolution using progressive generative adversarial networks for medical image analysis
    Mahapatra, Dwarikanath
    Bozorgtabar, Behzad
    Garnavi, Rahil
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2019, 71 : 30 - 39
  • [33] Image super-resolution using gradient profile prior
    Sun, Jian
    Sun, Jian
    Xu, Zongben
    Shum, Heung-Yeung
    2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, : 2471 - +
  • [34] Exploring the Spectral Prior for Hyperspectral Image Super-Resolution
    Hu, Qian
    Wang, Xinya
    Jiang, Junjun
    Zhang, Xiao-Ping
    Ma, Jiayi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 5260 - 5272
  • [35] Deep Networks for Image Super-Resolution with Sparse Prior
    Wang, Zhaowen
    Liu, Ding
    Yang, Jianchao
    Han, Wei
    Huang, Thomas
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 370 - 378
  • [36] A General Sparse Image Prior Combination in Super-Resolution
    Villena, Salvador
    Vega, Miguel
    Molina, Rafael
    Katsaggelos, Aggelos K.
    2013 18TH INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2013,
  • [37] Image Super-Resolution Via Analysis Sparse Prior
    Ning, Qiang
    Chen, Kan
    Yi, Li
    Fan, Chuchu
    Lu, Yao
    Wen, Jiangtao
    IEEE SIGNAL PROCESSING LETTERS, 2013, 20 (04) : 399 - 402
  • [38] Single Image Super-Resolution Using Sparse Prior
    Bian, Junjie
    Li, Yuelong
    Feng, Jufu
    MIPPR 2011: PATTERN RECOGNITION AND COMPUTER VISION, 2011, 8004
  • [39] A MCMC approach for Bayesian super-resolution image reconstruction
    Tian, J
    Ma, KK
    2005 International Conference on Image Processing (ICIP), Vols 1-5, 2005, : 525 - 528
  • [40] Variational Bayesian Image Super-Resolution with GPU Acceleration
    Chantas, Giannis
    ARTIFICIAL NEURAL NETWORKS-ICANN 2010, PT I, 2010, 6352 : 480 - 489