Generative Bayesian Image Super Resolution With Natural Image Prior

被引:61
|
作者
Zhang, Haichao [1 ]
Zhang, Yanning [1 ]
Li, Haisen [1 ]
Huang, Thomas S. [2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710129, Peoples R China
[2] Univ Illinois, Dept Elect & Comp Engn, Beckman Inst, Urbana, IL 61801 USA
基金
中国国家自然科学基金; 国家高技术研究发展计划(863计划);
关键词
Bayesian minimum mean square error estimation; field-of-experts; Markov chain Monte Carlo (MCMC); Markov random field; natural image statistics; super resolution (SR); KERNEL REGRESSION; SUPERRESOLUTION;
D O I
10.1109/TIP.2012.2199330
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a new single image super resolution (SR) algorithm via Bayesian modeling with a natural image prior modeled by a high-order Markov random field (MRF). SR is one of the long-standing and active topics in image processing community. It is of great use in many practical applications, such as astronomical observation, medical imaging, and the adaptation of low-resolution contents onto high-resolution displays. One category of the conventional approaches for image SR is formulating the problem with Bayesian modeling techniques and then obtaining its maximum-a-posteriori solution, which actually boils down to a regularized regression task. Although straightforward, this approach cannot exploit the full potential offered by the probabilistic modeling, as only the posterior mode is sought. On the other hand, current Bayesian SR approaches using the posterior mean estimation typically use very simple prior models for natural images to ensure the computational tractability. In this paper, we present a Bayesian image SR approach with a flexible high-order MRF model as the prior for natural images. The minimum mean square error (MMSE) criteria are used for estimating the HR image. A Markov chain Monte Carlo-based sampling algorithm is presented for obtaining the MMSE solution. The proposed method cannot only enjoy the benefits offered by the flexible prior, but also has the advantage of making use of the probabilistic modeling to perform a posterior mean estimation, thus is less sensitive to the local minima problem as the MAP solution. Experimental results indicate that the proposed method can generate competitive or better results than state-of-the-art SR algorithms.
引用
收藏
页码:4054 / 4067
页数:14
相关论文
共 50 条
  • [1] Multi-frame Image Super Resolution with Natural Image Prior
    Zhang, Chengzhi
    Feng, Huajun
    Xu, Zhihai
    Li, Qi
    Chen, Yueting
    2018 IEEE 3RD INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP), 2018, : 287 - 291
  • [2] BAYESIAN IMAGE SEPARATION WITH NATURAL IMAGE PRIOR
    Zhang, Haichao
    Zhang, Yanning
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 2097 - 2100
  • [3] MrSARP: A Hierarchical Deep Generative Prior for SAR Image Super-resolution
    Agarwal, Tushar
    Sugavanam, Nithin
    Ertin, Emre
    2023 IEEE RADAR CONFERENCE, RADARCONF23, 2023,
  • [4] Learning Generative Structure Prior for Blind Text Image Super-resolution
    Li, Xiaoming
    Zuo, Wangmeng
    Loy, Chen Change
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 10103 - 10113
  • [5] Deep Image Prior for Super Resolution of Noisy Image
    Han, Sujy
    Lee, Tae Bok
    Heo, Yong Seok
    ELECTRONICS, 2021, 10 (16)
  • [6] Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior
    Kim, Kwang In
    Kwon, Younghee
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (06) : 1127 - 1133
  • [7] IMAGE PRIOR COMBINATION IN SUPER-RESOLUTION IMAGE RECONSTRUCTION
    Villena, Salvador
    Vega, Miguel
    Molina, Rafael
    Katsaggelos, Aggelos K.
    18TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO-2010), 2010, : 616 - 620
  • [8] Bayesian Methods for Image Super-Resolution
    Pickup, Lyndsey C.
    Capel, David P.
    Roberts, Stephen J.
    Zisserman, Andrew
    COMPUTER JOURNAL, 2009, 52 (01): : 101 - 113
  • [9] Hybrid Bayesian super resolution image reconstruction
    Wang, Tao
    Zhang, Yan
    Zhang, Yong Sheng
    INTELLIGENT COMPUTING IN SIGNAL PROCESSING AND PATTERN RECOGNITION, 2006, 345 : 275 - 284
  • [10] Bayesian Super-Resolution Image Reconstruction using an l1 prior
    Villena, Salvador
    Vega, Miguel
    Molina, Rafael
    Katsaggelos, Aggelos K.
    2009 PROCEEDINGS OF 6TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS (ISPA 2009), 2009, : 156 - +