Super-Resolution Degradation Model: Converting High-Resolution Datasets to Optical Zoom Datasets

被引:3
|
作者
Hao, Yukun [1 ]
Yu, Feihong [1 ]
机构
[1] Zhejiang Univ, Coll Opt Sci & Engn, Hangzhou 310027, Peoples R China
关键词
Real-world super-resolution; degradation model; blur kernel; optical zoom; frequency domain aliasing; IMAGE SUPERRESOLUTION; NETWORK;
D O I
10.1109/TCSVT.2023.3269955
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Despite remarkable progress in single-image super-resolution based on neural networks, the results are not ideal when applied to real-world images, because the real-world degradation process is unknown and complex. The emergence of some optical zoom datasets shows that neural networks still achieve good results on real-world images as long as the low-resolution images used for training have similar features and distributions with the real-world images. However, obtaining such optical zoom datasets is complicated and the datasets are only applicable to specific cameras and shooting conditions. By studying the optical zoom datasets, we propose a super-resolution image degradation model consisting of blurring, frequency domain processing, adding noise and downsampling. Specifically, blurring uses a blur kernel with a wave-like shape inferred from the point spread function, which produces the artifacts like real-world images. Frequency domain processing simulates the frequency domain aliasing of real-world images, such as jagged edges and background stripes. Experiments demonstrate that the new degradation model achieves visual effects comparable to optical zoom datasets. Existing high-resolution datasets can be converted to "optical zoom datasets" by the degradation model, where the synthetic low-resolution images have real-world image features, thereby extending super-resolution methods to real-world images.
引用
收藏
页码:6374 / 6389
页数:16
相关论文
共 50 条
  • [31] Zoom based image super-resolution using DCT with LBP as characteristic model
    Doshi, Meera
    Gajjar, Prakash
    Kothari, Ashish
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (02) : 72 - 85
  • [32] BigStitcher: reconstructing high-resolution image datasets of cleared and expanded samples
    David Hörl
    Fabio Rojas Rusak
    Friedrich Preusser
    Paul Tillberg
    Nadine Randel
    Raghav K. Chhetri
    Albert Cardona
    Philipp J. Keller
    Hartmann Harz
    Heinrich Leonhardt
    Mathias Treier
    Stephan Preibisch
    Nature Methods, 2019, 16 : 870 - 874
  • [33] BigStitcher: reconstructing high-resolution image datasets of cleared and expanded samples
    Hoerl, David
    Rusak, Fabio Rojas
    Preusser, Friedrich
    Tillberg, Paul
    Randel, Nadine
    Chhetri, Raghav K.
    Cardona, Albert
    Keller, Philipp J.
    Harz, Hartmann
    Leonhardt, Heinrich
    Treier, Mathias
    Preibisch, Stephan
    NATURE METHODS, 2019, 16 (09) : 870 - +
  • [34] Southern Hemisphere strong polar mesoscale cyclones in high-resolution datasets
    Pezza, Alexandre
    Sadler, Katherine
    Uotila, Petteri
    Vihma, Timo
    Mesquita, Michel D. S.
    Reid, Phil
    CLIMATE DYNAMICS, 2016, 47 (5-6) : 1647 - 1660
  • [35] Unsupervised Summarization and Change Detection in High-Resolution Signalized Intersection Datasets
    Mahajan, Dhruv
    Karnati, Yashaswi
    Rangarajan, Anand
    Ranka, Sanjay
    2020 IEEE 23RD INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2020,
  • [36] Validation of High-Resolution Gridded Rainfall Datasets for Climate Applications in the Philippines
    Peralta, J. C. Albert C.
    Narisma, Gemma Teresa T.
    Cruz, Faye Abigail T.
    JOURNAL OF HYDROMETEOROLOGY, 2020, 21 (07) : 1571 - 1587
  • [37] High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth
    Scharstein, Daniel
    Hirschmuller, Heiko
    Kitajima, York
    Krathwohl, Greg
    Nesic, Nera
    Wang, Xi
    Westling, Porter
    PATTERN RECOGNITION, GCPR 2014, 2014, 8753 : 31 - 42
  • [38] Super-resolution optical classifier with high photon efficiency
    Zhang, He
    Kumar, Santosh
    Huang, Yu-Ping
    OPTICS LETTERS, 2020, 45 (18) : 4968 - 4971
  • [39] GEOtiled: A ScalableWorkflow for Generating Large Datasets of High-Resolution Terrain Parameters
    Roa, Camila
    Olaya, Paula
    Llamas, Ricardo
    Vargas, Rodrigo
    Taufer, Michela
    PROCEEDINGS OF THE 32ND INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE PARALLEL AND DISTRIBUTED COMPUTING, HPDC 2023, 2023, : 311 - 312
  • [40] High-Resolution GAN Inversion for Degraded Images in Large Diverse Datasets
    Wang, Yanbo
    Lin, Chuming
    Luo, Donghao
    Tai, Ying
    Zhang, Zhizhong
    Xie, Yuan
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 2716 - 2723