Super-Resolution Degradation Model: Converting High-Resolution Datasets to Optical Zoom Datasets

被引:3
|
作者
Hao, Yukun [1 ]
Yu, Feihong [1 ]
机构
[1] Zhejiang Univ, Coll Opt Sci & Engn, Hangzhou 310027, Peoples R China
关键词
Real-world super-resolution; degradation model; blur kernel; optical zoom; frequency domain aliasing; IMAGE SUPERRESOLUTION; NETWORK;
D O I
10.1109/TCSVT.2023.3269955
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Despite remarkable progress in single-image super-resolution based on neural networks, the results are not ideal when applied to real-world images, because the real-world degradation process is unknown and complex. The emergence of some optical zoom datasets shows that neural networks still achieve good results on real-world images as long as the low-resolution images used for training have similar features and distributions with the real-world images. However, obtaining such optical zoom datasets is complicated and the datasets are only applicable to specific cameras and shooting conditions. By studying the optical zoom datasets, we propose a super-resolution image degradation model consisting of blurring, frequency domain processing, adding noise and downsampling. Specifically, blurring uses a blur kernel with a wave-like shape inferred from the point spread function, which produces the artifacts like real-world images. Frequency domain processing simulates the frequency domain aliasing of real-world images, such as jagged edges and background stripes. Experiments demonstrate that the new degradation model achieves visual effects comparable to optical zoom datasets. Existing high-resolution datasets can be converted to "optical zoom datasets" by the degradation model, where the synthetic low-resolution images have real-world image features, thereby extending super-resolution methods to real-world images.
引用
收藏
页码:6374 / 6389
页数:16
相关论文
共 50 条
  • [21] How much zoom is the right zoom from the perspective of Super-Resolution?
    Arora, Himanshu
    Namboodiri, Anoop M.
    SIXTH INDIAN CONFERENCE ON COMPUTER VISION, GRAPHICS & IMAGE PROCESSING ICVGIP 2008, 2008, : 142 - 149
  • [22] Image super-resolution: prefix-tuning transformer from large to small datasets
    Hui Ma
    Dongli Jia
    Jiejie Xiao
    Xu Su
    Signal, Image and Video Processing, 2024, 18 : 2753 - 2761
  • [23] Image super-resolution: prefix-tuning transformer from large to small datasets
    Ma, Hui
    Jia, Dongli
    Xiao, Jiejie
    Su, Xu
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (03) : 2753 - 2761
  • [24] Super-Resolution Network for General Static Degradation Model
    Xu, Yingjie
    Zhou, Wenan
    Xing, Ying
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT II, 2019, 11954 : 25 - 36
  • [25] Super-Resolution Wavelength-Controlled Zoom Metalens
    Huang Baoze
    Zhao Fen
    Liu Qinxiao
    Yang Junbo
    ACTA OPTICA SINICA, 2023, 43 (23)
  • [26] Global spatio-temporally harmonised datasets for producing high-resolution gridded population distribution datasets
    Lloyd, Christopher T.
    Chamberlain, Heather
    Kerr, David
    Yetman, Greg
    Pistolesi, Linda
    Stevens, Forrest R.
    Gaughan, Andrea E.
    Nieves, Jeremiah J.
    Hornby, Graeme
    MacManus, Kytt
    Sinha, Parmanand
    Bondarenko, Maksym
    Sorichetta, Alessandro
    Tatem, Andrew J.
    BIG EARTH DATA, 2019, 3 (02) : 108 - 139
  • [27] A balanced super-resolution optical fluctuation imaging method for super-resolution ultrasound
    Lv, Minglei
    Shu, Yuexia
    Liu, Ying
    Yan, Zhuangzhi
    Jiang, Jiehui
    Liu, Xin
    MEDICAL IMAGING 2018: BIOMEDICAL APPLICATIONS IN MOLECULAR, STRUCTURAL, AND FUNCTIONAL IMAGING, 2018, 10578
  • [28] ResLap: Generating High-Resolution Climate Prediction Through Image Super-Resolution
    Cheng, Jianxin
    Kuang, Qiuming
    Shen, Chenkai
    Liu, Jin
    Tan, Xicheng
    Liu, Wang
    IEEE ACCESS, 2020, 8 : 39623 - 39634
  • [29] Super-resolution with adversarial loss on the feature maps of the generated high-resolution image
    Imanuel, I.
    Lee, S.
    ELECTRONICS LETTERS, 2022, 58 (02) : 47 - 49
  • [30] Open High-Resolution Satellite Imagery: TheWorldStrat Dataset - With Application to Super-Resolution
    Cornebise, Julien
    Orsolic, Ivan
    Kalaitzis, Freddie
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,