Super-Resolution Degradation Model: Converting High-Resolution Datasets to Optical Zoom Datasets

被引:3
|
作者
Hao, Yukun [1 ]
Yu, Feihong [1 ]
机构
[1] Zhejiang Univ, Coll Opt Sci & Engn, Hangzhou 310027, Peoples R China
关键词
Real-world super-resolution; degradation model; blur kernel; optical zoom; frequency domain aliasing; IMAGE SUPERRESOLUTION; NETWORK;
D O I
10.1109/TCSVT.2023.3269955
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Despite remarkable progress in single-image super-resolution based on neural networks, the results are not ideal when applied to real-world images, because the real-world degradation process is unknown and complex. The emergence of some optical zoom datasets shows that neural networks still achieve good results on real-world images as long as the low-resolution images used for training have similar features and distributions with the real-world images. However, obtaining such optical zoom datasets is complicated and the datasets are only applicable to specific cameras and shooting conditions. By studying the optical zoom datasets, we propose a super-resolution image degradation model consisting of blurring, frequency domain processing, adding noise and downsampling. Specifically, blurring uses a blur kernel with a wave-like shape inferred from the point spread function, which produces the artifacts like real-world images. Frequency domain processing simulates the frequency domain aliasing of real-world images, such as jagged edges and background stripes. Experiments demonstrate that the new degradation model achieves visual effects comparable to optical zoom datasets. Existing high-resolution datasets can be converted to "optical zoom datasets" by the degradation model, where the synthetic low-resolution images have real-world image features, thereby extending super-resolution methods to real-world images.
引用
收藏
页码:6374 / 6389
页数:16
相关论文
共 50 条
  • [1] Super-Resolution for High-Resolution Displays
    Goto, Kyohei
    Nagashima, Fumiya
    Goto, Tomio
    Hirano, Satoshi
    Sakurai, Masaru
    2014 IEEE 3RD GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE), 2014, : 309 - 310
  • [2] High-Resolution Projection Network combining High-Resolution Optical Flow Compensation for Video Super-Resolution
    Sun, Yifei
    Chen, Zhengxia
    Jin, Yuying
    Feng, Xiaoyi
    2024 3RD INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND MEDIA COMPUTING, ICIPMC 2024, 2024, : 234 - 238
  • [3] Automated mosaicing with super-resolution zoom
    Capel, D
    Zisserman, A
    1998 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1998, : 885 - 891
  • [4] High-Resolution Satellite Image Super-Resolution Using Image Degradation Model with MTF-Based Filters
    Chung, Minkyung
    Jung, Minyoung
    Kim, Yongil
    KOREAN JOURNAL OF REMOTE SENSING, 2023, 39 (04) : 395 - 407
  • [5] Zoom based super-resolution through SAR model fitting
    Joshi, MV
    Chaudhuri, S
    ICIP: 2004 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1- 5, 2004, : 1775 - 1778
  • [6] Super-Resolution Images Methodology Applied to UAV Datasets to Road Pavement Monitoring
    Inzerillo, Laura
    Acuto, Francesco
    Di Mino, Gaetano
    Uddin, Mohammed Zeeshan
    DRONES, 2022, 6 (07)
  • [7] Effect of Training and Test Datasets on Image Restoration and Super-Resolution by Deep Learning
    Kirmemis, Ogun
    Tekalp, A. Murat
    2018 26TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2018, : 514 - 518
  • [8] SURFNet: Super-resolution of Turbulent Flows with Transfer Learning using Small Datasets
    Obiols-Sales, Octavi
    Vishnu, Abhinav
    Malaya, Nicholas P.
    Chandramowlishwaran, Aparna
    30TH INTERNATIONAL CONFERENCE ON PARALLEL ARCHITECTURES AND COMPILATION TECHNIQUES (PACT 2021), 2021, : 331 - 344
  • [9] Super-resolution imaging: use of zoom as a cue
    Joshi, MV
    Chaudhuri, S
    Panuganti, R
    IMAGE AND VISION COMPUTING, 2004, 22 (14) : 1185 - 1196
  • [10] Learn to Zoom in Single Image Super-Resolution
    Zhang, Zili
    Favaro, Paolo
    Tian, Yan
    Li, Jianxiang
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 1237 - 1241