Unsupervised Single-Image Super-Resolution with Multi-Gram Loss

被引:5
|
作者
Shi, Yong [1 ,2 ,3 ,4 ]
Li, Biao [1 ,2 ,3 ]
Wang, Bo [5 ,6 ]
Qi, Zhiquan [1 ,2 ,3 ]
Liu, Jiabin [2 ,3 ]
机构
[1] Univ Chinese Acad Sci, Sch Econ & Management, Beijing 101408, Peoples R China
[2] Chinese Acad Sci, Res Ctr Fictitious Econ & Data Sci, Beijing 100190, Peoples R China
[3] Chinese Acad Sci, Key Lab Big Data Min & Knowledge Management, Beijing 100190, Peoples R China
[4] Univ Nebraska, Coll Informat Sci & Technol, Omaha, NE 68182 USA
[5] Univ Int Business & Econ, Sch Informat Technol & Management, Beijing 100029, Peoples R China
[6] Texas A&M Univ, Dept Comp Sci & Engn, College Stn, TX 77843 USA
基金
中国国家自然科学基金;
关键词
unsupervised single-image super-resolution; two-step super-resolution; multi-gram loss; global residual learning; RESOLUTION; LIMITS;
D O I
10.3390/electronics8080833
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, supervised deep super-resolution (SR) networks have achieved great success in both accuracy and texture generation. However, most methods train in the dataset with a fixed kernel (such as bicubic) between high-resolution images and their low-resolution counterparts. In real-life applications, pictures are always disturbed with additional artifacts, e.g., non-ideal point-spread function in old film photos, and compression loss in cellphone photos. How to generate a satisfactory SR image from the specific prior single low-resolution (LR) image is still a challenging issue. In this paper, we propose a novel unsupervised method named unsupervised single-image SR with multi-gram loss (UMGSR) to overcome the dilemma. There are two significant contributions in this paper: (a) we design a new architecture for extracting more information from limited inputs by combining the local residual block and two-step global residual learning; (b) we introduce the multi-gram loss for SR task to effectively generate better image details. Experimental comparison shows that our unsupervised method in normal conditions can attain better visual results than other supervised SR methods.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Anchored neighborhood deep network for single-image super-resolution
    Wuzhen Shi
    Shaohui Liu
    Feng Jiang
    Debin Zhao
    Zhihong Tian
    EURASIP Journal on Image and Video Processing, 2018
  • [42] Coarse-to-Fine Learning for Single-Image Super-Resolution
    Zhang, Kaibing
    Tao, Dacheng
    Gao, Xinbo
    Li, Xuelong
    Li, Jie
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (05) : 1109 - 1122
  • [43] Single-image super-resolution based on multi-branch residual pyramid network
    Ou, Jiayu
    Xia, Hao
    Huo, Wenxiao
    Yan, Yejin
    Li, Tianping
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (06) : 2569 - 2581
  • [44] A Conspectus of Deep Learning Techniques for Single-Image Super-Resolution
    Pattern Recognition and Image Analysis, 2022, 32 : 11 - 32
  • [45] NLCUnet: Single-Image Super-Resolution Network with Hairline Details
    Feng, Jiancong
    Wang, Yuan-Gen
    Xing, Fengchuang
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1277 - 1282
  • [46] Texture enhancement for improving single-image super-resolution performance
    Yoo, Seok Bong
    Choi, Kyuha
    Jeon, Young Woo
    Ra, Jong Beom
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2016, 46 : 29 - 39
  • [47] Single-Image Super-Resolution Based on Rational Fractal Interpolation
    Zhang, Yunfeng
    Fan, Qinglan
    Bao, Fangxun
    Liu, Yifang
    Zhang, Caiming
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (08) : 3782 - 3797
  • [48] Anchored neighborhood deep network for single-image super-resolution
    Shi, Wuzhen
    Liu, Shaohui
    Jiang, Feng
    Zhao, Debin
    Tian, Zhihong
    EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2018,
  • [49] Single-image super-resolution based on multi-branch residual pyramid network
    Jiayu Ou
    Hao Xia
    Wenxiao Huo
    Yejin Yan
    Tianping Li
    Journal of Real-Time Image Processing, 2021, 18 : 2569 - 2581
  • [50] Adapting Single-Image Super-Resolution Models to Video Super-Resolution: A Plug-and-Play Approach
    Wang, Wenhao
    Liu, Zhenbing
    Lu, Haoxiang
    Lan, Rushi
    Huang, Yingxin
    SENSORS, 2023, 23 (11)