Unsupervised Single-Image Super-Resolution with Multi-Gram Loss

被引:5
|
作者
Shi, Yong [1 ,2 ,3 ,4 ]
Li, Biao [1 ,2 ,3 ]
Wang, Bo [5 ,6 ]
Qi, Zhiquan [1 ,2 ,3 ]
Liu, Jiabin [2 ,3 ]
机构
[1] Univ Chinese Acad Sci, Sch Econ & Management, Beijing 101408, Peoples R China
[2] Chinese Acad Sci, Res Ctr Fictitious Econ & Data Sci, Beijing 100190, Peoples R China
[3] Chinese Acad Sci, Key Lab Big Data Min & Knowledge Management, Beijing 100190, Peoples R China
[4] Univ Nebraska, Coll Informat Sci & Technol, Omaha, NE 68182 USA
[5] Univ Int Business & Econ, Sch Informat Technol & Management, Beijing 100029, Peoples R China
[6] Texas A&M Univ, Dept Comp Sci & Engn, College Stn, TX 77843 USA
基金
中国国家自然科学基金;
关键词
unsupervised single-image super-resolution; two-step super-resolution; multi-gram loss; global residual learning; RESOLUTION; LIMITS;
D O I
10.3390/electronics8080833
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, supervised deep super-resolution (SR) networks have achieved great success in both accuracy and texture generation. However, most methods train in the dataset with a fixed kernel (such as bicubic) between high-resolution images and their low-resolution counterparts. In real-life applications, pictures are always disturbed with additional artifacts, e.g., non-ideal point-spread function in old film photos, and compression loss in cellphone photos. How to generate a satisfactory SR image from the specific prior single low-resolution (LR) image is still a challenging issue. In this paper, we propose a novel unsupervised method named unsupervised single-image SR with multi-gram loss (UMGSR) to overcome the dilemma. There are two significant contributions in this paper: (a) we design a new architecture for extracting more information from limited inputs by combining the local residual block and two-step global residual learning; (b) we introduce the multi-gram loss for SR task to effectively generate better image details. Experimental comparison shows that our unsupervised method in normal conditions can attain better visual results than other supervised SR methods.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Single-Image Super-Resolution: A Survey
    Yao, Tingting
    Luo, Yu
    Chen, Yantong
    Yang, Dongqiao
    Zhao, Lei
    COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, CSPS 2018, VOL II: SIGNAL PROCESSING, 2020, 516 : 119 - 125
  • [2] Single-Image Super-Resolution: A Benchmark
    Yang, Chih-Yuan
    Ma, Chao
    Yang, Ming-Hsuan
    COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 : 372 - 386
  • [3] Multi-attention fusion transformer for single-image super-resolution
    Li, Guanxing
    Cui, Zhaotong
    Li, Meng
    Han, Yu
    Li, Tianping
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [4] MULTI-SCALE DENSE NETWORK FOR SINGLE-IMAGE SUPER-RESOLUTION
    Chang, Chia-Yang
    Chien, Shao-Yi
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 1742 - 1746
  • [5] A New Deep Generative Network for Unsupervised Remote Sensing Single-Image Super-Resolution
    Mario Haut, Juan
    Fernandez-Beltran, Ruben
    Paoletti, Mercedes E.
    Plaza, Javier
    Plaza, Antonio
    Pla, Filiberto
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (11): : 6792 - 6810
  • [6] FINE-GRAINED DYNAMIC LOSS FOR ACCURATE SINGLE-IMAGE SUPER-RESOLUTION
    Wang, Haoquan
    Zhang, Gang
    Lei, Zhichun
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2150 - 2154
  • [7] A Content Dependent Kernel For Single-Image Super-Resolution
    Saryazdi, Saman
    Saryazdi, Saeid
    Nezanabadipour, Hossein
    2013 5TH CONFERENCE ON INFORMATION AND KNOWLEDGE TECHNOLOGY (IKT), 2013, : 453 - 456
  • [8] Rectified Binary Network for Single-Image Super-Resolution
    Xin, Jingwei
    Wang, Nannan
    Jiang, Xinrui
    Li, Jie
    Wang, Xiaoyu
    Gao, Xinbo
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [9] Single-image super-resolution via local learning
    Yi Tang
    Pingkun Yan
    Yuan Yuan
    Xuelong Li
    International Journal of Machine Learning and Cybernetics, 2011, 2 : 15 - 23
  • [10] EXTERNAL AND INTERNAL LEARNING FOR SINGLE-IMAGE SUPER-RESOLUTION
    Wang, Shuang
    Lin, Shaopeng
    Liang, Xuefeng
    Yue, Bo
    Jiao, Licheng
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 128 - 132