Multi-scale fractal residual network for image super-resolution

被引:20
|
作者
Feng, Xinxin [1 ,2 ,3 ,4 ]
Li, Xianguo [1 ,2 ,3 ,4 ]
Li, Jianxiong [1 ,2 ,3 ,4 ]
机构
[1] Tiangong Univ, Sch Elect, Informat Engn, Tianjin, Peoples R China
[2] Tianjin Key Lab Optoelectron Detect Technol, Syst, Tianjin, Peoples R China
[3] Tiangong Univ, Sch Elect & Informat Engn, Tianjin 300387, Peoples R China
[4] Tianjin Key Lab Optoelect Detect Technol & Syst, Tianjin 300387, Peoples R China
关键词
Image super-resolution; Residual learning; Multi-scale feature fusion; Fractal network; INTERPOLATION;
D O I
10.1007/s10489-020-01909-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent studies have shown that the use of deep convolutional neural networks (CNNs) can improve the performance of single image super-resolution reconstruction (SISR) methods. However, the existing CNN-based SISR model ignores the multi-scale features and shallow and deep features of the image, resulting in relatively low image reconstruction performance. To address these issues, this paper proposes a new multi-scale fractal residual network (MSFRN) for image super-resolution. On the basis of residual learning, a multi-scale fractal residual block (MSFRB) is designed. This block uses convolution kernels of different sizes to extract image multi-scale features and uses multiple paths to extract and fuse image features of different depths. Then, the shallow features extracted at the shallow feature extraction stage and the local features output by all MSFRBs are used to perform global hierarchical feature fusion. Finally, through sub-pixel convolution, the fused global features are used to reconstruct high-resolution images from low-resolution images. The experimental results on the five standard benchmark datasets show that MSFRN improved subjective visual effects and objective image quality evaluation indicators, and is superior to other state-of-the-art SISR methods.
引用
收藏
页码:1845 / 1856
页数:12
相关论文
共 50 条
  • [1] Multi-scale fractal residual network for image super-resolution
    Xinxin Feng
    Xianguo Li
    Jianxiong Li
    [J]. Applied Intelligence, 2021, 51 : 1845 - 1856
  • [2] Image super-resolution with multi-scale fractal residual attention network
    Song, Xiaogang
    Liu, Wanbo
    Liang, Li
    Shi, Weiwei
    Xie, Guo
    Lu, Xiaofeng
    Hei, Xinhong
    [J]. COMPUTERS & GRAPHICS-UK, 2023, 113 : 21 - 31
  • [3] Multi-scale Residual Network for Image Super-Resolution
    Li, Juncheng
    Fang, Faming
    Mei, Kangfu
    Zhang, Guixu
    [J]. COMPUTER VISION - ECCV 2018, PT VIII, 2018, 11212 : 527 - 542
  • [4] Feedback Multi-scale Residual Dense Network for image super-resolution
    Lin, Zhengchun
    Li, Siyuan
    Jiang, Yunzhi
    Wang, Jing
    Luo, Qingxing
    [J]. Signal Processing: Image Communication, 2022, 107
  • [5] Feedback Multi-scale Residual Dense Network for image super-resolution
    Lin, Zhengchun
    Li, Siyuan
    Jiang, Yunzhi
    Wang, Jing
    Luo, Qingxing
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2022, 107
  • [6] Image super-resolution via enhanced multi-scale residual network
    Wang, MengJie
    Yang, Xiaomin
    Anisetti, Marco
    Zhang, Rongzhu
    Albertini, Marcelo Keese
    Liu, Kai
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2021, 152 : 57 - 66
  • [7] A lightweight multi-scale residual network for single image super-resolution
    Chen, Xiaole
    Yang, Ruifeng
    Guo, Chenxia
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (07) : 1793 - 1801
  • [8] A lightweight multi-scale residual network for single image super-resolution
    Xiaole Chen
    Ruifeng Yang
    Chenxia Guo
    [J]. Signal, Image and Video Processing, 2022, 16 : 1793 - 1801
  • [9] Multi-Scale Residual Fusion Network for Super-Resolution Reconstruction of Single Image
    Zhao, Baiting
    Hu, Rui
    Jia, Xiaofen
    Guo, Yongcun
    [J]. IEEE ACCESS, 2020, 8 (155285-155295) : 155285 - 155295
  • [10] Lightweight Image Super-Resolution via Weighted Multi-Scale Residual Network
    Long Sun
    Zhenbing Liu
    Xiyan Sun
    Licheng Liu
    Rushi Lan
    Xiaonan Luo
    [J]. IEEE/CAA Journal of Automatica Sinica, 2021, 8 (07) : 1271 - 1280