MFFN: image super-resolution via multi-level features fusion network

被引:81
|
作者
Chen, Yuantao [1 ]
Xia, Runlong [2 ,3 ]
Yang, Kai [4 ]
Zou, Ke [5 ]
机构
[1] Hunan Univ Informat Technol, Sch Comp Sci & Engn, Changsha, Hunan, Peoples R China
[2] Mt Yuelu Breeding Innovat Ctr Ltd, Changsha, Peoples R China
[3] Hunan Prov Sci & Technol Affairs Ctr, Changsha, Hunan, Peoples R China
[4] Hunan ZOOMLION Intelligent Technology Corp Ltd, Changsha, Hunan, Peoples R China
[5] Hunan WUJO High Tech Mat Corp Ltd, Loudi, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 02期
关键词
Residual learning; Multi-level features; Super-resolution; Convolutional neural network; Lightweight;
D O I
10.1007/s00371-023-02795-0
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deep convolutional neural networks can effectively improve the performance of single-image super-resolution reconstruction. Deep networks tend to achieve better performance than others. However, the deep CNNs will lead to a dramatic increase in the size of parameters, limiting its application on embedding and resource-constrained devices, such as smart phone. To address the common problems of blurred image edges, inflexible convolution kernel size selection and slow convergence during training procedure due to redundant network structure in image super-resolution algorithms, this paper proposes a lightweight single-image super-resolution network that fusesmulti-level features. The components are mainly two-level nested residual blocks. To better extract features and reduce the number of parameters, each residual block adopts an asymmetric structure. Firstly, it expands twice and then compresses the number of channels twice. Secondly, in the residual block, the feature information of different channels is weighted and fused by adding an autocorrelation weight unit. The quality of the reconstructed image of the proposed method is superior to the existing image super-resolution reconstruction methods in both subjective perception and objective evaluation indicators, and the reconstruction performance is better when the factor is large.
引用
收藏
页码:489 / 504
页数:16
相关论文
共 50 条
  • [1] MFFN: image super-resolution via multi-level features fusion network
    Yuantao Chen
    Runlong Xia
    Kai Yang
    Ke Zou
    [J]. The Visual Computer, 2024, 40 (2) : 489 - 504
  • [2] Multi-level Feature Fusion Network for Single Image Super-Resolution
    Zhang, Xinxia
    Zhang, Xiaoqin
    Zhao, Li
    Jiang, Runhua
    Huang, Pengcheng
    Xu, Jiawei
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 3361 - 3368
  • [3] Channel Attention and Multi-level Features Fusion for Single Image Super-Resolution
    Lu, Yue
    Zhou, Yun
    Jiang, Zhuqing
    Guo, Xiaoqiang
    Yang, Zixuan
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP), 2018,
  • [4] Single image super-resolution with multi-level feature fusion recursive network
    Jin, Xin
    Xiong, Qiming
    Xiong, Chengyi
    Li, Zhibang
    Gao, Zhirong
    [J]. NEUROCOMPUTING, 2019, 370 : 166 - 173
  • [5] Multi-level Feature Fusion Mechanism for Single Image Super-Resolution
    Lyn, Jiawen
    [J]. 2020 THE 3RD INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTICS AND CONTROL ENGINEERING (IRCE 2020), 2020, : 52 - 57
  • [6] Multi-level U-net network for image super-resolution reconstruction
    Han, Ning
    Zhou, Li
    Xie, Zhengmao
    Zheng, Jingli
    Zhang, Liuxin
    [J]. DISPLAYS, 2022, 73
  • [7] MFFN: Multi-path feedback fusion network for lightweight image super resolution
    Xue, Lixia
    Shen, Junhui
    Wang, Ronggui
    Yang, Juan
    [J]. IET IMAGE PROCESSING, 2023, 17 (14) : 4190 - 4201
  • [8] Image super-resolution using multi-level high-frequency feature fusion
    Cai, Zhiyuan
    Xiaol, Junsheng
    [J]. 2022 IEEE 6TH ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2022, : 737 - 742
  • [9] Hyperspectral image super-resolution based on the transfer of both spectra and multi-level features
    Cao, Xuheng
    Lian, Yusheng
    Liu, Zilong
    Zhou, Han
    Hu, Xiangmei
    Huang, Beiqing
    Zhang, Wan
    [J]. OPTICS LETTERS, 2022, 47 (14) : 3431 - 3434
  • [10] Deep multi-level up-projection network for single image super-resolution
    Shen, Yan
    Zhang, Liao
    Chen, Yun
    Xie, Yi
    Wang, Zhongli
    Shao, Xiaotao
    [J]. IET IMAGE PROCESSING, 2021, 15 (02) : 325 - 336