A Multi-Branch Feature Extraction Residual Network for Lightweight Image Super-Resolution

被引:0
|
作者
Liu, Chunying [1 ]
Wan, Xujie [1 ]
Gao, Guangwei [1 ,2 ]
机构
[1] Nanjing Univ Posts & Telecommun, Inst Adv Technol, Nanjing 210046, Peoples R China
[2] Soochow Univ, Prov Key Lab Comp Informat Proc Technol, Suzhou 215006, Peoples R China
关键词
single-image super-resolution; lightweight network; multi-branch feature extraction; transformer;
D O I
10.3390/math12172736
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Single-image super-resolution (SISR) seeks to elucidate the mapping relationships between low-resolution and high-resolution images. However, high-performance network models often entail a significant number of parameters and computations, presenting limitations in practical applications. Therefore, prioritizing a light weight and efficiency becomes crucial when applying image super-resolution (SR) to real-world scenarios. We propose a straightforward and efficient method, the Multi-Branch Feature Extraction Residual Network (MFERN), to tackle lightweight image SR through the fusion of multi-information self-calibration and multi-attention information. Specifically, we have devised a Multi-Branch Residual Feature Fusion Module (MRFFM) that leverages a multi-branch residual structure to succinctly and effectively fuse multiple pieces of information. Within the MRFFM, we have designed the Multi-Scale Attention Feature Fusion Block (MAFFB) to adeptly extract features via convolution and self-calibration attention operations. Furthermore, we introduce a Dual Feature Calibration Block (DFCB) to dynamically fuse feature information using dynamic weight values derived from the upper and lower branches. Additionally, to overcome the limitation of convolution in solely extracting local information, we incorporate a Transformer module to effectively integrate global information. The experimental results demonstrate that our MFERN exhibits outstanding performance in terms of model parameters and overall performance.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Residual multi-branch distillation network for efficient image super-resolution
    Gao, Xiang
    Zhou, Ying
    Wu, Sining
    Wu, Xinrong
    Wang, Fan
    Hu, Xiaopeng
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (30) : 75217 - 75241
  • [2] Multi-Branch Deep Residual Network for Single Image Super-Resolution
    Liu, Peng
    Hong, Ying
    Liu, Yan
    [J]. ALGORITHMS, 2018, 11 (10)
  • [3] Multi-Branch Neural Architecture Search for Lightweight Image Super-Resolution
    Ahn, Joon Young
    Cho, Nam Ik
    [J]. IEEE ACCESS, 2021, 9 : 153633 - 153646
  • [4] Single-image super-resolution based on multi-branch residual pyramid network
    Ou, Jiayu
    Xia, Hao
    Huo, Wenxiao
    Yan, Yejin
    Li, Tianping
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (06) : 2569 - 2581
  • [5] Single-image super-resolution based on multi-branch residual pyramid network
    Jiayu Ou
    Hao Xia
    Wenxiao Huo
    Yejin Yan
    Tianping Li
    [J]. Journal of Real-Time Image Processing, 2021, 18 : 2569 - 2581
  • [6] Channel rearrangement multi-branch network for image super-resolution
    Wei, Deyun
    Wang, Zhaowu
    [J]. DIGITAL SIGNAL PROCESSING, 2022, 120
  • [7] Lightweight image super-resolution with feature enhancement residual network
    Hui, Zheng
    Gao, Xinbo
    Wang, Xiumei
    [J]. NEUROCOMPUTING, 2020, 404 : 50 - 60
  • [8] Multi-Residual Feature Fusion Network for lightweight Single Image Super-Resolution
    Qin, Jiayi
    He, Zheng
    Yan, Binyu
    Jeon, Gwanggil
    Yang, Xiaomin
    [J]. 2021 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2021, : 1511 - 1518
  • [9] Image super-resolution network based on a multi-branch attention mechanism
    Xin Yang
    Yingqing Guo
    Zhiqiang Li
    Dake Zhou
    [J]. Signal, Image and Video Processing, 2021, 15 : 1397 - 1405
  • [10] Image super-resolution network based on a multi-branch attention mechanism
    Yang, Xin
    Guo, Yingqing
    Li, Zhiqiang
    Zhou, Dake
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2021, 15 (07) : 1397 - 1405