Multi-scale strip-shaped convolution attention network for lightweight image super-resolution

被引:0
|
作者
Xu, Ke [1 ]
Pan, Lulu [1 ]
Peng, Guohua [1 ]
Zhang, Wenbo [1 ]
Lv, Yanheng [1 ]
Li, Guo [1 ]
Li, Lingxiao [1 ]
Lei, Le [1 ]
机构
[1] Northwestern Polytech Univ, Sch Math & Stat, Xian 710129, Peoples R China
基金
中国国家自然科学基金;
关键词
Image super-resolution; Strip convolution; Attention mechanism; Lightweight; Convolutional neural network;
D O I
10.1016/j.image.2024.117166
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Lightweight convolutional neural networks for Single Image Super-Resolution (SISR) have exhibited remarkable performance improvements in recent years. These models achieve excellent performance by relying on attention mechanisms that incorporate square-shaped convolutions to enhance feature representation. However, these approaches still suffer from redundancy which comes from square-shaped convolutional kernels and overlooks the utilization of multi-scale information. In this paper, we propose a novel attention mechanism called Multiscale Strip-shaped convolution Attention (MSA), which utilizes three sets of differently sized depth-wise separable stripe convolution kernels in parallel to replace the redundant square-shaped convolution attention and extract multi-scale features. We also generalize MSA to other lightweight neural network models, and experimental results show that MSA outperforms other convolutional based attention mechanisms. Building upon MSA, we propose an Efficient Feature Extraction Block (EFEB), a lightweight block for SISR. Finally, based on EFEB, we propose a lightweight image super-resolution neural network named Multi-scale Strip-shaped convolution Attention Network (MSAN). Experiments demonstrate that MSAN outperforms existing state-of-the-art lightweight SR methods with fewer parameters and lower computational complexity.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] TBNet: Stereo Image Super-Resolution with Multi-Scale Attention
    Zhu, Jiyang
    Han, Xue
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2023, 32 (18)
  • [42] Accurate and Lightweight MRI Super-Resolution Via Multi-Scale Bidirectional Fusion Attention Network
    organization, The School of Electronics and Information Engineering, University of Tongji, addressline=4800 Cao’an Road, Jiading District, Shanghai, China
    不详
    1600,
  • [43] Accurate and lightweight MRI super-resolution via multi-scale bidirectional fusion attention network
    Xu, Ling
    Li, Guanyao
    Chen, Qiaochuan
    PLOS ONE, 2022, 17 (12):
  • [44] Attention-enhanced multi-scale residual network for single image super-resolution
    Sun, Yubin
    Qin, Jiongming
    Gao, Xuliang
    Chai, Shuiqin
    Chen, Bin
    SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (05) : 1417 - 1424
  • [45] Super-Resolution Network with Information Distillation and Multi-Scale Attention for Medical CT Image
    Zhao, Tianliu
    Hu, Lei
    Zhang, Yongmei
    Fang, Jianying
    SENSORS, 2021, 21 (20)
  • [46] Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution
    Ma, Yimin
    Xu, Yi
    Liu, Yunqing
    Yan, Fei
    Zhang, Qiong
    Li, Qi
    Liu, Quanyang
    APPLIED SCIENCES-BASEL, 2024, 14 (06):
  • [47] Single image super-resolution via multi-scale residual channel attention network
    Cao, Feilong
    Liu, Huan
    NEUROCOMPUTING, 2019, 358 : 424 - 436
  • [48] Dual-attention guided multi-scale network for single image super-resolution
    Juan Wen
    Lei Zha
    Applied Intelligence, 2022, 52 : 12258 - 12271
  • [49] Attention-enhanced multi-scale residual network for single image super-resolution
    Yubin Sun
    Jiongming Qin
    Xuliang Gao
    Shuiqin Chai
    Bin Chen
    Signal, Image and Video Processing, 2022, 16 : 1417 - 1424
  • [50] Dual-attention guided multi-scale network for single image super-resolution
    Wen, Juan
    Zha, Lei
    APPLIED INTELLIGENCE, 2022, 52 (11) : 12258 - 12271