CVANet: Cascaded visual attention network for single image super-resolution

被引:35
|
作者
Zhang, Weidong [1 ]
Zhao, Wenyi [2 ]
Li, Jia [1 ]
Zhuang, Peixian [3 ]
Sun, Haihan [4 ]
Xu, Yibo [2 ]
Li, Chongyi [5 ]
机构
[1] Henan Inst Sci & Technol, Sch Informat Engn, Xinxiang 453003, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[3] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100084, Peoples R China
[4] Univ Tasmania, Sch Engn, Hobart, Tas 7005, Australia
[5] Nankai Univ, Sch Comp Sci, Tianjin 300073, Peoples R China
基金
中国国家自然科学基金;
关键词
Super-resolution; Feature attention; Channel attention; Pixel attention; Closely-related modules; OPTIMIZATION;
D O I
10.1016/j.neunet.2023.11.049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep convolutional neural networks (DCNNs) have exhibited excellent feature extraction and detail reconstruc-tion capabilities for single image super-resolution (SISR). Nevertheless, most previous DCNN-based methods do not fully utilize the complementary strengths between feature maps, channels, and pixels. Therefore, it hinders the ability of DCNNs to represent abundant features. To tackle the aforementioned issues, we present a Cascaded Visual Attention Network for SISR called CVANet, which simulates the visual attention mechanism of the human eyes to focus on the reconstruction process of details. Specifically, we first designed a trainable feature attention module (FAM) for feature-level attention learning. Afterward, we introduce a channel attention module (CAM) to reinforce feature maps under channel-level attention learning. Meanwhile, we propose a pixel attention module (PAM) that adaptively selects representative features from the previous layers, which are utilized to generate a high-resolution image. Satisfactory, our CVANet can effectively improve the resolution of images by exploring the feature representation capabilities of different modules and the visual perception properties of the human eyes. Extensive experiments with different methods on four benchmarks demonstrate that our CVANet outperforms the state-of-the-art (SOTA) methods in subjective visual perception, PSNR, and SSIM.The code will be made available https://github.com/WilyZhao8/CVANet.
引用
收藏
页码:622 / 634
页数:13
相关论文
共 50 条
  • [31] Single Image Super-Resolution Using Deep Hierarchical Attention Network
    Zhao, Fei
    Chen, Rui
    Li, Yuan
    [J]. PROCEEDINGS OF 2020 5TH INTERNATIONAL CONFERENCE ON MULTIMEDIA AND IMAGE PROCESSING (ICMIP 2020), 2020, : 80 - 85
  • [32] Second-order Attention Network for Single Image Super-Resolution
    Dai, Tao
    Cai, Jianrui
    Zhang, Yongbing
    Xia, Shu-Tao
    Zhang, Lei
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11057 - 11066
  • [33] Novel Channel Attention Residual Network for Single Image Super-Resolution
    Shi, Wenling
    Du, Huiqian
    Mei, Wenbo
    [J]. Journal of Beijing Institute of Technology (English Edition), 2020, 29 (03): : 345 - 353
  • [34] Mixed Attention Densely Residual Network for Single Image Super-Resolution
    Zhou, Jingjun
    Liu, Jing
    Li, Jingbing
    Huang, Mengxing
    Cheng, Jieren
    Chen, Yen-Wei
    Xu, Yingying
    Nawaz, Saqib Ali
    [J]. COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2021, 39 (01): : 133 - 146
  • [35] HRAN: Hybrid Residual Attention Network for Single Image Super-Resolution
    Muqeet, Abdul
    Bin Iqbal, Md Tauhid
    Bae, Sung-Ho
    [J]. IEEE ACCESS, 2019, 7 : 137020 - 137029
  • [36] Cascaded Residual Densely Connected Network for Image Super-Resolution
    Zou, Changjun
    Ye, Lintao
    [J]. KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2022, 16 (09): : 2882 - 2903
  • [37] Deep Super-Resolution Network for Single Image Super-Resolution with Realistic Degradations
    Umer, Rao Muhammad
    Foresti, Gian Luca
    Micheloni, Christian
    [J]. ICDSC 2019: 13TH INTERNATIONAL CONFERENCE ON DISTRIBUTED SMART CAMERAS, 2019,
  • [38] Residual shuffle attention network for image super-resolution
    Li, Xuanyi
    Shao, Zhuhong
    Li, Bicao
    Shang, Yuanyuan
    Wu, Jiasong
    Duan, Yuping
    [J]. MACHINE VISION AND APPLICATIONS, 2023, 34 (05)
  • [39] Attention mechanism feedback network for image super-resolution
    Chen, Xiao
    Jing, Ruyun
    Suna, Chaowen
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (04)
  • [40] Pyramid Attention Dense Network for Image Super-Resolution
    Chen, Si-Bao
    Hu, Chao
    Luo, Bin
    Ding, Chris H. Q.
    Huang, Shi-Lei
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,