CVANet: Cascaded visual attention network for single image super-resolution

被引:35
|
作者
Zhang, Weidong [1 ]
Zhao, Wenyi [2 ]
Li, Jia [1 ]
Zhuang, Peixian [3 ]
Sun, Haihan [4 ]
Xu, Yibo [2 ]
Li, Chongyi [5 ]
机构
[1] Henan Inst Sci & Technol, Sch Informat Engn, Xinxiang 453003, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[3] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100084, Peoples R China
[4] Univ Tasmania, Sch Engn, Hobart, Tas 7005, Australia
[5] Nankai Univ, Sch Comp Sci, Tianjin 300073, Peoples R China
基金
中国国家自然科学基金;
关键词
Super-resolution; Feature attention; Channel attention; Pixel attention; Closely-related modules; OPTIMIZATION;
D O I
10.1016/j.neunet.2023.11.049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep convolutional neural networks (DCNNs) have exhibited excellent feature extraction and detail reconstruc-tion capabilities for single image super-resolution (SISR). Nevertheless, most previous DCNN-based methods do not fully utilize the complementary strengths between feature maps, channels, and pixels. Therefore, it hinders the ability of DCNNs to represent abundant features. To tackle the aforementioned issues, we present a Cascaded Visual Attention Network for SISR called CVANet, which simulates the visual attention mechanism of the human eyes to focus on the reconstruction process of details. Specifically, we first designed a trainable feature attention module (FAM) for feature-level attention learning. Afterward, we introduce a channel attention module (CAM) to reinforce feature maps under channel-level attention learning. Meanwhile, we propose a pixel attention module (PAM) that adaptively selects representative features from the previous layers, which are utilized to generate a high-resolution image. Satisfactory, our CVANet can effectively improve the resolution of images by exploring the feature representation capabilities of different modules and the visual perception properties of the human eyes. Extensive experiments with different methods on four benchmarks demonstrate that our CVANet outperforms the state-of-the-art (SOTA) methods in subjective visual perception, PSNR, and SSIM.The code will be made available https://github.com/WilyZhao8/CVANet.
引用
收藏
页码:622 / 634
页数:13
相关论文
共 50 条
  • [41] Context Reasoning Attention Network for Image Super-Resolution
    Zhang, Yulun
    Wei, Donglai
    Qin, Can
    Wang, Huan
    Pfister, Hanspeter
    Fu, Yun
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4258 - 4267
  • [42] Pixel attention convolutional network for image super-resolution
    Wang, Xin
    Zhang, Shufen
    Lin, Yuanyuan
    Lyu, Yanxia
    Zhang, Jiale
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (11): : 8589 - 8599
  • [43] Edge Attention Network for Image Deblurring and Super-Resolution
    Han, Jong-Wook
    Choi, Jun-Ho
    Kim, Jun-Hyuk
    Lee, Jong-Seok
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 2401 - 2406
  • [44] Image super-resolution with parallel convolution attention network
    Zhang, Qiao
    Yang, Xiaomin
    Xiao, Long
    Yang, Feng
    Hussain, Farhan
    Won Kim, Pyoung
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (22):
  • [45] Residual shuffle attention network for image super-resolution
    Xuanyi Li
    Zhuhong Shao
    Bicao Li
    Yuanyuan Shang
    Jiasong Wu
    Yuping Duan
    [J]. Machine Vision and Applications, 2023, 34
  • [46] Augmented global attention network for image super-resolution
    Du, Xiaobiao
    Jiang, Saibiao
    Liu, Jie
    [J]. IET IMAGE PROCESSING, 2022, 16 (02) : 567 - 575
  • [47] Stratified attention dense network for image super-resolution
    Zhiwei Liu
    Xiaofeng Mao
    Ji Huang
    Menghan Gan
    Yueyuan Zhang
    [J]. Signal, Image and Video Processing, 2022, 16 : 715 - 722
  • [48] Attention augmented multi-scale network for single image super-resolution
    Xiong, Chengyi
    Shi, Xiaodi
    Gao, Zhirong
    Wang, Ge
    [J]. APPLIED INTELLIGENCE, 2021, 51 (02) : 935 - 951
  • [49] Deep and adaptive feature extraction attention network for single image super-resolution
    Lin, Jianpu
    Liao, Lizhao
    Lin, Shanling
    Lin, Zhixian
    Guo, Tailiang
    [J]. JOURNAL OF THE SOCIETY FOR INFORMATION DISPLAY, 2024, 32 (01) : 23 - 33
  • [50] Deep recurrent residual channel attention network for single image super-resolution
    Liu, Yepeng
    Yang, Dezhi
    Zhang, Fan
    Xie, Qingsong
    Zhang, Caiming
    [J]. VISUAL COMPUTER, 2024, 40 (05): : 3441 - 3456