CVANet: Cascaded visual attention network for single image super-resolution

被引:35
|
作者
Zhang, Weidong [1 ]
Zhao, Wenyi [2 ]
Li, Jia [1 ]
Zhuang, Peixian [3 ]
Sun, Haihan [4 ]
Xu, Yibo [2 ]
Li, Chongyi [5 ]
机构
[1] Henan Inst Sci & Technol, Sch Informat Engn, Xinxiang 453003, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[3] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100084, Peoples R China
[4] Univ Tasmania, Sch Engn, Hobart, Tas 7005, Australia
[5] Nankai Univ, Sch Comp Sci, Tianjin 300073, Peoples R China
基金
中国国家自然科学基金;
关键词
Super-resolution; Feature attention; Channel attention; Pixel attention; Closely-related modules; OPTIMIZATION;
D O I
10.1016/j.neunet.2023.11.049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep convolutional neural networks (DCNNs) have exhibited excellent feature extraction and detail reconstruc-tion capabilities for single image super-resolution (SISR). Nevertheless, most previous DCNN-based methods do not fully utilize the complementary strengths between feature maps, channels, and pixels. Therefore, it hinders the ability of DCNNs to represent abundant features. To tackle the aforementioned issues, we present a Cascaded Visual Attention Network for SISR called CVANet, which simulates the visual attention mechanism of the human eyes to focus on the reconstruction process of details. Specifically, we first designed a trainable feature attention module (FAM) for feature-level attention learning. Afterward, we introduce a channel attention module (CAM) to reinforce feature maps under channel-level attention learning. Meanwhile, we propose a pixel attention module (PAM) that adaptively selects representative features from the previous layers, which are utilized to generate a high-resolution image. Satisfactory, our CVANet can effectively improve the resolution of images by exploring the feature representation capabilities of different modules and the visual perception properties of the human eyes. Extensive experiments with different methods on four benchmarks demonstrate that our CVANet outperforms the state-of-the-art (SOTA) methods in subjective visual perception, PSNR, and SSIM.The code will be made available https://github.com/WilyZhao8/CVANet.
引用
收藏
页码:622 / 634
页数:13
相关论文
共 50 条
  • [1] Channel attention based wavelet cascaded network for image super-resolution
    陈健
    HUANG Detian
    HUANG Weiqin
    [J]. High Technology Letters, 2022, 28 (02) : 197 - 207
  • [2] Region Attention Network For Single Image Super-resolution
    Du, Xiaobiao
    Liu, Chongjin
    Yang, Xiaoling
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [3] Upsampling Attention Network for Single Image Super-resolution
    Zheng, Zhijie
    Jiao, Yuhang
    Fang, Guangyou
    [J]. VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 4: VISAPP, 2021, : 399 - 406
  • [4] Channel attention based wavelet cascaded network for image super-resolution
    Chen, Jian
    Huang, Detian
    Huang, Weiqin
    [J]. High Technology Letters, 2022, 28 (02) : 197 - 207
  • [5] Kernel Attention Network for Single Image Super-Resolution
    Zhang, Dongyang
    Shao, Jie
    Shen, Heng Tao
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2020, 16 (03)
  • [6] SINGLE FUNDUS IMAGE SUPER-RESOLUTION VIA CASCADED CHANNEL-WISE ATTENTION NETWORK
    Fan, Zhihao
    Dan, Tingting
    Yu, Honghua
    Liu, Baoyi
    Car, Hongmin
    [J]. 42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 1984 - 1987
  • [7] PYRAMID FUSION ATTENTION NETWORK FOR SINGLE IMAGE SUPER-RESOLUTION
    He, Hao
    Du, Zongcai
    Li, Wenfeng
    Tang, Jie
    Wu, Gangshan
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2165 - 2169
  • [8] Deep coordinate attention network for single image super-resolution
    Xie, Chao
    Zhu, Hongyu
    Fei, Yeqi
    [J]. IET IMAGE PROCESSING, 2022, 16 (01) : 273 - 284
  • [9] SRGAT: Single Image Super-Resolution With Graph Attention Network
    Yan, Yanyang
    Ren, Wenqi
    Hu, Xiaobin
    Li, Kun
    Shen, Haifeng
    Cao, Xiaochun
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4905 - 4918
  • [10] Fused pyramid attention network for single image super-resolution
    Chen, Shi
    Bi, Xiuping
    Zhang, Lefei
    [J]. IET IMAGE PROCESSING, 2023, 17 (06) : 1681 - 1693