Attention mechanism feedback network for image super-resolution

被引:6
|
作者
Chen, Xiao [1 ,2 ]
Jing, Ruyun [1 ]
Suna, Chaowen [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Elect & Informat Engn, Nanjing, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Nanjing, Peoples R China
关键词
image super-resolution; separable convolution; upper and lower projection units; attention mechanism; feedback network; FRACTIONAL DERIVATIVE METHOD; RATE CONTROL ALGORITHM; LAMB WAVE SIGNALS; NOISE;
D O I
10.1117/1.JEI.31.4.043006
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The number of photosensitive elements in the image sensor determines the resolution of the original image. One promising method for increasing the resolution of an image without increasing hardware cost is image super-resolution. Many existing image super-resolution methods based on deep learning lack feedback mechanisms and deal with feature channels equally, which hinders the expressive ability of deep learning networks and makes it difficult to resolve the dependence between high- and low-resolution (LR) images. An image super-resolution method based on an attention mechanism feedback network was presented in this study. First, the proposed multiscale separable convolution layer is used to extract the characteristics of the input image. Second, a feedback module is designed to process the feedback connections between subnetworks and generate richer high-level representations through densely connected upper and lower projection units, enabling the recovery of high-resolution (HR) images from LR images. Subsequently, an attention mechanism is introduced in the feedback module to redistribute channel attention resources, enhance interdependence between channels, and focus the network on learning high-frequency information. Finally, the reconstructed image was gradually generated using the reconstruction layer through an iterative network. The experimental results for x2 to x8 image super-resolution on five standard datasets showed that the quality of the reconstructed image of the proposed method outperforms that of the comparative image super-resolution methods in terms of subjective perception and objective evaluation indices. It can retain more detail for super-resolution and obtain better HR images.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] FNSAM: Image super-resolution using a feedback network with self-attention mechanism
    Huang, Yu
    Wang, Wenqian
    Li, Min
    TECHNOLOGY AND HEALTH CARE, 2023, 31 : S383 - S395
  • [2] Feedback Network for Image Super-Resolution
    Li, Zhen
    Yang, Jinglei
    Liu, Zheng
    Yang, Xiaomin
    Jeon, Gwanggil
    Wu, Wei
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3862 - 3871
  • [3] Edge-Enhanced with Feedback Attention Network for Image Super-Resolution
    Fu, Chunmei
    Yin, Yong
    SENSORS, 2021, 21 (06) : 1 - 16
  • [4] Face image super-resolution with an attention mechanism
    Chen X.
    Shen H.
    Bian Q.
    Wang Z.
    Tian X.
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2019, 46 (03): : 148 - 153
  • [5] Adaptive Attention Network for Image Super-resolution
    Chen Y.-M.
    Zhou D.-W.
    Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (08): : 1950 - 1960
  • [6] Gated Multi-Attention Feedback Network for Medical Image Super-Resolution
    Shang, Jianrun
    Zhang, Xue
    Zhang, Guisheng
    Song, Wenhao
    Chen, Jinyong
    Li, Qilei
    Gao, Mingliang
    ELECTRONICS, 2022, 11 (21)
  • [7] Super-Resolution Generative Adversarial Network Based on the Dual Dimension Attention Mechanism for Biometric Image Super-Resolution
    Huang, Chi-En
    Li, Yung-Hui
    Aslam, Muhammad Saqlain
    Chang, Ching-Chun
    SENSORS, 2021, 21 (23)
  • [8] Image super-resolution network based on a multi-branch attention mechanism
    Xin Yang
    Yingqing Guo
    Zhiqiang Li
    Dake Zhou
    Signal, Image and Video Processing, 2021, 15 : 1397 - 1405
  • [9] Image super-resolution network based on a multi-branch attention mechanism
    Yang, Xin
    Guo, Yingqing
    Li, Zhiqiang
    Zhou, Dake
    SIGNAL IMAGE AND VIDEO PROCESSING, 2021, 15 (07) : 1397 - 1405
  • [10] Context Reasoning Attention Network for Image Super-Resolution
    Zhang, Yulun
    Wei, Donglai
    Qin, Can
    Wang, Huan
    Pfister, Hanspeter
    Fu, Yun
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4258 - 4267