Attention mechanism feedback network for image super-resolution

被引:6
|
作者
Chen, Xiao [1 ,2 ]
Jing, Ruyun [1 ]
Suna, Chaowen [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Elect & Informat Engn, Nanjing, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Nanjing, Peoples R China
关键词
image super-resolution; separable convolution; upper and lower projection units; attention mechanism; feedback network; FRACTIONAL DERIVATIVE METHOD; RATE CONTROL ALGORITHM; LAMB WAVE SIGNALS; NOISE;
D O I
10.1117/1.JEI.31.4.043006
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The number of photosensitive elements in the image sensor determines the resolution of the original image. One promising method for increasing the resolution of an image without increasing hardware cost is image super-resolution. Many existing image super-resolution methods based on deep learning lack feedback mechanisms and deal with feature channels equally, which hinders the expressive ability of deep learning networks and makes it difficult to resolve the dependence between high- and low-resolution (LR) images. An image super-resolution method based on an attention mechanism feedback network was presented in this study. First, the proposed multiscale separable convolution layer is used to extract the characteristics of the input image. Second, a feedback module is designed to process the feedback connections between subnetworks and generate richer high-level representations through densely connected upper and lower projection units, enabling the recovery of high-resolution (HR) images from LR images. Subsequently, an attention mechanism is introduced in the feedback module to redistribute channel attention resources, enhance interdependence between channels, and focus the network on learning high-frequency information. Finally, the reconstructed image was gradually generated using the reconstruction layer through an iterative network. The experimental results for x2 to x8 image super-resolution on five standard datasets showed that the quality of the reconstructed image of the proposed method outperforms that of the comparative image super-resolution methods in terms of subjective perception and objective evaluation indices. It can retain more detail for super-resolution and obtain better HR images.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Infrared image super-resolution reconstruction by using generative adversarial network with an attention mechanism
    Qing-Ming Liu
    Rui-Sheng Jia
    Yan-Bo Liu
    Hai-Bin Sun
    Jian-Zhi Yu
    Hong-Mei Sun
    Applied Intelligence, 2021, 51 : 2018 - 2030
  • [42] Residual deep attention mechanism and adaptive reconstruction network for single image super-resolution
    Wang, Hongjuan
    Wei, Mingrun
    Cheng, Ru
    Yu, Yue
    Zhang, Xingli
    APPLIED INTELLIGENCE, 2022, 52 (05) : 5197 - 5211
  • [43] Image super-resolution reconstruction based on generative adversarial network model with feedback and attention mechanisms
    Wang, Yongqiang
    Li, Xue
    Nan, Fangzhe
    Liu, Feng
    Li, Hua
    Wang, Haitao
    Qian, Yurong
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (05) : 6633 - 6652
  • [44] Self-attention negative feedback network for real-time image super-resolution
    Liu, Xiangbin
    Chen, Shuqi
    Song, Liping
    Wozniak, Marcin
    Liu, Shuai
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (08) : 6179 - 6186
  • [45] Image super-resolution reconstruction based on generative adversarial network model with feedback and attention mechanisms
    Yongqiang Wang
    Xue Li
    Fangzhe Nan
    Feng Liu
    Hua Li
    Haitao Wang
    Yurong Qian
    Multimedia Tools and Applications, 2022, 81 : 6633 - 6652
  • [46] A Novel Image Super-Resolution Method Based on Attention Mechanism
    Li, Da
    Wang, Yan
    Liu, Dong
    Li, Ruifang
    2020 4TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND INFORMATION TECHNOLOGY (CMVIT 2020), 2020, 1518
  • [47] SRGAT: Single Image Super-Resolution With Graph Attention Network
    Yan, Yanyang
    Ren, Wenqi
    Hu, Xiaobin
    Li, Kun
    Shen, Haifeng
    Cao, Xiaochun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4905 - 4918
  • [48] Information-Growth Attention Network for Image Super-Resolution
    Li, Zhuangzi
    Li, Ge
    Li, Thomas
    Liu, Shan
    Gao, Wei
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 544 - 552
  • [49] Lightweight image super-resolution with multiscale residual attention network
    Xiao, Cunjun
    Dong, Hui
    Li, Haibin
    Li, Yaqian
    Zhang, Wenming
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (04)
  • [50] PYRAMID FUSION ATTENTION NETWORK FOR SINGLE IMAGE SUPER-RESOLUTION
    He, Hao
    Du, Zongcai
    Li, Wenfeng
    Tang, Jie
    Wu, Gangshan
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2165 - 2169