Attention-Based Real Image Restoration

被引:15
|
作者
Anwar, Saeed [1 ,2 ]
Barnes, Nick [3 ]
Petersson, Lars [1 ,2 ]
机构
[1] Australian Natl Univ, Imaging & Comp Vis Grp, CSIRO, Canberra, ACT 2600, Australia
[2] Australian Natl Univ, Sch Comp Sci & Engn, Canberra, ACT 2600, Australia
[3] Australian Natl Univ, Res Sch Elect Energy & Mat Engn, Canberra, ACT 2600, Australia
关键词
Noise reduction; Image restoration; Superresolution; Degradation; Computational modeling; Transform coding; Noise measurement; Convolutional neural networks (CNNs); deep learning; denoising; feature attention; image degradations; JPEG compression; raindrop removal; real restoration; super-resolution; NETWORK; REGULARIZATION; DEBLOCKING; ALGORITHM; FRAMEWORK;
D O I
10.1109/TNNLS.2021.3131739
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep convolutional neural networks perform better on images containing spatially invariant degradations, also known as synthetic degradations; however, their performance is limited on real-degraded photographs and requires multiple-stage network modeling. To advance the practicability of restoration algorithms, this article proposes a novel single-stage blind real image restoration network (R(2)Net) by employing a modular architecture. We use a residual on the residual structure to ease low-frequency information flow and apply feature attention to exploit the channel dependencies. Furthermore, the evaluation in terms of quantitative metrics and visual quality for four restoration tasks, i.e., denoising, super-resolution, raindrop removal, and JPEG compression on 11 real degraded datasets against more than 30 state-of-the-art algorithms, demonstrates the superiority of our R(2)Net. We also present the comparison on three synthetically generated degraded datasets for denoising to showcase our method's capability on synthetics denoising. The codes, trained models, and results are available on https://github.com/saeed-anwar/R2Net.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Attention-based neural network for polarimetric image denoising
    Liu, Hedong
    Zhang, Yizhu
    Cheng, Zhenzhou
    Zhai, Jingsheng
    Hu, Haofeng
    [J]. OPTICS LETTERS, 2022, 47 (11) : 2726 - 2729
  • [22] Multispectral attention-based network for single image deraining
    Gao, Weihao
    Zhang, Yongjun
    Jian, Huachun
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (01) : 691 - 701
  • [23] Person image generation with attention-based injection network
    Liu, Meichen
    Wang, Kejun
    Ji, Ruihang
    Ge, Shuzhi Sam
    Chen, Jing
    [J]. NEUROCOMPUTING, 2021, 460 : 345 - 359
  • [24] Attention-based Fusion Network for Image Forgery Localization
    Gong, Wenhui
    Chen, Yan
    Alam, Mohammad S.
    Sang, Jun
    [J]. PATTERN RECOGNITION AND PREDICTION XXXV, 2024, 13040
  • [25] A novel attention-based network for single image dehazing
    Gao, Weihao
    Zhang, Yongjun
    Jian, Huachun
    [J]. VISUAL COMPUTER, 2024, 40 (08): : 5681 - 5693
  • [26] Multispectral attention-based network for single image deraining
    Weihao Gao
    Yongjun Zhang
    Huachun Jian
    [J]. Signal, Image and Video Processing, 2024, 18 : 691 - 701
  • [27] Image Retrieval Using a Deep Attention-Based Hash
    Li, Xinlu
    Xu, Mengfei
    Xu, Jiabo
    Weise, Thomas
    Zou, Le
    Sun, Fei
    Wu, Zhize
    [J]. IEEE ACCESS, 2020, 8 (08): : 142229 - 142242
  • [28] An Attention-Based Network for Single Image HDR Reconstruction
    Dafaallah, Mohamed
    Yuan, Hui
    Jiang, Shiqi
    Yang, Ye
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022,
  • [29] Attention-based Saliency Hashing for Ophthalmic Image Retrieval
    Fang, Jiansheng
    Xu, Yanwu
    Zhang, Xiaoqing
    Hu, Yan
    Liu, Jiang
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 990 - 995
  • [30] Medical Image Segmentation on Attention-based Gaussian Blurring
    Mao, Yue-Tian
    Liu, Qing-Song
    Fang, Yin-Feng
    Jiang, Guo-Zhang
    Jiang, Du
    [J]. Sensors and Materials, 2024, 36 (11) : 4683 - 4694