Attention-Based Real Image Restoration

被引:15
|
作者
Anwar, Saeed [1 ,2 ]
Barnes, Nick [3 ]
Petersson, Lars [1 ,2 ]
机构
[1] Australian Natl Univ, Imaging & Comp Vis Grp, CSIRO, Canberra, ACT 2600, Australia
[2] Australian Natl Univ, Sch Comp Sci & Engn, Canberra, ACT 2600, Australia
[3] Australian Natl Univ, Res Sch Elect Energy & Mat Engn, Canberra, ACT 2600, Australia
关键词
Noise reduction; Image restoration; Superresolution; Degradation; Computational modeling; Transform coding; Noise measurement; Convolutional neural networks (CNNs); deep learning; denoising; feature attention; image degradations; JPEG compression; raindrop removal; real restoration; super-resolution; NETWORK; REGULARIZATION; DEBLOCKING; ALGORITHM; FRAMEWORK;
D O I
10.1109/TNNLS.2021.3131739
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep convolutional neural networks perform better on images containing spatially invariant degradations, also known as synthetic degradations; however, their performance is limited on real-degraded photographs and requires multiple-stage network modeling. To advance the practicability of restoration algorithms, this article proposes a novel single-stage blind real image restoration network (R(2)Net) by employing a modular architecture. We use a residual on the residual structure to ease low-frequency information flow and apply feature attention to exploit the channel dependencies. Furthermore, the evaluation in terms of quantitative metrics and visual quality for four restoration tasks, i.e., denoising, super-resolution, raindrop removal, and JPEG compression on 11 real degraded datasets against more than 30 state-of-the-art algorithms, demonstrates the superiority of our R(2)Net. We also present the comparison on three synthetically generated degraded datasets for denoising to showcase our method's capability on synthetics denoising. The codes, trained models, and results are available on https://github.com/saeed-anwar/R2Net.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Attention-based Adaptive Selection of Operations for Image Restoration in the Presence of Unknown Combined Distortions
    Suganuma, Masanori
    Liu, Xing
    Okatani, Takayuki
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9031 - 9040
  • [2] Attention-based multimodal image matching
    Moreshet, Aviad
    Keller, Yosi
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 241
  • [3] Visual Attention-Based Image Watermarking
    Bhowmik, Deepayan
    Oakes, Matthew
    Abhayaratne, Charith
    [J]. IEEE ACCESS, 2016, 4 : 8002 - 8018
  • [4] Attention-based Stylisation for Exemplar Image Colourisation
    Blanch, Marc Gorriz
    Khalifeh, Issa
    O'Connor, Noel E.
    Mrak, Marta
    [J]. IEEE MMSP 2021: 2021 IEEE 23RD INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2021,
  • [5] A New Attention-Based LSTM for Image Captioning
    Fen Xiao
    Wenfeng Xue
    Yanqing Shen
    Xieping Gao
    [J]. Neural Processing Letters, 2022, 54 : 3157 - 3171
  • [6] Attention-Based Segmentation on an Image Pyramid Sequence
    Atsumi, Masayasu
    [J]. ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, PROCEEDINGS, 2008, 5259 : 625 - 636
  • [7] Deep Attention-Based Imbalanced Image Classification
    Wang, Lituan
    Zhang, Lei
    Qi, Xiaofeng
    Yi, Zhang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (08) : 3320 - 3330
  • [8] A lightweight attention-based network for image dehazing
    Wei, Yunsong
    Li, Jiaqiang
    Wei, Rongkun
    Lin, Zuxiang
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (10) : 7271 - 7284
  • [9] An attention-based view of real options reasoning
    Barnett, Michael L.
    [J]. ACADEMY OF MANAGEMENT REVIEW, 2008, 33 (03): : 606 - 628
  • [10] A New Attention-Based LSTM for Image Captioning
    Xiao, Fen
    Xue, Wenfeng
    Shen, Yanqing
    Gao, Xieping
    [J]. NEURAL PROCESSING LETTERS, 2022, 54 (04) : 3157 - 3171