Wavelet Approximation-Aware Residual Network for Single Image Deraining

被引:8
|
作者
Hsu, Wei-Yen [1 ,2 ,3 ]
Chang, Wei-Chi [1 ]
机构
[1] Natl Chung Cheng Univ, Dept Informat Management, Chiayi 62102, Taiwan
[2] Natl Chung Cheng Univ, Adv Inst Mfg Hightech Innovat, Chiayi 62102, Taiwan
[3] Natl Chung Cheng Univ, Ctr Innovat Res Aging Soc CIRAS, Chiayi 62102, Taiwan
关键词
Approximation awareness; level blending; single image deraining; wavelet pyramid; RAIN; TRANSFORM; DISCRETE; REMOVAL;
D O I
10.1109/TPAMI.2023.3307666
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
It has been made great progress on single image deraining based on deep convolutional neural networks (CNNs). In most existing deep deraining methods, CNNs aim to learn a direct mapping from rainy images to clean rain-less images, and their architectures are becoming more and more complex. However, due to the limitation of mixing rain with object edges and background, it is difficult to separate rain and object/background, and the edge details of the image cannot be effectively recovered in the reconstruction process. To address this problem, we propose a novel wavelet approximation-aware residual network (WAAR), wherein rain is effectively removed from both low-frequency structures and high-frequency details at each level separately, especially in low-frequency sub-images at each level. After wavelet transform, we propose novel approximation aware (AAM) and approximation level blending (ALB) mechanisms to further aid the low-frequency networks at each level recover the structure and texture of low-frequency sub-images recursively, while the high frequency network can effectively eliminate rain streaks through block connection and achieve different degrees of edge detail enhancement by adjusting hyperparameters. In addition, we also introduce block connection to enrich the high-frequency details in the high-frequency network, which is favorable for obtaining potential interdependencies between high- and low-frequency features. Experimental results indicate that the proposed WAAR exhibits strong performance in reconstructing clean and rain-free images, recovering real and undistorted texture structures, and enhancing image edges in comparison with the state-of-the-art approaches on synthetic and real image datasets. It shows the effectiveness of our method, especially on image edges and texture details.
引用
收藏
页码:15979 / 15995
页数:17
相关论文
共 50 条
  • [21] Security and Approximation: Vulnerabilities in Approximation-Aware Testing
    Dou, Yuqin
    Gu, Chongyan
    Wang, Chenghua
    Liu, Weiqiang
    Lombardi, Fabrizio
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2023, 11 (01) : 265 - 271
  • [22] Selective Wavelet Attention Learning for Single Image Deraining
    Huaibo Huang
    Aijing Yu
    Zhenhua Chai
    Ran He
    Tieniu Tan
    International Journal of Computer Vision, 2021, 129 : 1282 - 1300
  • [23] Selective Wavelet Attention Learning for Single Image Deraining
    Huang, Huaibo
    Yu, Aijing
    Chai, Zhenhua
    He, Ran
    Tan, Tieniu
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (04) : 1282 - 1300
  • [24] Degradation-Aware Transformer for Single Image Deraining
    Zhao, Peijun
    Wang, Tongjun
    IEEE ACCESS, 2023, 11 : 97274 - 97283
  • [25] Approximation-aware Testing for Approximate Circuits
    Chandrasekharan, Arun
    Eggersgluess, Stephan
    Grolsse, Daniel
    Drechsler, Rolf
    2018 23RD ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE (ASP-DAC), 2018, : 239 - 244
  • [26] Deep Residual Haze Network for Image Dehazing and Deraining
    Wang, Chuansheng
    Li, Zuoyong
    Wu, Jiawei
    Fan, Haoyi
    Xiao, Guobao
    Zhang, Hong
    IEEE ACCESS, 2020, 8 : 9488 - 9500
  • [27] Recursive residual Fourier transformation for single image deraining
    Bao, Zhiyuan
    Shao, Mingwen
    Wan, Yecong
    Qiao, Yuanjian
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (05) : 1743 - 1754
  • [28] Single image deraining via deep residual attention and encoder-decoder network
    Wei, Mingrun
    Wang, Hongjuan
    Cheng, Ru
    Yu, Yue
    Wang, Lukun
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 43 (03) : 3453 - 3467
  • [29] Recurrent context-aware multi-stage network for single image deraining
    Liu, Yuetong
    Zhang, Rui
    Zhang, Yunfeng
    Pan, Xiao
    Yao, Xunxiang
    Ni, Zhaorui
    Han, Huijian
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 227
  • [30] Recurrent multi-level residual and global attention network for single image deraining
    Meihua Wang
    Chao Li
    Fanhui Ke
    Neural Computing and Applications, 2023, 35 : 3697 - 3708