Wavelet Approximation-Aware Residual Network for Single Image Deraining

被引:8
|
作者
Hsu, Wei-Yen [1 ,2 ,3 ]
Chang, Wei-Chi [1 ]
机构
[1] Natl Chung Cheng Univ, Dept Informat Management, Chiayi 62102, Taiwan
[2] Natl Chung Cheng Univ, Adv Inst Mfg Hightech Innovat, Chiayi 62102, Taiwan
[3] Natl Chung Cheng Univ, Ctr Innovat Res Aging Soc CIRAS, Chiayi 62102, Taiwan
关键词
Approximation awareness; level blending; single image deraining; wavelet pyramid; RAIN; TRANSFORM; DISCRETE; REMOVAL;
D O I
10.1109/TPAMI.2023.3307666
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
It has been made great progress on single image deraining based on deep convolutional neural networks (CNNs). In most existing deep deraining methods, CNNs aim to learn a direct mapping from rainy images to clean rain-less images, and their architectures are becoming more and more complex. However, due to the limitation of mixing rain with object edges and background, it is difficult to separate rain and object/background, and the edge details of the image cannot be effectively recovered in the reconstruction process. To address this problem, we propose a novel wavelet approximation-aware residual network (WAAR), wherein rain is effectively removed from both low-frequency structures and high-frequency details at each level separately, especially in low-frequency sub-images at each level. After wavelet transform, we propose novel approximation aware (AAM) and approximation level blending (ALB) mechanisms to further aid the low-frequency networks at each level recover the structure and texture of low-frequency sub-images recursively, while the high frequency network can effectively eliminate rain streaks through block connection and achieve different degrees of edge detail enhancement by adjusting hyperparameters. In addition, we also introduce block connection to enrich the high-frequency details in the high-frequency network, which is favorable for obtaining potential interdependencies between high- and low-frequency features. Experimental results indicate that the proposed WAAR exhibits strong performance in reconstructing clean and rain-free images, recovering real and undistorted texture structures, and enhancing image edges in comparison with the state-of-the-art approaches on synthetic and real image datasets. It shows the effectiveness of our method, especially on image edges and texture details.
引用
收藏
页码:15979 / 15995
页数:17
相关论文
共 50 条
  • [1] Recurrent wavelet structure-preserving residual network for single image deraining
    Hsu, Wei-Yen
    Chang, Wei-Chi
    PATTERN RECOGNITION, 2023, 137
  • [2] Single image deraining based on the concatenation residual network
    Chen Qing-jiang
    Wu Tian-tian
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2021, 36 (04) : 605 - 614
  • [3] DAWN: Direction-aware Attention Wavelet Network for Image Deraining
    Jiang, Kui
    Liu, Wenxuan
    Wang, Zheng
    Zhong, Xian
    Jiang, Junjun
    Lin, Chia-Wen
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 7065 - 7074
  • [4] Residual-Guide Network for Single Image Deraining
    Fan, Zhiwen
    Wu, Huafeng
    Fu, Xueyang
    Huang, Yue
    Ding, Xinghao
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 1751 - 1759
  • [5] Residual Contextual Hourglass Network for Single-Image Deraining
    Zhou, Weina
    Ye, Linhui
    Wang, Xiu
    NEURAL PROCESSING LETTERS, 2024, 56 (02)
  • [6] Residual Contextual Hourglass Network for Single-Image Deraining
    Weina Zhou
    Linhui Ye
    Xiu Wang
    Neural Processing Letters, 56
  • [7] Complementary Parallel Residual Attention Network for Single Image Deraining
    Gai, Shan
    Yin, Minglei
    Zhi, Yuan
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2025, 44 (02) : 1400 - 1425
  • [8] WAVELET CHANNEL ATTENTION MODULE WITH A FUSION NETWORK FOR SINGLE IMAGE DERAINING
    Yang, Hao-Hsiang
    Yang, Chao-Han Huck
    Wang, Yu-Chiang Frank
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 883 - 887
  • [9] Context-detail-aware United Network for Single Image Deraining
    Hsu, Wei-Yen
    Lin, Hsien-Wen
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (05)
  • [10] DWTN: deep wavelet transform network for lightweight single image deraining
    Tao, Wenyin
    Yan, Xuefeng
    Wang, Yongzhen
    Wei, Mingqiang
    ADVANCES IN CONTINUOUS AND DISCRETE MODELS, 2024, 2024 (01):