Wavelet Approximation-Aware Residual Network for Single Image Deraining

被引:8
|
作者
Hsu, Wei-Yen [1 ,2 ,3 ]
Chang, Wei-Chi [1 ]
机构
[1] Natl Chung Cheng Univ, Dept Informat Management, Chiayi 62102, Taiwan
[2] Natl Chung Cheng Univ, Adv Inst Mfg Hightech Innovat, Chiayi 62102, Taiwan
[3] Natl Chung Cheng Univ, Ctr Innovat Res Aging Soc CIRAS, Chiayi 62102, Taiwan
关键词
Approximation awareness; level blending; single image deraining; wavelet pyramid; RAIN; TRANSFORM; DISCRETE; REMOVAL;
D O I
10.1109/TPAMI.2023.3307666
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
It has been made great progress on single image deraining based on deep convolutional neural networks (CNNs). In most existing deep deraining methods, CNNs aim to learn a direct mapping from rainy images to clean rain-less images, and their architectures are becoming more and more complex. However, due to the limitation of mixing rain with object edges and background, it is difficult to separate rain and object/background, and the edge details of the image cannot be effectively recovered in the reconstruction process. To address this problem, we propose a novel wavelet approximation-aware residual network (WAAR), wherein rain is effectively removed from both low-frequency structures and high-frequency details at each level separately, especially in low-frequency sub-images at each level. After wavelet transform, we propose novel approximation aware (AAM) and approximation level blending (ALB) mechanisms to further aid the low-frequency networks at each level recover the structure and texture of low-frequency sub-images recursively, while the high frequency network can effectively eliminate rain streaks through block connection and achieve different degrees of edge detail enhancement by adjusting hyperparameters. In addition, we also introduce block connection to enrich the high-frequency details in the high-frequency network, which is favorable for obtaining potential interdependencies between high- and low-frequency features. Experimental results indicate that the proposed WAAR exhibits strong performance in reconstructing clean and rain-free images, recovering real and undistorted texture structures, and enhancing image edges in comparison with the state-of-the-art approaches on synthetic and real image datasets. It shows the effectiveness of our method, especially on image edges and texture details.
引用
收藏
页码:15979 / 15995
页数:17
相关论文
共 50 条
  • [31] Recursive residual Fourier transformation for single image deraining
    Zhiyuan Bao
    Mingwen Shao
    Yecong Wan
    Yuanjian Qiao
    International Journal of Machine Learning and Cybernetics, 2024, 15 : 1743 - 1754
  • [32] Recurrent multi-level residual and global attention network for single image deraining
    Wang, Meihua
    Li, Chao
    Ke, Fanhui
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (05): : 3697 - 3708
  • [33] A FAST AND EFFICIENT NETWORK FOR SINGLE IMAGE DERAINING
    Yang, Youzhao
    Lu, Hong
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2030 - 2034
  • [34] BILATERAL RECURRENT NETWORK FOR SINGLE IMAGE DERAINING
    Shang, Wei
    Zhu, Pengfei
    Ren, Dongwei
    Shi, Hong
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2503 - 2507
  • [35] PAC : Program Analysis for Approximation-aware Compilation
    Roy, Pooja
    Wang, Jianxing
    Wong, Weng Fai
    2015 INTERNATIONAL CONFERENCE ON COMPILERS, ARCHITECTURE AND SYNTHESIS FOR EMBEDDED SYSTEMS (CASES), 2015, : 69 - 78
  • [36] Single Image Deraining via Rain-Steaks Aware Deep Convolutional Neural Network
    Zheng, Chaobing
    Li, Yuwen
    Wu, Shiqian
    2022 IEEE 17TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2022, : 1534 - 1538
  • [37] Multi-Scale Aggregation Residual Channel Attention Fusion Network for Single Image Deraining
    Wang, Jyun-Guo
    Wu, Cheng-Shiuan
    APPLIED SCIENCES-BASEL, 2023, 13 (04):
  • [38] Factorized multi-scale multi-resolution residual network for single image deraining
    Shivakanth Sujit
    Seok-Bum Deivalakshmi S
    Applied Intelligence, 2022, 52 : 7582 - 7598
  • [39] Single Image Deraining Using Residual Channel Attention Networks
    Wang, Di
    Pan, Jin-Shan
    Tang, Jin-Hui
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2023, 38 (02) : 439 - 454
  • [40] Research on Single Image Deraining Algorithm Based on Euclidean Distance with Adaptive Progressive Residual Network
    Chen, Xingzhi
    Ma, Ruiqiang
    Dong, Zehui
    2021 IEEE 23rd International Conference on High Performance Computing and Communications, 7th International Conference on Data Science and Systems, 19th International Conference on Smart City and 7th International Conference on Dependability in Sensor, Cloud and Big Data Systems and Applications, HPCC-DSS-SmartCity-DependSys 2021, 2022, : 1791 - 1796