Single image deraining via deep pyramid network with spatial contextual information aggregation

被引:8
|
作者
Wang, Cong [1 ]
Wu, Yutong [1 ]
Cai, Yu [1 ]
Yao, Guangle [2 ]
Su, Zhixun [1 ,3 ,4 ]
Wang, Hongyan [1 ]
机构
[1] Dalian Univ Technol, Dalian, Peoples R China
[2] Chengdu Univ Technol, Chengdu, Peoples R China
[3] Guilin Univ Elect Technol, Guilin, Peoples R China
[4] Dalian Univ Technol, Sch Math Sci, Dalian, Peoples R China
关键词
Single image deraining; Pyramid network; Spatial contextual information aggregation; Residual learning; RAIN; REMOVAL;
D O I
10.1007/s10489-019-01567-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Rain streaks usually give rise to visual degradation and cause many computer vision algorithms to fail. So it is necessary to develop an effective deraining algorithm as preprocess of high-level vision tasks. In this paper, we propose a novel deep learning based deraining method. Specifically, the multi-scale kernels and feature maps are both important for single image deraining. However, the previous works ignore the two multi-scale information or only consider the multi-scale kernels information. Instead, our method learns multi-scale information both from the perspectives of kernels and feature maps, respectively, by designing spatial contextual information aggregation module and pyramid network module. The former module can capture the rain streaks with different sizes and the latter module can extract rain streaks from different scales further. Moreover, we also employ squeeze-and-excitation and skip connections to enhance the correlation between channels and transmit the information from low-level to high-level, respectively. The experimental results show that the proposed method achieves significant improvements over the recent state-of-the-art methods in Rain100H, Rain100L, Rain1200 and Rain1400 datasets.
引用
收藏
页码:1437 / 1447
页数:11
相关论文
共 50 条
  • [31] SINGLE IMAGE DERAINING USING A RECURRENT MULTI-SCALE AGGREGATION AND ENHANCEMENT NETWORK
    Yang, Youzhao
    Lu, Hong
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 1378 - 1383
  • [32] Single image deraining via multi-scale feature-based deep convolutional neural network
    Zheng, Chaobing
    Yang, Zhesen
    Jiang, Jun
    Ying, Wenjian
    Wu, Shiqian
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (05)
  • [33] Deep Single Image Deraining via Modeling Haze-Like Effect
    Wang, Yinglong
    Gong, Dong
    Yang, Jie
    Shi, Qinfeng
    van den Hengel, Anton
    Xie, Dehua
    Zeng, Bing
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 2481 - 2492
  • [34] LPN-IDD: A Lightweight Pyramid Network for Image Deraining and Detection
    Babar, Kainat
    Yaseen, Muhammad Usman
    Al-Shamayleh, Ahmad Sami
    Imran, Muhammad
    Al-Ghushami, Abdullah Hussein
    Akhunzada, Adnan
    IEEE ACCESS, 2024, 12 : 37103 - 37119
  • [35] Combined with Pyramid Split Attention and Multi-Scale Feature Learning Network for Single Image Deraining
    Chen, Hui
    Zhu, Songhao
    Liang, Zhiwei
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 7064 - 7069
  • [36] Deep Single Image Deraining via Modeling Haze-Like Effect
    Wang, Yinglong
    Gong, Dong
    Yang, Jie
    Shi, Qinfeng
    Hengel, Anton Van Den
    Xie, Dehua
    Zeng, Bing
    IEEE Transactions on Multimedia, 2021, 23 : 2481 - 2492
  • [37] Single image deraining via a recurrent multi-attention enhancement network
    Liu, Yuetong
    Zhang, Rui
    Zhang, Yunfeng
    Yao, Xunxiang
    Han, Huijian
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 113
  • [38] Single image deraining via nonlocal squeeze-and-excitation enhancing network
    Cong Wang
    Wanshu Fan
    Honghe Zhu
    Zhixun Su
    Applied Intelligence, 2020, 50 : 2932 - 2944
  • [39] Ensemble single image deraining network via progressive structural boosting constraints
    Peng, Long
    Jiang, Aiwen
    Wei, Haoran
    Liu, Bo
    Wang, Mingwen
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 99
  • [40] A FAST AND EFFICIENT NETWORK FOR SINGLE IMAGE DERAINING
    Yang, Youzhao
    Lu, Hong
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2030 - 2034