Single image deraining via deep pyramid network with spatial contextual information aggregation

被引:8
|
作者
Wang, Cong [1 ]
Wu, Yutong [1 ]
Cai, Yu [1 ]
Yao, Guangle [2 ]
Su, Zhixun [1 ,3 ,4 ]
Wang, Hongyan [1 ]
机构
[1] Dalian Univ Technol, Dalian, Peoples R China
[2] Chengdu Univ Technol, Chengdu, Peoples R China
[3] Guilin Univ Elect Technol, Guilin, Peoples R China
[4] Dalian Univ Technol, Sch Math Sci, Dalian, Peoples R China
关键词
Single image deraining; Pyramid network; Spatial contextual information aggregation; Residual learning; RAIN; REMOVAL;
D O I
10.1007/s10489-019-01567-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Rain streaks usually give rise to visual degradation and cause many computer vision algorithms to fail. So it is necessary to develop an effective deraining algorithm as preprocess of high-level vision tasks. In this paper, we propose a novel deep learning based deraining method. Specifically, the multi-scale kernels and feature maps are both important for single image deraining. However, the previous works ignore the two multi-scale information or only consider the multi-scale kernels information. Instead, our method learns multi-scale information both from the perspectives of kernels and feature maps, respectively, by designing spatial contextual information aggregation module and pyramid network module. The former module can capture the rain streaks with different sizes and the latter module can extract rain streaks from different scales further. Moreover, we also employ squeeze-and-excitation and skip connections to enhance the correlation between channels and transmit the information from low-level to high-level, respectively. The experimental results show that the proposed method achieves significant improvements over the recent state-of-the-art methods in Rain100H, Rain100L, Rain1200 and Rain1400 datasets.
引用
收藏
页码:1437 / 1447
页数:11
相关论文
共 50 条
  • [21] Single Image Deraining via Recurrent Hierarchy Enhancement Network
    Yang, Youzhao
    Lu, Hong
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 1814 - 1822
  • [22] Single-image Deraining via a channel memory network
    Zhang, Yan
    Guo, Jun
    Li, Jianqing
    Zhang, Juan
    APPLIED INTELLIGENCE, 2023, 53 (01) : 1009 - 1020
  • [23] Single-image Deraining via a channel memory network
    Yan Zhang
    Jun Guo
    Jianqing Li
    Juan Zhang
    Applied Intelligence, 2023, 53 : 1009 - 1020
  • [24] Non-local feature aggregation quaternion network for single image deraining
    Xiong, Gonghe
    Gai, Shan
    Nie, Bofan
    Chen, Feilong
    Sun, Chengli
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 103
  • [25] Deep Scale-space Mining Network for Single Image Deraining
    Li, Pengpeng
    Jin, Jiyu
    Jin, Guiyue
    Fan, Lei
    Gao, Xiao
    Song, Tianyu
    Chen, Xiang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 4275 - 4284
  • [26] Multi-scale enhancement and aggregation network for single-image deraining
    Zhang, Rui
    Liu, Yuetong
    Han, Huijian
    Zheng, Yong
    Zhang, Tao
    Zhang, Yunfeng
    COMPUTATIONAL VISUAL MEDIA, 2025, 11 (01): : 213 - 226
  • [27] DWTN: deep wavelet transform network for lightweight single image deraining
    Tao, Wenyin
    Yan, Xuefeng
    Wang, Yongzhen
    Wei, Mingqiang
    ADVANCES IN CONTINUOUS AND DISCRETE MODELS, 2024, 2024 (01):
  • [28] Single-image deraining via a Recurrent Memory Unit Network
    Zhang, Yan
    Zhang, Juan
    Huang, Bo
    Fang, Zhijun
    KNOWLEDGE-BASED SYSTEMS, 2021, 218
  • [29] Gated Context Aggregation Network for Image Dehazing and Deraining
    Chen, Dongdong
    He, Mingming
    Fan, Qingnan
    Liao, Jing
    Zhang, Liheng
    Hou, Dongdong
    Yuan, Lu
    Hua, Gang
    2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 1375 - 1383
  • [30] Deep Learning Algorithms for Single Image Deraining
    Grigoras, Radu
    Ciocoiu, Iulian B.
    PROCEEDINGS OF THE 2018 10TH INTERNATIONAL CONFERENCE ON ELECTRONICS, COMPUTERS AND ARTIFICIAL INTELLIGENCE (ECAI), 2018,