Scale-Space Feature Recalibration Network for Single Image Deraining

被引:2
|
作者
Li, Pengpeng [1 ]
Jin, Jiyu [1 ]
Jin, Guiyue [1 ]
Fan, Lei [1 ]
机构
[1] Dalian Polytech Univ, Sch Informat Sci & Engn, Dalian 116034, Peoples R China
关键词
image deraining; multi-scale; attention recalibration; feature fusion; MODEL;
D O I
10.3390/s22186823
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Computer vision technology is increasingly being used in areas such as intelligent security and autonomous driving. Users need accurate and reliable visual information, but the images obtained under severe weather conditions are often disturbed by rainy weather, causing image scenes to look blurry. Many current single image deraining algorithms achieve good performance but have limitations in retaining detailed image information. In this paper, we design a Scale-space Feature Recalibration Network (SFR-Net) for single image deraining. The proposed network improves the image feature extraction and characterization capability of a Multi-scale Extraction Recalibration Block (MERB) using dilated convolution with different convolution kernel sizes, which results in rich multi-scale rain streaks features. In addition, we develop a Subspace Coordinated Attention Mechanism (SCAM) and embed it into MERB, which combines coordinated attention recalibration and a subspace attention mechanism to recalibrate the rain streaks feature information learned from the feature extraction phase and eliminate redundant feature information to enhance the transfer of important feature information. Meanwhile, the overall SFR-Net structure uses dense connection and cross-layer feature fusion to repeatedly utilize the feature maps, thus enhancing the understanding of the network and avoiding gradient disappearance. Through extensive experiments on synthetic and real datasets, the proposed method outperforms the recent state-of-the-art deraining algorithms in terms of both the rain removal effect and the preservation of image detail information.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Scale-space feature extraction on digital surfaces
    Levallois, Jeremy
    Coeurjolly, David
    Lachaud, Jacques-Olivier
    COMPUTERS & GRAPHICS-UK, 2015, 51 : 177 - 189
  • [32] Scale-space vector fields for feature analysis
    Cross, ADJ
    Hancock, ER
    1997 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1997, : 738 - 743
  • [33] Morphological scale-space analysis and feature extraction
    Vachier, C
    2001 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL III, PROCEEDINGS, 2001, : 676 - 679
  • [34] APAN: Across-Scale Progressive Attention Network for Single Image Deraining
    Wang, Qiang
    Sun, Gan
    Fan, Huijie
    Li, Wentao
    Tang, Yandong
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 159 - 163
  • [35] Multi-Scale Hourglass Hierarchical Fusion Network for Single Image Deraining
    Chen, Xiang
    Huang, Yufeng
    Xu, Lei
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 872 - 879
  • [36] The Monogenic Scale-Space: A Unifying Approach to Phase-Based Image Processing in Scale-Space
    M. Felsberg
    G. Sommer
    Journal of Mathematical Imaging and Vision, 2004, 21 : 5 - 26
  • [37] The monogenic scale-space: A unifying approach to phase-based image processing in scale-space
    Felsberg, M
    Sommer, G
    JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2004, 21 (01) : 5 - 26
  • [38] Color image segmentation by scale-space image analysis
    Wei, Zhi-Qiang
    Yang, Miao
    2007 INTERNATIONAL CONFERENCE ON WAVELET ANALYSIS AND PATTERN RECOGNITION, VOLS 1-4, PROCEEDINGS, 2007, : 1377 - 1381
  • [39] A FAST AND EFFICIENT NETWORK FOR SINGLE IMAGE DERAINING
    Yang, Youzhao
    Lu, Hong
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2030 - 2034
  • [40] BILATERAL RECURRENT NETWORK FOR SINGLE IMAGE DERAINING
    Shang, Wei
    Zhu, Pengfei
    Ren, Dongwei
    Shi, Hong
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2503 - 2507