Scale-Space Feature Recalibration Network for Single Image Deraining

被引:2
|
作者
Li, Pengpeng [1 ]
Jin, Jiyu [1 ]
Jin, Guiyue [1 ]
Fan, Lei [1 ]
机构
[1] Dalian Polytech Univ, Sch Informat Sci & Engn, Dalian 116034, Peoples R China
关键词
image deraining; multi-scale; attention recalibration; feature fusion; MODEL;
D O I
10.3390/s22186823
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Computer vision technology is increasingly being used in areas such as intelligent security and autonomous driving. Users need accurate and reliable visual information, but the images obtained under severe weather conditions are often disturbed by rainy weather, causing image scenes to look blurry. Many current single image deraining algorithms achieve good performance but have limitations in retaining detailed image information. In this paper, we design a Scale-space Feature Recalibration Network (SFR-Net) for single image deraining. The proposed network improves the image feature extraction and characterization capability of a Multi-scale Extraction Recalibration Block (MERB) using dilated convolution with different convolution kernel sizes, which results in rich multi-scale rain streaks features. In addition, we develop a Subspace Coordinated Attention Mechanism (SCAM) and embed it into MERB, which combines coordinated attention recalibration and a subspace attention mechanism to recalibrate the rain streaks feature information learned from the feature extraction phase and eliminate redundant feature information to enhance the transfer of important feature information. Meanwhile, the overall SFR-Net structure uses dense connection and cross-layer feature fusion to repeatedly utilize the feature maps, thus enhancing the understanding of the network and avoiding gradient disappearance. Through extensive experiments on synthetic and real datasets, the proposed method outperforms the recent state-of-the-art deraining algorithms in terms of both the rain removal effect and the preservation of image detail information.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Generalized Gaussian Scale-Space Axiomatics Comprising Linear Scale-Space, Affine Scale-Space and Spatio-Temporal Scale-Space
    Tony Lindeberg
    Journal of Mathematical Imaging and Vision, 2011, 40 : 36 - 81
  • [42] A total variation scale-space and image resizing
    Hyams, Yedidya
    Porat, Moshe
    2016 IEEE INTERNATIONAL CONFERENCE ON THE SCIENCE OF ELECTRICAL ENGINEERING (ICSEE), 2016,
  • [43] Image scale-space from the heat kernel
    Zhang, F
    Hancock, ER
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS AND APPLICATIONS, PROCEEDINGS, 2005, 3773 : 181 - 192
  • [44] SCALE-SPACE METHOD OF IMAGE RINGING ESTIMATION
    Nasonov, Andrey V.
    Krylov, Andrey S.
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 2793 - 2796
  • [45] Image watermarking based on scale-space representation
    Seo, JS
    Yoo, CD
    SECURITY, STEGANOGRAPHY, AND WATERMARKING OF MULTIMEDIA CONTENTS VI, 2004, 5306 : 560 - 570
  • [46] A SCALE-SPACE TOGGLE OPERATOR FOR IMAGE TRANSFORMATIONS
    Dorini, Leyza Baldo
    Leite, Neucimar Jeronimo
    INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2013, 13 (04)
  • [47] Properties of Brownian image models in scale-space
    Pedersen, KS
    SCALE SPACE METHODS IN COMPUTER VISION, PROCEEDINGS, 2003, 2695 : 281 - 296
  • [48] Generalized Gaussian Scale-Space Axiomatics Comprising Linear Scale-Space, Affine Scale-Space and Spatio-Temporal Scale-Space
    Lindeberg, Tony
    JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2011, 40 (01) : 36 - 81
  • [49] Feature point extraction using scale-space representation
    Abdeljaoued, Y
    Ebrahimi, T
    ICIP: 2004 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1- 5, 2004, : 3053 - 3056
  • [50] SINGLE IMAGE DERAINING USING A RECURRENT MULTI-SCALE AGGREGATION AND ENHANCEMENT NETWORK
    Yang, Youzhao
    Lu, Hong
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 1378 - 1383