Scale-Space Feature Recalibration Network for Single Image Deraining

被引:2
|
作者
Li, Pengpeng [1 ]
Jin, Jiyu [1 ]
Jin, Guiyue [1 ]
Fan, Lei [1 ]
机构
[1] Dalian Polytech Univ, Sch Informat Sci & Engn, Dalian 116034, Peoples R China
关键词
image deraining; multi-scale; attention recalibration; feature fusion; MODEL;
D O I
10.3390/s22186823
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Computer vision technology is increasingly being used in areas such as intelligent security and autonomous driving. Users need accurate and reliable visual information, but the images obtained under severe weather conditions are often disturbed by rainy weather, causing image scenes to look blurry. Many current single image deraining algorithms achieve good performance but have limitations in retaining detailed image information. In this paper, we design a Scale-space Feature Recalibration Network (SFR-Net) for single image deraining. The proposed network improves the image feature extraction and characterization capability of a Multi-scale Extraction Recalibration Block (MERB) using dilated convolution with different convolution kernel sizes, which results in rich multi-scale rain streaks features. In addition, we develop a Subspace Coordinated Attention Mechanism (SCAM) and embed it into MERB, which combines coordinated attention recalibration and a subspace attention mechanism to recalibrate the rain streaks feature information learned from the feature extraction phase and eliminate redundant feature information to enhance the transfer of important feature information. Meanwhile, the overall SFR-Net structure uses dense connection and cross-layer feature fusion to repeatedly utilize the feature maps, thus enhancing the understanding of the network and avoiding gradient disappearance. Through extensive experiments on synthetic and real datasets, the proposed method outperforms the recent state-of-the-art deraining algorithms in terms of both the rain removal effect and the preservation of image detail information.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Multi-scale Channel Transformer Network for Single Image Deraining
    Namba, Yuto
    Han, Xian-Hua
    PROCEEDINGS OF THE 4TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA IN ASIA, MMASIA 2022, 2022,
  • [22] A fuzzy scale-space approach to feature-based image representation and retrieval
    Ceccarelli, M
    Musacchia, F
    Petrosino, A
    BRAIN, VISION, AND ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2005, 3704 : 377 - 385
  • [23] A NEW APPROACH TO SCALE-SPACE IMAGE
    RAY, BK
    RAY, KS
    PATTERN RECOGNITION LETTERS, 1994, 15 (04) : 365 - 372
  • [24] Image segmentation by analysis of scale-space
    De Carvalho, MAG
    Couprie, M
    Lotufo, RD
    SIBGRAPI 2002: XV BRAZILIAN SYMPOSIUM ON COMPUTER GRAPHICS AND IMAGE PROCESSING, PROCEEDINGS, 2002, : 403 - 403
  • [25] Scale-space matching and image retrieval
    Ravela, S
    Manmatha, R
    Riseman, EM
    IMAGE UNDERSTANDING WORKSHOP, 1996 PROCEEDINGS, VOLS I AND II, 1996, : 1199 - 1207
  • [26] Morphological scale-space in image processing
    Bosworth, JH
    Acton, ST
    DIGITAL SIGNAL PROCESSING, 2003, 13 (02) : 338 - 367
  • [27] Scale-space in hyperspectral image analysis
    Duarte-Carvajalino, Julio M.
    Velez-Reyes, Miguel
    Castillo, Paul
    ALGORITHMS AND TECHNOLOGIES FOR MULTISPECTRAL, HYPERSPECTRAL, AND ULTRASPECTRAL IMAGERY XII PTS 1 AND 2, 2006, 6233
  • [28] Scale-space characteristics for image segmentation
    Rahman, M
    Chai, WY
    Abdessealm, A
    IEEE REGION 10 INTERNATIONAL CONFERENCE ON ELECTRICAL AND ELECTRONIC TECHNOLOGY, VOLS 1 AND 2, 2001, : 28 - 32
  • [29] A scale-space measure of image complexity
    Oomes, A. H. J.
    Leeuwenberg, E. L. J.
    PERCEPTION, 1994, 23 : 20 - 21
  • [30] Scale-space properties of quadratic feature detectors
    Kube, P
    Perona, P
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1996, 18 (10) : 987 - 999