Scale-Space Feature Recalibration Network for Single Image Deraining

被引:2
|
作者
Li, Pengpeng [1 ]
Jin, Jiyu [1 ]
Jin, Guiyue [1 ]
Fan, Lei [1 ]
机构
[1] Dalian Polytech Univ, Sch Informat Sci & Engn, Dalian 116034, Peoples R China
关键词
image deraining; multi-scale; attention recalibration; feature fusion; MODEL;
D O I
10.3390/s22186823
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Computer vision technology is increasingly being used in areas such as intelligent security and autonomous driving. Users need accurate and reliable visual information, but the images obtained under severe weather conditions are often disturbed by rainy weather, causing image scenes to look blurry. Many current single image deraining algorithms achieve good performance but have limitations in retaining detailed image information. In this paper, we design a Scale-space Feature Recalibration Network (SFR-Net) for single image deraining. The proposed network improves the image feature extraction and characterization capability of a Multi-scale Extraction Recalibration Block (MERB) using dilated convolution with different convolution kernel sizes, which results in rich multi-scale rain streaks features. In addition, we develop a Subspace Coordinated Attention Mechanism (SCAM) and embed it into MERB, which combines coordinated attention recalibration and a subspace attention mechanism to recalibrate the rain streaks feature information learned from the feature extraction phase and eliminate redundant feature information to enhance the transfer of important feature information. Meanwhile, the overall SFR-Net structure uses dense connection and cross-layer feature fusion to repeatedly utilize the feature maps, thus enhancing the understanding of the network and avoiding gradient disappearance. Through extensive experiments on synthetic and real datasets, the proposed method outperforms the recent state-of-the-art deraining algorithms in terms of both the rain removal effect and the preservation of image detail information.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Deep Scale-space Mining Network for Single Image Deraining
    Li, Pengpeng
    Jin, Jiyu
    Jin, Guiyue
    Fan, Lei
    Gao, Xiao
    Song, Tianyu
    Chen, Xiang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 4275 - 4284
  • [2] Single Image Deraining via Scale-space Invariant Attention Neural Network
    Pang, Bo
    Zhai, Deming
    Jiang, Junjun
    Liu, Xianming
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 375 - 383
  • [3] Feature decoupling and reorganization network for single image deraining
    Cheng, Yunrui
    Huang, Junjian
    Ren, Hao
    Ran, Wu
    Lu, Hong
    MULTIMEDIA SYSTEMS, 2024, 30 (03)
  • [4] PFDN: Pyramid Feature Decoupling Network for Single Image Deraining
    Wang, Qiang
    Sun, Gan
    Dong, Jiahua
    Zhang, Yulun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 7091 - 7101
  • [5] DENSE FEATURE PYRAMID GRIDS NETWORK FOR SINGLE IMAGE DERAINING
    Wang, Zhen
    Wang, Cong
    Su, Zhixun
    Chen, Junyang
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2025 - 2029
  • [6] Progressive dense feature fusion network for single image deraining
    Feng, Fuxiang
    Zhang, Youmei
    Zhang, Weidong
    Li, Bin
    PATTERN RECOGNITION LETTERS, 2023, 176 : 209 - 214
  • [7] Deep Feature Interactive Aggregation Network for Single Image Deraining
    Cao, Shaoli
    Liu, Liying
    Zhao, Li
    Xu, Yuewang
    Xu, Jiawei
    Zhang, Xiaoqin
    IEEE ACCESS, 2022, 10 : 103872 - 103879
  • [8] Multistage Feature Complimentary Network for Single-Image Deraining
    Wang, Kangying
    Wang, Minghui
    JOURNAL OF ROBOTICS, 2021, 2021
  • [9] Scale-space methods for image feature modeling in vision metrology
    Fraser, CS
    Shao, J
    PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 1998, 64 (04): : 323 - 328
  • [10] Scale-Space Feature Based Image Watermarking in Contourlet Domain
    Li, Leida
    Guo, Baolong
    Pan, Jeng-Shyang
    Yang, Liu
    DIGITAL WATERMARKING, 2009, 5450 : 88 - +