Image deraining based on dual-channel component decomposition

被引:2
|
作者
Lin, Xiao [1 ]
Xu, Duojiu [1 ]
Tan, Peiwen [1 ]
Ma, Lizhuang [2 ]
Wang, Zhi-Jie [3 ,4 ]
机构
[1] Shanghai Normal Univ, Dept Comp Sci, Shanghai, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
[3] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[4] Chongqing Univ, Key Lab Dependable Serv Comp Cyber Phys Soc, Minist Educ, Chongqing 400044, Peoples R China
来源
COMPUTERS & GRAPHICS-UK | 2023年 / 116卷
基金
中国国家自然科学基金;
关键词
Deraining; Transformer; Component decomposition; Background detail recovery; RAIN STREAKS REMOVAL;
D O I
10.1016/j.cag.2023.08.010
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Image deraining aims to remove rain streaks from images and reduce information loss in outdoor images caused by rain. As a fundamental task in image processing, image deraining not only enhances the visibility of images but also provides necessary image restoration for advanced vision tasks. Existing image deraining models mostly train end-to-end models by minimizing the similarity between the output image of the model and the rain-free ground truth. Although these methods have achieved significant results, they often perform poorly in the face of dense and changing rain streak scenes. In this paper, we propose a novel method, called Dual-Channel Component Decomposition Network (DCD-Net). The basic idea of DCD-Net is to leverage the separability prior of rainy images, treats the rain-free background layer and the rain streak mask layer as two parallel component extraction tasks. To this end, it builds a dual-branch parallel networks that extract the rain-free background image and decouple the reconstruction information of the rain streak mask, respectively. It finally applies a composite multi-level contrastive supervision to the output of the above dual-branch parallel network, thereby achieving rain streak removal. Extensive experiments on various datasets demonstrate that the proposed model outperforms existing methods in deraining dense rain streak images. & COPY; 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:93 / 101
页数:9
相关论文
共 50 条
  • [41] Medical image segmentation based on dual-channel integrated cross-layer residual algorithm
    You, Hongfeng
    Yu, Long
    Tian, Shengwei
    Ma, Xiang
    Xing, Yan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (04) : 5587 - 5603
  • [42] Using dual-channel CNN to classify hyperspectral image based on spatial-spectral information
    Song, Haifeng
    Yang, Weiwei
    Dai, Songsong
    Du, Lei
    Sun, Yongchen
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2020, 17 (04) : 3450 - 3477
  • [43] Medical image segmentation based on dual-channel integrated cross-layer residual algorithm
    Hongfeng You
    Long Yu
    Shengwei Tian
    Xiang Ma
    Yan Xing
    Multimedia Tools and Applications, 2023, 82 : 5587 - 5603
  • [44] Spotlight SAR Image Recognition Based on Dual-Channel Feature Map Convolutional Neural Network
    Liu, Junjie
    Fu, Xiongjun
    Liu, Kaiqiang
    Wang, Miao
    Zhang, Chengyan
    Su, Qinning
    2019 IEEE 4TH INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP 2019), 2019, : 65 - 69
  • [45] A Dual-Channel Readout Low-Noise CMOS Image Sensor Based on Skipper Technology
    Qu, Yang
    Zang, Qing
    Li, Zehao
    Jiang, Qian
    Liu, Yang
    Liang, Hongwei
    Chang, Yuchun
    IEEE SENSORS JOURNAL, 2025, 25 (02) : 2830 - 2838
  • [46] Dual-Channel Reliable Breast Ultrasound Image Classification Based on Explainable Attribution and Uncertainty Quantification
    Lei, Shuge
    Hu, Haonan
    Sun, Dasheng
    Zhang, Huabin
    Yuan, Kehong
    Dai, Jian
    Tang, Jijun
    Tong, Yan
    6TH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND MACHINE VISION, IPMV 2024, 2024, : 53 - 61
  • [47] AVO Inversion for Low-Frequency Component of the Model Parameters Based on Dual-Channel Convolutional Network
    Sun, Qianhao
    Zong, Zhaoyun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [48] Design of a terahertz dual-channel modulator based on metamaterials
    Pan, Wu
    Yang, Longliang
    Ma, Yong
    Xiao, Huiyun
    Liu, Bowen
    APPLIED OPTICS, 2021, 60 (30) : 9519 - 9524
  • [49] Image registration of the dual-channel spaceborne hyperspectral imager with motion compensation
    Zhao H.
    Zhang X.
    Jia G.
    Qiu X.
    Zhai L.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2021, 50 (03):
  • [50] A Stereo Dual-Channel Dynamic Programming Algorithm for UAV Image Stitching
    Li, Ming
    Chen, Ruizhi
    Zhang, Weilong
    Li, Deren
    Liao, Xuan
    Wang, Lei
    Pan, Yuanjin
    Zhang, Peng
    SENSORS, 2017, 17 (09):