Image deraining based on dual-channel component decomposition

被引:2
|
作者
Lin, Xiao [1 ]
Xu, Duojiu [1 ]
Tan, Peiwen [1 ]
Ma, Lizhuang [2 ]
Wang, Zhi-Jie [3 ,4 ]
机构
[1] Shanghai Normal Univ, Dept Comp Sci, Shanghai, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
[3] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[4] Chongqing Univ, Key Lab Dependable Serv Comp Cyber Phys Soc, Minist Educ, Chongqing 400044, Peoples R China
来源
COMPUTERS & GRAPHICS-UK | 2023年 / 116卷
基金
中国国家自然科学基金;
关键词
Deraining; Transformer; Component decomposition; Background detail recovery; RAIN STREAKS REMOVAL;
D O I
10.1016/j.cag.2023.08.010
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Image deraining aims to remove rain streaks from images and reduce information loss in outdoor images caused by rain. As a fundamental task in image processing, image deraining not only enhances the visibility of images but also provides necessary image restoration for advanced vision tasks. Existing image deraining models mostly train end-to-end models by minimizing the similarity between the output image of the model and the rain-free ground truth. Although these methods have achieved significant results, they often perform poorly in the face of dense and changing rain streak scenes. In this paper, we propose a novel method, called Dual-Channel Component Decomposition Network (DCD-Net). The basic idea of DCD-Net is to leverage the separability prior of rainy images, treats the rain-free background layer and the rain streak mask layer as two parallel component extraction tasks. To this end, it builds a dual-branch parallel networks that extract the rain-free background image and decouple the reconstruction information of the rain streak mask, respectively. It finally applies a composite multi-level contrastive supervision to the output of the above dual-branch parallel network, thereby achieving rain streak removal. Extensive experiments on various datasets demonstrate that the proposed model outperforms existing methods in deraining dense rain streak images. & COPY; 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:93 / 101
页数:9
相关论文
共 50 条
  • [31] A Dual-Channel convolution neural network for image smoke detection
    Fang Zhang
    Wen Qin
    Yanbei Liu
    Zhitao Xiao
    Jinxin Liu
    Qi Wang
    Kaihua Liu
    Multimedia Tools and Applications, 2020, 79 : 34587 - 34603
  • [32] A stock series prediction model based on variational mode decomposition and dual-channel attention network
    Liu, Yepeng
    Huang, Siyuan
    Tian, Xiaoyi
    Zhang, Fan
    Zhao, Feng
    Zhang, Caiming
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [33] A Dual-Channel convolution neural network for image smoke detection
    Zhang, Fang
    Qin, Wen
    Liu, Yanbei
    Xiao, Zhitao
    Liu, Jinxin
    Wang, Qi
    Liu, Kaihua
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (45-46) : 34587 - 34603
  • [34] A dual-channel IEGT
    Huang, S
    Amaratunga, GAJ
    Udrea, F
    Sheng, K
    Waind, P
    Coulbeck, L
    Taylor, P
    MICROELECTRONICS JOURNAL, 2001, 32 (09) : 755 - 761
  • [35] Information-based uncertainty decomposition in dual-channel microwave remote sensing of soil moisture
    Li, Bonan
    Good, Stephen P.
    HYDROLOGY AND EARTH SYSTEM SCIENCES, 2021, 25 (09) : 5029 - 5045
  • [36] Dual-channel component replenishment problem in an assemble-to-order system
    Yao, Zhishuang
    Lee, Loo Hay
    Chew, Ek Peng
    Hsu, Vernon N.
    Jaruphongsa, Wikrom
    IIE TRANSACTIONS, 2013, 45 (03) : 229 - 243
  • [37] DBSwin: Transformer based dual branch network for single image deraining
    Tan, Fuxiang
    Qian, Yurong
    Kong, Yuting
    Zhang, Hao
    Zhou, Daxin
    Fan, Yingying
    Chen, Long
    Xiao, Zhengqing
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 43 (04) : 5109 - 5123
  • [38] DUAL RECURSIVE NETWORK FOR FAST IMAGE DERAINING
    Cai, Linwen
    Li, Si-Yao
    Ren, Dongwei
    Wang, Ping
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2756 - 2760
  • [39] Remote Sensing Image Reconstruction Method Based on Parameter Adaptive Dual-Channel Pulse-Coupled Neural Network to Optimize Multiscale Decomposition
    Hu, Pengcheng
    Tang, Shihua
    Zhang, Yan
    Song, Xiaohui
    Sun, Mengbo
    IEEE ACCESS, 2023, 11 : 78084 - 78103
  • [40] Small Sample Hyperspectral Image Classification Method Based on Dual-Channel Spectral Enhancement Network
    Pei, Songwei
    Song, Hong
    Lu, Yinning
    ELECTRONICS, 2022, 11 (16)