Image deraining based on dual-channel component decomposition

被引:2
|
作者
Lin, Xiao [1 ]
Xu, Duojiu [1 ]
Tan, Peiwen [1 ]
Ma, Lizhuang [2 ]
Wang, Zhi-Jie [3 ,4 ]
机构
[1] Shanghai Normal Univ, Dept Comp Sci, Shanghai, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
[3] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[4] Chongqing Univ, Key Lab Dependable Serv Comp Cyber Phys Soc, Minist Educ, Chongqing 400044, Peoples R China
来源
COMPUTERS & GRAPHICS-UK | 2023年 / 116卷
基金
中国国家自然科学基金;
关键词
Deraining; Transformer; Component decomposition; Background detail recovery; RAIN STREAKS REMOVAL;
D O I
10.1016/j.cag.2023.08.010
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Image deraining aims to remove rain streaks from images and reduce information loss in outdoor images caused by rain. As a fundamental task in image processing, image deraining not only enhances the visibility of images but also provides necessary image restoration for advanced vision tasks. Existing image deraining models mostly train end-to-end models by minimizing the similarity between the output image of the model and the rain-free ground truth. Although these methods have achieved significant results, they often perform poorly in the face of dense and changing rain streak scenes. In this paper, we propose a novel method, called Dual-Channel Component Decomposition Network (DCD-Net). The basic idea of DCD-Net is to leverage the separability prior of rainy images, treats the rain-free background layer and the rain streak mask layer as two parallel component extraction tasks. To this end, it builds a dual-branch parallel networks that extract the rain-free background image and decouple the reconstruction information of the rain streak mask, respectively. It finally applies a composite multi-level contrastive supervision to the output of the above dual-branch parallel network, thereby achieving rain streak removal. Extensive experiments on various datasets demonstrate that the proposed model outperforms existing methods in deraining dense rain streak images. & COPY; 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:93 / 101
页数:9
相关论文
共 50 条
  • [21] Infrared and Visible Image Fusion Method Based on Dual-Channel Generative Adversarial Network
    Hou Chunping
    Wang Xiaocong
    Xia Han
    Yang Yang
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (14)
  • [22] No-reference image quality assessment based on dual-channel convolutional neural network
    Huang, Shuyu
    Sang, Qingbing
    Wu, Qin
    Wu, Xiaojun
    Li, Chaofeng
    2018 INTERNATIONAL SYMPOSIUM IN SENSING AND INSTRUMENTATION IN IOT ERA (ISSI), 2018,
  • [23] A Novel Low-Illumination Image Enhancement Method Based on Dual-Channel Prior
    Zhao, Xinyu
    Huang, Fuzhen
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 4244 - 4248
  • [24] An Image Fusion Method Based on Wavelet and Dual-channel Pulse Coupled Neural Network
    Wang, Nianyi
    Wang, Weilan
    PROCEEDINGS OF 2015 IEEE INTERNATIONAL CONFERENCE ON PROGRESS IN INFORMATCS AND COMPUTING (IEEE PIC), 2015, : 270 - 274
  • [25] ECT Image Reconstruction Algorithm Based on Multiscale Dual-Channel Convolutional Neural Network
    Wang, Lili
    Liu, Xiao
    Chen, Deyun
    Yang, Hailu
    Wang, Chengdong
    COMPLEXITY, 2020, 2020
  • [26] Compressed dual-channel neural network with application to image-based smoke detection
    Zhang, Jiedong
    Xie, Wenhui
    Liu, Hongyan
    Dang, Wenyi
    Yu, Anfeng
    Liu, Di
    IET IMAGE PROCESSING, 2022, 16 (04) : 1036 - 1043
  • [27] Natural low-illumination image enhancement based on dual-channel prior information
    Wang, Lingyun
    HELIYON, 2024, 10 (17)
  • [28] Infrared and Visible Image Fusion Based on Adaptive Dual-channel PCNN and Saliency Detection
    An, Ying
    Fan, Xunli
    Chen, Li
    Liu, Pei
    2019 15TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS 2019), 2019, : 20 - 25
  • [29] Medical Image Fusion Method Based on Lifting Wavelet Transform and Dual-channel PCNN
    Yang Yanchun
    Dang Jianwu
    Wang Yangping
    PROCEEDINGS OF THE 2014 9TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2014, : 1179 - 1182
  • [30] Dual-channel PCNN and its application in the field of image fusion
    Wang, Zhanbin
    Ma, Yide
    ICNC 2007: THIRD INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, VOL 1, PROCEEDINGS, 2007, : 755 - +