Image deraining based on dual-channel component decomposition

被引:2
|
作者
Lin, Xiao [1 ]
Xu, Duojiu [1 ]
Tan, Peiwen [1 ]
Ma, Lizhuang [2 ]
Wang, Zhi-Jie [3 ,4 ]
机构
[1] Shanghai Normal Univ, Dept Comp Sci, Shanghai, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
[3] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[4] Chongqing Univ, Key Lab Dependable Serv Comp Cyber Phys Soc, Minist Educ, Chongqing 400044, Peoples R China
来源
COMPUTERS & GRAPHICS-UK | 2023年 / 116卷
基金
中国国家自然科学基金;
关键词
Deraining; Transformer; Component decomposition; Background detail recovery; RAIN STREAKS REMOVAL;
D O I
10.1016/j.cag.2023.08.010
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Image deraining aims to remove rain streaks from images and reduce information loss in outdoor images caused by rain. As a fundamental task in image processing, image deraining not only enhances the visibility of images but also provides necessary image restoration for advanced vision tasks. Existing image deraining models mostly train end-to-end models by minimizing the similarity between the output image of the model and the rain-free ground truth. Although these methods have achieved significant results, they often perform poorly in the face of dense and changing rain streak scenes. In this paper, we propose a novel method, called Dual-Channel Component Decomposition Network (DCD-Net). The basic idea of DCD-Net is to leverage the separability prior of rainy images, treats the rain-free background layer and the rain streak mask layer as two parallel component extraction tasks. To this end, it builds a dual-branch parallel networks that extract the rain-free background image and decouple the reconstruction information of the rain streak mask, respectively. It finally applies a composite multi-level contrastive supervision to the output of the above dual-branch parallel network, thereby achieving rain streak removal. Extensive experiments on various datasets demonstrate that the proposed model outperforms existing methods in deraining dense rain streak images. & COPY; 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:93 / 101
页数:9
相关论文
共 50 条
  • [1] MFFDNet: Single Image Deraining via Dual-Channel Mixed Feature Fusion
    Tao, Wenyin
    Yan, Xuefeng
    Wang, Yongzhen
    Wei, Mingqiang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 13
  • [2] Dual-channel image acquisition system based on FPGA
    Shi Haitao
    Zhang Shiru
    2019 INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION, BIG DATA & SMART CITY (ICITBS), 2019, : 421 - 424
  • [3] Hyperspectral Image Classification Based on Dual-Channel Feature Enhancement
    Zhao, Li
    Wang, Leiquan
    Zhang, Junsan
    Shao, Zhimin
    Zhu, Jie
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (12)
  • [4] Polarimetric Dual-Channel Multiscale Decomposition Dehazing
    Ma, Tongwei
    Zhou, Jianping
    Zhang, Lilian
    Fan, Chen
    Sun, Bo
    Xue, Ruilei
    Mao, Jun
    IEEE SENSORS JOURNAL, 2025, 25 (05) : 8569 - 8585
  • [5] Dual-Channel Deep Image Prior for Image Denoising
    Xu S.-P.
    Xiao N.
    Luo J.
    Cheng X.-H.
    Chen X.-J.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2024, 52 (01): : 58 - 68
  • [6] DUAL-CHANNEL DENSENET FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Yang, Gefei
    Gewali, Utsav B.
    Ientilucci, Emmett
    Gartley, Micheal
    Monteiro, Sildomar T.
    IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 2595 - 2598
  • [7] Spectral Dual-Channel Encoding for Image Dehazing
    Zhu, Zhanchen
    Zhang, Daokun
    Wang, Zhikang
    Feng, Siyuan
    Duan, Peibo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (11) : 6236 - 6248
  • [8] An image fusion method based on NSCT and dual-channel PCNN model
    Wang, Nianyi
    Ma, Yide
    Wang, Weilan
    Zhou, Shijie
    Journal of Networks, 2014, 9 (02) : 501 - 506
  • [9] Dual-channel Rybak neural network based medical image fusion
    Goyal, Neeraj
    Goyal, Nandini
    Mendiratta, Taesha
    Kharbanda, Himani
    Bansal, Keshav
    Mann, Sukhmanpreet Kaur
    Panigrahy, Chinmaya
    Aggarwal, Ashutosh
    OPTICS AND LASER TECHNOLOGY, 2025, 181
  • [10] Infrared and visible image fusion based on FDST and dual-channel PCNN
    Dai J.
    Liu Y.
    Mao X.
    Sheng G.
    Jiang X.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2019, 48 (02):