When dual contrastive learning meets disentangled features for unpaired image deraining

被引:0
|
作者
Tianming Wang
Kaige Wang
Qing Li
机构
[1] Institute of Microelectronics of the Chinese Academy of Sciences,Intelligent Manufacturing Electronics Research Center
[2] University of Chinese Academy of Sciences,School of Integrated Circuits
[3] 2050 Laboratory,undefined
[4] China Academy of Aerospace Science and Innovation,undefined
来源
关键词
Image processing; Deraining; Contrastive learning; Unsupervised learning;
D O I
暂无
中图分类号
学科分类号
摘要
As the basis work of image processing, rain removal from a single image has always been an important and challenging problem. Due to the lack of real rain images and corresponding clean images, most rain removal networks are trained by synthetic datasets, which makes the output images unsatisfactory in practical applications. In this work, we propose a new feature decoupling network for unsupervised image rain removal. Its purpose is to decompose the rain image into two distinguishable layers: clean image layer and rain layer. In order to fully decouple the features of different attributes, we use contrastive learning to constrain this process. Specifically, the image patch with similarity is pulled together as a positive sample, while the rain layer patch is pushed away as a negative sample. We not only make use of the inherent self-similarity within the sample, but also make use of the mutual exclusion between the two layers, so as to better distinguish the rain layer from the clean image. We implicitly constrain the embedding of different samples in the depth feature space to better promote rainline removal and image restoration. Our method achieves a PSNR of 25.80 on Test100, surpassing other unsupervised methods.
引用
收藏
相关论文
共 50 条
  • [1] When dual contrastive learning meets disentangled features for unpaired image deraining
    Wang, Tianming
    Wang, Kaige
    Li, Qing
    [J]. MACHINE VISION AND APPLICATIONS, 2023, 34 (05)
  • [2] Unpaired Deep Image Deraining Using Dual Contrastive Learning
    Chen, Xiang
    Pan, Jinshan
    Jiang, Kui
    Li, Yufeng
    Huang, Yufeng
    Kong, Caihua
    Dai, Longgang
    Fan, Zhentao
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 2007 - 2016
  • [3] Unpaired Learning for Deep Image Deraining with Rain Direction Regularizer
    Liu, Yang
    Yue, Ziyu
    Pan, Jinshan
    Su, Zhixun
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4733 - 4741
  • [4] Unsupervised Deraining: Where Contrastive Learning Meets Self-similarity
    Ye, Yuntong
    Yu, Changfeng
    Chang, Yi
    Zhu, Lin
    Zhao, Xi-le
    Yan, Luxin
    Tian, Yonghong
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5811 - 5820
  • [5] Unpaired sonar image denoising with simultaneous contrastive learning
    Zhao, Boyu
    Zhou, Qian
    Huang, Lijun
    Zhang, Qiang
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 235
  • [6] Unsupervised Deraining: Where Asymmetric Contrastive Learning Meets Self-Similarity
    Chang, Yi
    Guo, Yun
    Ye, Yuntong
    Yu, Changfeng
    Zhu, Lin
    Zhao, Xile
    Yan, Luxin
    Tian, Yonghong
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (05) : 2638 - 2657
  • [7] Exploring Negatives in Contrastive Learning for Unpaired Image-to-Image Translation
    Lin, Yupei
    Zhang, Sen
    Chen, Tianshui
    Lu, Yongyi
    Li, Guangping
    Shi, Yukai
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1186 - 1194
  • [8] Magic ELF: Image Deraining Meets Association Learning and Transformer
    Jiang, Kui
    Wang, Zhongyuan
    Chen, Chen
    Wang, Zheng
    Cui, Laizhong
    Lin, Chia-Wen
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022,
  • [9] Contrastive Dual Gating: Learning Sparse Features With Contrastive Learning
    Meng, Jian
    Yang, Li
    Shin, Jinwoo
    Fan, Deliang
    Seo, Jae-Sun
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12247 - 12255
  • [10] Unpaired Deep Image Dehazing Using Contrastive Disentanglement Learning
    Chen, Xiang
    Fan, Zhentao
    Li, Pengpeng
    Dai, Longgang
    Kong, Caihua
    Zheng, Zhuoran
    Huang, Yufeng
    Li, Yufeng
    [J]. COMPUTER VISION - ECCV 2022, PT XVII, 2022, 13677 : 632 - 648