Importing Diffusion and Re-Designed Backward Process for Image De-Raining

被引:0
|
作者
Lin, Jhe-Wei [1 ]
Lee, Cheng-Hsuan [1 ]
Su, Tang-Wei [1 ]
Chang, Che-Cheng [1 ]
机构
[1] Feng Chia Univ, Dept Informat Engn & Comp Sci, Taichung 407, Taiwan
关键词
image process; diffusion model; de-rained; feature extraction;
D O I
10.3390/s24123715
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In recent years, with the increasing demand for high-quality images in various fields, more and more attention has been focused on noise removal techniques for image processing. The effective elimination of unwanted noise plays a crucial role in improving image quality. To meet this challenge, many noise removal methods have been proposed, among which the diffusion model has become one of the focuses of many researchers. In order to make the restored image closer to the real image and retain more features of the image, this paper proposes a DIR-SDE method with reference to the diffusion models of IR-SDE and IDM, which improve the feature retention of the image in the de-raining process, and then improve the realism of the image for the image de-raining task. In this study, IR-SDE was used as the base structure of the diffusion model, IR-SDE was improved, and DINO-ViT was combined to enhance the image features. During the diffusion process, the image features were extracted using DINO-ViT, and these features were fused with the original images to enhance the learning effect of the model. The model was also trained and validated with the Rain100H dataset. Compared with the IR-SDE method, it improved 0.003 in the SSIM, 0.003 in the LPIPS, and 1.23 in the FID. The experimental results show that the diffusion model proposed in this study can effectively improve the image restoration performance.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Self-attentive Pyramid Network for Single Image De-raining
    Guo, Taian
    Dai, Tao
    Li, Jiawei
    Xia, Shu-Tao
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT I, 2019, 11953 : 390 - 401
  • [22] SINGLE IMAGE DE-RAINING WITH HIGH-LOW FREQUENCY GUIDANCE
    Zhang, Ying
    Xiang, Youjun
    Cai, Lei
    Fu, Yuli
    Huo, Wanliang
    Xia, Junjun
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2330 - 2334
  • [23] Disentangled Representation Learning and Enhancement Network for Single Image De-Raining
    Wang, Guoqing
    Sun, Changming
    Xu, Xing
    Li, Jingjing
    Wang, Zheng
    Ma, Zeyu
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3015 - 3023
  • [24] Fast Single Image De-raining via a Weighted Residual Network
    Zhuge, Ruibin
    Xia, Haiying
    Li, Haisheng
    Song, Shuxiang
    NEURAL INFORMATION PROCESSING (ICONIP 2018), PT VI, 2018, 11306 : 257 - 268
  • [25] Single image de-raining via clique recursive feedback mechanism
    Wang, Xiaofen
    Chen, Jun
    Jiang, Kui
    Han, Zhen
    Ruan, Weijian
    Wang, Zhongyuan
    Liang, Chao
    NEUROCOMPUTING, 2020, 417 : 142 - 154
  • [26] An Efficient Single Image De-Raining Model With Decoupled Deep Networks
    Li, Wencheng
    Chen, Gang
    Chang, Yi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 69 - 81
  • [27] Single Image De-Raining via Improved Generative Adversarial Nets
    Ren, Yi
    Nie, Mengzhen
    Li, Shichao
    Li, Chuankun
    SENSORS, 2020, 20 (06)
  • [28] PID Controller-Inspired Model Design for Single Image De-Raining
    Zhou, Man
    Wang, Fan
    Wei, Xian
    Wang, Rujing
    Wang, Xue
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (04) : 2351 - 2355
  • [29] Multiscale Attentive Image De-Raining Networks via Neural Architecture Search
    Cai, Lei
    Fu, Yuli
    Huo, Wanliang
    Xiang, Youjun
    Zhu, Tao
    Zhang, Ying
    Zeng, Huanqiang
    Zeng, Delu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (02) : 618 - 633
  • [30] Control Theory-Inspired Model Design for Single Image De-Raining
    Zhou, Man
    Wang, Rujing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (02) : 649 - 653