Importing Diffusion and Re-Designed Backward Process for Image De-Raining

被引:0
|
作者
Lin, Jhe-Wei [1 ]
Lee, Cheng-Hsuan [1 ]
Su, Tang-Wei [1 ]
Chang, Che-Cheng [1 ]
机构
[1] Feng Chia Univ, Dept Informat Engn & Comp Sci, Taichung 407, Taiwan
关键词
image process; diffusion model; de-rained; feature extraction;
D O I
10.3390/s24123715
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In recent years, with the increasing demand for high-quality images in various fields, more and more attention has been focused on noise removal techniques for image processing. The effective elimination of unwanted noise plays a crucial role in improving image quality. To meet this challenge, many noise removal methods have been proposed, among which the diffusion model has become one of the focuses of many researchers. In order to make the restored image closer to the real image and retain more features of the image, this paper proposes a DIR-SDE method with reference to the diffusion models of IR-SDE and IDM, which improve the feature retention of the image in the de-raining process, and then improve the realism of the image for the image de-raining task. In this study, IR-SDE was used as the base structure of the diffusion model, IR-SDE was improved, and DINO-ViT was combined to enhance the image features. During the diffusion process, the image features were extracted using DINO-ViT, and these features were fused with the original images to enhance the learning effect of the model. The model was also trained and validated with the Rain100H dataset. Compared with the IR-SDE method, it improved 0.003 in the SSIM, 0.003 in the LPIPS, and 1.23 in the FID. The experimental results show that the diffusion model proposed in this study can effectively improve the image restoration performance.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Rain-component-aware capsule-GAN for single image de-raining
    Yang, Fei
    Ren, Jianfeng
    Lu, Zheng
    Zhang, Jialu
    Zhang, Qian
    PATTERN RECOGNITION, 2022, 123
  • [42] Multi-scale encoding-decoding model for single image de-raining
    Zhang X.
    Li J.
    Chu Y.
    Tang Y.
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2021, 49 (07): : 68 - 73
  • [43] Single Image De-Raining Using Spinning Detail Perceptual Generative Adversarial Networks
    Chen, Kaizheng
    Dai, Yaping
    Jia, Zhiyang
    Hirota, Kaoru
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2020, 24 (07) : 811 - 819
  • [44] A Unified Single Image De-raining Model via Region Adaptive Coupled Network
    Wu, Qingbo
    Chen, Li
    Ngan, King Ngi
    Li, Hongliang
    Meng, Fanman
    Xu, Linfeng
    2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2020, : 205 - 208
  • [45] DUAL-DOMAIN SINGLE IMAGE DE-RAINING USING CONDITIONAL GENERATIVE ADVERSARIAL NETWORK
    Sharma, Prasen Kumar
    Jain, Priyankar
    Sur, Arijit
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2796 - 2800
  • [46] Multi-scale fusion and adaptively attentive generative adversarial network for image de-raining
    Yang, Haifeng
    Guo, Jiajia
    Xin, Yongjie
    Cai, Jianghui
    Zhang, Min
    Zhao, Xujun
    Zhao, Yingyue
    He, Yanting
    APPLIED INTELLIGENCE, 2023, 53 (24) : 30865 - 30886
  • [47] Non-locally Enhanced Encoder-Decoder Network for Single Image De-raining
    Li, Guanbin
    He, Xiang
    Zhang, Wei
    Chang, Huiyou
    Dong, Le
    Lin, Liang
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 1056 - 1064
  • [48] A pyramid non-local enhanced residual dense network for single image de-raining
    Zhao, Minghua
    Fan, Hengrui
    DU, Shuangli
    Wang, Li
    Li, Peng
    Hu, Jing
    IET IMAGE PROCESSING, 2021, 15 (08) : 1786 - 1799
  • [49] Single Image De-raining Using a Recurrent Dual-attention-residual Ensemble Network
    Zhang, Xue-Feng
    Li, Jin-Jing
    Ruan Jian Xue Bao/Journal of Software, 2021, 32 (10): : 3283 - 3292
  • [50] Multi-scale fusion and adaptively attentive generative adversarial network for image de-raining
    Haifeng Yang
    Jiajia Guo
    Yongjie Xin
    Jianghui Cai
    Min Zhang
    Xujun Zhao
    Yingyue Zhao
    Yanting He
    Applied Intelligence, 2023, 53 : 30954 - 30970