Importing Diffusion and Re-Designed Backward Process for Image De-Raining

被引:0
|
作者
Lin, Jhe-Wei [1 ]
Lee, Cheng-Hsuan [1 ]
Su, Tang-Wei [1 ]
Chang, Che-Cheng [1 ]
机构
[1] Feng Chia Univ, Dept Informat Engn & Comp Sci, Taichung 407, Taiwan
关键词
image process; diffusion model; de-rained; feature extraction;
D O I
10.3390/s24123715
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In recent years, with the increasing demand for high-quality images in various fields, more and more attention has been focused on noise removal techniques for image processing. The effective elimination of unwanted noise plays a crucial role in improving image quality. To meet this challenge, many noise removal methods have been proposed, among which the diffusion model has become one of the focuses of many researchers. In order to make the restored image closer to the real image and retain more features of the image, this paper proposes a DIR-SDE method with reference to the diffusion models of IR-SDE and IDM, which improve the feature retention of the image in the de-raining process, and then improve the realism of the image for the image de-raining task. In this study, IR-SDE was used as the base structure of the diffusion model, IR-SDE was improved, and DINO-ViT was combined to enhance the image features. During the diffusion process, the image features were extracted using DINO-ViT, and these features were fused with the original images to enhance the learning effect of the model. The model was also trained and validated with the Rain100H dataset. Compared with the IR-SDE method, it improved 0.003 in the SSIM, 0.003 in the LPIPS, and 1.23 in the FID. The experimental results show that the diffusion model proposed in this study can effectively improve the image restoration performance.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] I Can See Clearly Now : Image Restoration via De-Raining
    Porav, Horia
    Bruls, Tom
    Newman, Paul
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 7087 - 7093
  • [32] ERL-Net: Entangled Representation Learning for Single Image De-Raining
    Wang, Guoqing
    Sun, Changming
    Sowmya, Arcot
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 5643 - 5651
  • [33] Subjective and Objective De-Raining Quality Assessment Towards Authentic Rain Image
    Wu, Qingbo
    Wang, Lei
    Ngan, King Ngi
    Li, Hongliang
    Meng, Fanman
    Xu, Linfeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (11) : 3883 - 3897
  • [34] Single-image de-raining with a connected multi-stream neural network
    Pan Y.
    Shin H.
    Shin, Hyunchul (shin@hanyang.ac.kr), 2020, Institute of Electronics Engineers of Korea (09): : 461 - 467
  • [35] Single-image de-raining using low-rank matrix approximation
    Luo, Yu
    Ling, Jie
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (11): : 7503 - 7514
  • [36] Memory-Guided Image De-Raining Using Time-Lapse Data
    Cho, Jaehoon
    Kim, Seungryong
    Sohn, Kwanghoon
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 4090 - 4103
  • [37] Multifocal Attention-Based Cross-Scale Network for Image De-raining
    Zhang, Zheyu
    Zhu, Yurui
    Fu, Xueyang
    Xiong, Zhiwei
    Zha, Zheng-Jun
    Wu, Feng
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3673 - 3681
  • [38] Single-image de-raining using low-rank matrix approximation
    Yu Luo
    Jie Ling
    Neural Computing and Applications, 2020, 32 : 7503 - 7514
  • [39] Single Image De-raining Based on a Novel Enhanced Attentive Generative Adversarial Network
    Zhou, Haochen
    Wei, Qin
    5TH ANNUAL INTERNATIONAL CONFERENCE ON INFORMATION SYSTEM AND ARTIFICIAL INTELLIGENCE (ISAI2020), 2020, 1575
  • [40] Single-Image De-Raining With Feature-Supervised Generative Adversarial Network
    Xiang, Peng
    Wang, Lei
    Wu, Fuxiang
    Cheng, Jun
    Zhou, Mengchu
    IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (05) : 650 - 654