Single Image De-Raining via Improved Generative Adversarial Nets

被引:11
|
作者
Ren, Yi [1 ]
Nie, Mengzhen [2 ]
Li, Shichao [2 ]
Li, Chuankun [3 ]
机构
[1] CAEIT, Beijing 100041, Peoples R China
[2] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300011, Peoples R China
[3] North Univ China, Sch Informat & Commun Engn, Taiyuan 030051, Peoples R China
关键词
image de-raining; generative adversarial network; rain estimation; refinement network; QUALITY ASSESSMENT; NETWORKS;
D O I
10.3390/s20061591
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Capturing images under rainy days degrades image visual quality and affects analysis tasks, such as object detection and classification. Therefore, image de-raining has attracted a lot of attention in recent years. In this paper, an improved generative adversarial network for single image de-raining is proposed. According to the principles of divide-and-conquer, we divide an image de-raining task into rain locating, rain removing, and detail refining sub-tasks. A multi-stream DenseNet, termed as Rain Estimation Network, is proposed to estimate the rain location map. A Generative Adversarial Network is proposed to remove the rain streaks. A Refinement Network is proposed to refine the details. These three models accomplish rain locating, rain removing, and detail refining sub-tasks, respectively. Experiments on two synthetic datasets and real world images demonstrate that the proposed method outperforms state-of-the-art de-raining studies in both objective and subjective measurements.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] SINGLE IMAGE DE-RAINING VIA GENERATIVE ADVERSARIAL NETS
    Li, Shichao
    Hou, Yonghong
    Yue, Huanjing
    Guo, Zihui
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 1192 - 1197
  • [2] Image De-Raining Using a Conditional Generative Adversarial Network
    Zhang, He
    Sindagi, Vishwanath
    Patel, Vishal M.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (11) : 3943 - 3956
  • [3] Single Image De-raining Based on a Novel Enhanced Attentive Generative Adversarial Network
    Zhou, Haochen
    Wei, Qin
    5TH ANNUAL INTERNATIONAL CONFERENCE ON INFORMATION SYSTEM AND ARTIFICIAL INTELLIGENCE (ISAI2020), 2020, 1575
  • [4] Single-Image De-Raining With Feature-Supervised Generative Adversarial Network
    Xiang, Peng
    Wang, Lei
    Wu, Fuxiang
    Cheng, Jun
    Zhou, Mengchu
    IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (05) : 650 - 654
  • [5] Single Image De-Raining Using Spinning Detail Perceptual Generative Adversarial Networks
    Chen, Kaizheng
    Dai, Yaping
    Jia, Zhiyang
    Hirota, Kaoru
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2020, 24 (07) : 811 - 819
  • [6] DUAL-DOMAIN SINGLE IMAGE DE-RAINING USING CONDITIONAL GENERATIVE ADVERSARIAL NETWORK
    Sharma, Prasen Kumar
    Jain, Priyankar
    Sur, Arijit
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2796 - 2800
  • [7] Multi-Scale Weighted Fusion Attentive Generative Adversarial Network for Single Image De-Raining
    Bi, Xiaojun
    Xing, Junyao
    IEEE ACCESS, 2020, 8 : 69838 - 69848
  • [8] Image De-raining via Continual Learning
    Zhou, Man
    Xiao, Jie
    Chang, Yifan
    Fu, Xueyang
    Liu, Aiping
    Pan, Jinshan
    Zha, Zheng-Jun
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 4905 - 4914
  • [9] Gradual Network for Single Image De-raining
    Yu, Weijiang
    Huang, Zhe
    Zhang, Wayne
    Feng, Litong
    Xiao, Nong
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 1795 - 1804
  • [10] Multi-scale fusion and adaptively attentive generative adversarial network for image de-raining
    Yang, Haifeng
    Guo, Jiajia
    Xin, Yongjie
    Cai, Jianghui
    Zhang, Min
    Zhao, Xujun
    Zhao, Yingyue
    He, Yanting
    APPLIED INTELLIGENCE, 2023, 53 (24) : 30865 - 30886