Single-Image Snow Removal Based on an Attention Mechanism and a Generative Adversarial Network

被引:4
|
作者
Jia, Aiwen [1 ,2 ]
Jia, Zhen-Hong [1 ,2 ]
Yang, Jie [3 ]
Kasabov, Nikola K. [4 ]
机构
[1] Xinjiang Univ, Coll Informat Sci & Engn, Urumqi 830046, Peoples R China
[2] Xinjiang Univ, Key Lab Signal Detect & Proc, Urumqi 830046, Xinjiang Uygur, Peoples R China
[3] Shanghai Jiao Tong Univ, Inst Image Proc & Pattern Recognit, Shanghai 200400, Peoples R China
[4] Auckland Univ Technol, Knowledge Engn & Discovery Res Inst, Auckland 1020, New Zealand
基金
美国国家科学基金会;
关键词
Snow; Rain; Feature extraction; Training; Generators; Gallium nitride; Generative adversarial networks; Snow removal; generative adversarial networks; attention mechanisms;
D O I
10.1109/ACCESS.2021.3051359
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Bad weather, such as snowfall, can seriously decrease the quality of images and pose great challenges to computer vision algorithms. In view of the negative effect of snowfall, this paper presents a single-image snow removal method based on a generative adversarial network (GAN). Unlike previous GANs, our GAN includes an attention mechanism in the generator component. By injecting attention information, the network can pay increased attention to areas covered by snow and improve its capability to perform local repairs. At the same time, we improve the traditional U-Net network by combining it with the residual network to enhance the effect of the model when removing snowflakes from a single image. Our experiments on both synthetic and real-word images show that our method produces better results than those of other state-of-the-art methods.
引用
收藏
页码:12852 / 12860
页数:9
相关论文
共 50 条
  • [1] Single-image snow removal algorithm based on generative adversarial networks
    Zhang, Zhijia
    Wu, Sinan
    Wang, Shixian
    [J]. IET IMAGE PROCESSING, 2023, 17 (12) : 3580 - 3588
  • [2] Single-Image Rain Removal Network Based on an Attention Mechanism and a Residual Structure
    Liang, Xinyue
    Zhao, Feng
    [J]. IEEE ACCESS, 2022, 10 : 52472 - 52480
  • [3] Attention Fusion Generative Adversarial Network for Single-Image Super-Resolution Reconstruction
    Peng Yanfei
    Zhang Pingjia
    Gao Yi
    Zi Lingling
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (20)
  • [4] Enhanced Attentive Generative Adversarial Network for Single-Image Deraining
    Chai, Guoqiang
    Wang, Zhaoba
    Guo, Guodong
    Chen, Youxing
    Jin, Yong
    Wang, Dawei
    Lu, Bin
    Ren, Shilei
    [J]. IEEE ACCESS, 2021, 9 : 58390 - 58402
  • [5] Multi-Scale Attention Generative Adversarial Network for Single Image Rain Removal
    Wang, Wanwei
    [J]. PATTERN RECOGNITION AND IMAGE ANALYSIS, 2022, 32 (02) : 436 - 447
  • [6] Multi-Scale Attention Generative Adversarial Network for Single Image Rain Removal
    [J]. Pattern Recognition and Image Analysis, 2022, 32 : 436 - 447
  • [7] Single Image Snow Removal via Composition Generative Adversarial networks
    Li, Zhi
    Zhang, Juan
    Fang, Zhijun
    Huang, Bo
    Jiang, Xiaoyan
    Gao, Yongbin
    Hwang, Jenq-Neng
    [J]. IEEE ACCESS, 2019, 7 : 25016 - 25025
  • [8] Underwater Image Enhancement Based on Pyramid Attention Mechanism and Generative Adversarial Network
    Wang Yue
    Wang Dexing
    Yuan Hongchun
    Wu Ruoyou
    Gong Peng
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (16)
  • [9] Single image dehazing using generative adversarial networks based on an attention mechanism
    Ma, Yongli
    Xu, Jindong
    Jia, Fei
    Yan, Weiqing
    Liu, Zhaowei
    Ni, Mengying
    [J]. IET IMAGE PROCESSING, 2022, 16 (07) : 1897 - 1907
  • [10] DHGAN: Generative adversarial network with dark channel prior for single-image dehazing
    Wu, Wenxia
    Zhu, Jinxiu
    Su, Xin
    Zhang, Xuewu
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (18):