Single-Image Snow Removal Based on an Attention Mechanism and a Generative Adversarial Network

被引:4
|
作者
Jia, Aiwen [1 ,2 ]
Jia, Zhen-Hong [1 ,2 ]
Yang, Jie [3 ]
Kasabov, Nikola K. [4 ]
机构
[1] Xinjiang Univ, Coll Informat Sci & Engn, Urumqi 830046, Peoples R China
[2] Xinjiang Univ, Key Lab Signal Detect & Proc, Urumqi 830046, Xinjiang Uygur, Peoples R China
[3] Shanghai Jiao Tong Univ, Inst Image Proc & Pattern Recognit, Shanghai 200400, Peoples R China
[4] Auckland Univ Technol, Knowledge Engn & Discovery Res Inst, Auckland 1020, New Zealand
基金
美国国家科学基金会;
关键词
Snow; Rain; Feature extraction; Training; Generators; Gallium nitride; Generative adversarial networks; Snow removal; generative adversarial networks; attention mechanisms;
D O I
10.1109/ACCESS.2021.3051359
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Bad weather, such as snowfall, can seriously decrease the quality of images and pose great challenges to computer vision algorithms. In view of the negative effect of snowfall, this paper presents a single-image snow removal method based on a generative adversarial network (GAN). Unlike previous GANs, our GAN includes an attention mechanism in the generator component. By injecting attention information, the network can pay increased attention to areas covered by snow and improve its capability to perform local repairs. At the same time, we improve the traditional U-Net network by combining it with the residual network to enhance the effect of the model when removing snowflakes from a single image. Our experiments on both synthetic and real-word images show that our method produces better results than those of other state-of-the-art methods.
引用
收藏
页码:12852 / 12860
页数:9
相关论文
共 50 条
  • [31] A physics based generative adversarial network for single image defogging
    Liu, Wei
    Yao, Rongguo
    Qiu, Guoping
    IMAGE AND VISION COMPUTING, 2019, 92
  • [32] Single image dehazing algorithm based on generative adversarial network
    Zhao, Donghui
    Mo, Bo
    ACM International Conference Proceeding Series, 2022, : 27 - 31
  • [33] Single-Image Dehazing via Compositional Adversarial Network
    Zhu, Hongyuan
    Cheng, Yi
    Peng, Xi
    Zhou, Joey Tianyi
    Kang, Zhao
    Lu, Shijian
    Fang, Zhiwen
    Li, Liyuan
    Lim, Joo-Hwee
    IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (02) : 829 - 838
  • [34] Single-Image Super-Resolution for Remote Sensing Images Using a Deep Generative Adversarial Network With Local and Global Attention Mechanisms
    Li, Yadong
    Mavromatis, Sebastien
    Zhang, Feng
    Du, Zhenhong
    Sequeira, Jean
    Wang, Zhongyi
    Zhao, Xianwei
    Liu, Renyi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [35] Stereoscopic image reflection removal based on Wasserstein Generative Adversarial Network
    Wang, Xiuyuan
    Pan, Yikun
    Lun, Daniel P. K.
    2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2020, : 148 - 151
  • [36] Image Motion Blur Removal Algorithm Based on Generative Adversarial Network
    Kim, Jongchol
    Kim, Myongchol
    Kim, Insong
    Han, Gyongwon
    Jong, Myonghak
    Ri, Gwuangwon
    PROGRAMMING AND COMPUTER SOFTWARE, 2024, 50 (05) : 403 - 415
  • [37] UnfairGAN: An enhanced generative adversarial network for raindrop removal from a single image
    Nguyen, Duc Manh
    Le, Thao Phuong
    Vo, Duc My
    Lee, Sang-Woong
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 210
  • [38] IAD-Net: Single-Image Dehazing Network Based on Image Attention
    Zhang, Zheqing
    Zhou, Hao
    Li, Chuan
    Jiang, Weiwei
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2024, E107D (10) : 1380 - 1384
  • [39] Attention mechanism enhancement algorithm based on cycle consistent generative adversarial networks for single image dehazing
    Liu, Yan
    Al-Shehari, Hassan
    Zhang, Hongying
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 83
  • [40] Semi-supervised Image Classification via Attention Mechanism and Generative Adversarial Network
    Xiang, Xuezhi
    Yu, Zeting
    Lv, Ning
    Kong, Xiangdong
    Saddik, Abdulmotaleb Ei
    ELEVENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2019), 2020, 11373