Single-Image Snow Removal Based on an Attention Mechanism and a Generative Adversarial Network

被引:4
|
作者
Jia, Aiwen [1 ,2 ]
Jia, Zhen-Hong [1 ,2 ]
Yang, Jie [3 ]
Kasabov, Nikola K. [4 ]
机构
[1] Xinjiang Univ, Coll Informat Sci & Engn, Urumqi 830046, Peoples R China
[2] Xinjiang Univ, Key Lab Signal Detect & Proc, Urumqi 830046, Xinjiang Uygur, Peoples R China
[3] Shanghai Jiao Tong Univ, Inst Image Proc & Pattern Recognit, Shanghai 200400, Peoples R China
[4] Auckland Univ Technol, Knowledge Engn & Discovery Res Inst, Auckland 1020, New Zealand
基金
美国国家科学基金会;
关键词
Snow; Rain; Feature extraction; Training; Generators; Gallium nitride; Generative adversarial networks; Snow removal; generative adversarial networks; attention mechanisms;
D O I
10.1109/ACCESS.2021.3051359
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Bad weather, such as snowfall, can seriously decrease the quality of images and pose great challenges to computer vision algorithms. In view of the negative effect of snowfall, this paper presents a single-image snow removal method based on a generative adversarial network (GAN). Unlike previous GANs, our GAN includes an attention mechanism in the generator component. By injecting attention information, the network can pay increased attention to areas covered by snow and improve its capability to perform local repairs. At the same time, we improve the traditional U-Net network by combining it with the residual network to enhance the effect of the model when removing snowflakes from a single image. Our experiments on both synthetic and real-word images show that our method produces better results than those of other state-of-the-art methods.
引用
收藏
页码:12852 / 12860
页数:9
相关论文
共 50 条
  • [41] Plane-Wave Image Reconstruction via Generative Adversarial Network and Attention Mechanism
    Tang, Jiahua
    Zou, Bao
    Li, Chang
    Feng, Shuai
    Peng, Hu
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [42] Computationally efficient progressive approach for single-image super-resolution using generative adversarial network
    Chudasama, Vishal
    Upla, Kishor
    JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (02)
  • [43] Multi-scale capsule generative adversarial network for snow removal
    Yang, Fei
    Zhang, Jialu
    Zhang, Qian
    IET COMPUTER VISION, 2021, 15 (07) : 474 - 486
  • [44] Semantic Segmentation of Plant Leaves Based on Generative Adversarial Network and Attention Mechanism
    Cao, Liying
    Li, Hongda
    Liu, Xuerui
    Chen, Guifen
    Yu, Helong
    IEEE ACCESS, 2022, 10 : 76310 - 76317
  • [45] Image Generation Using generative Adversarial Networks and Attention Mechanism
    Kataoka, Yuusuke
    Matsubara, Takashi
    Uehara, Kuniaki
    2016 IEEE/ACIS 15TH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE (ICIS), 2016, : 933 - 938
  • [46] Single Image Defogging Algorithm Based on Conditional Generative Adversarial Network
    Ma, Rui-Qiang
    Shen, Xing-Run
    Zhang, Shan-Jun
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2020, 2020
  • [47] DSAGAN: A generative adversarial network based on dual-stream attention mechanism for anatomical and functional image fusion
    Fu, Jun
    Li, Weisheng
    Du, Jiao
    Xu, Liming
    INFORMATION SCIENCES, 2021, 576 : 484 - 506
  • [48] Image Super-Resolution Reconstruction Based on Self-Attention Mechanism and Deep Generative Adversarial Network
    Zhao, Yu-Feng
    He, Jie
    Journal of Network Intelligence, 2024, 9 (04): : 1936 - 1950
  • [49] DSAGAN: A generative adversarial network based on dual-stream attention mechanism for anatomical and functional image fusion
    Fu, Jun
    Li, Weisheng
    Du, Jiao
    Xu, Liming
    Li, Weisheng (liws@cqupt.edu.cn), 1600, Elsevier Inc. (576): : 484 - 506
  • [50] Image motion deblurring via attention generative adversarial network
    Zhang, Yucun
    Li, Tao
    Li, Qun
    Fu, Xianbin
    Kong, Tao
    COMPUTERS & GRAPHICS-UK, 2023, 111 : 122 - 132