Image Shadow Removal Based on Minimum Noise Fraction and Generative Adversarial Network

被引:0
|
作者
Ding Dong [1 ,2 ]
Wang Jiali [1 ]
Chen Ming [1 ,2 ]
机构
[1] Shanghai Ocean Univ, Coll Informat Technol, Shanghai 201306, Peoples R China
[2] Minist Agr, Key Lab Fisheries Informat, Shanghai 201306, Peoples R China
关键词
shadow removal; minimum noise fraction; generative adversarial network; encoding and decoding structure;
D O I
10.3788/LOP213421
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
An image shadow removal algorithm based on minimum noise fraction (MNF) and a generative adversarial network (GAN) is proposed to improve the shadow removal effect. The algorithm takes GAN as its basic framework, introduces condition information into the generator and discriminator respectively, and adopts the multitask mode of end-to-end joint learning. The generative network adopts the encoding-decoding structure, and the discriminant network adopts the Markov discriminator structure. Additionally, the proposed algorithm uses MNF to restore the shade-free image after graying the noise-eliminating image with the shadowed image. Therefore, our network can focus on single feature embedding after the change in MNF instead of the traditional cross-task shared embedding. Experimental results indicate that the proposed algorithm can increase the mean structural similarity (SSIM) to 0.9780 and decrease the mean root mean square error (RMSE) to 9.8717 on the specified dataset. Both visual and statistic comparisons confirm that the proposed algorithm is better than other algorithms.
引用
收藏
页数:10
相关论文
共 29 条
  • [1] Shadow Removal Using Intensity Surfaces and Texture Anchor Points
    Arbel, Eli
    Hel-Or, Hagit
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (06) : 1202 - 1216
  • [2] Deep Convolutional Neural Network for Natural Image Matting Using Initial Alpha Mattes
    Cho, Donghyeon
    Tai, Yu-Wing
    Kweon, In So
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (03) : 1054 - 1067
  • [3] On the removal of shadows from images
    Finlayson, GD
    Hordley, SD
    Lu, C
    Drew, MS
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (01) : 59 - 68
  • [4] Finlayson GD, 2002, LECT NOTES COMPUT SC, V2353, P823
  • [5] Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
  • [6] A TRANSFORMATION FOR ORDERING MULTISPECTRAL DATA IN TERMS OF IMAGE QUALITY WITH IMPLICATIONS FOR NOISE REMOVAL
    GREEN, AA
    BERMAN, M
    SWITZER, P
    CRAIG, MD
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 1988, 26 (01): : 65 - 74
  • [7] Learning to Remove Soft Shadows
    Gryka, Maciej
    Terry, Michael
    Brostow, Gabriel J.
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2015, 34 (05):
  • [8] Paired Regions for Shadow Detection and Removal
    Guo, Ruiqi
    Dai, Qieyun
    Hoiem, Derek
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (12) : 2956 - 2967
  • [9] Mask-ShadowGAN: Learning to Remove Shadows from Unpaired Data
    Hu, Xiaowei
    Jiang, Yitong
    Fu, Chi-Wing
    Heng, Pheng-Ann
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2472 - 2481
  • [10] Image-to-Image Translation with Conditional Adversarial Networks
    Isola, Phillip
    Zhu, Jun-Yan
    Zhou, Tinghui
    Efros, Alexei A.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5967 - 5976