Adversarial Image Colorization Method Based on Semantic Optimization and Edge Preservation

被引:1
|
作者
Gui, Tingting [1 ]
Zhan, Weida [1 ]
Gu, Xing [1 ]
Hu, Jiahui [1 ]
机构
[1] Changchun Univ Sci & Technol, Sch Elect Informat Engn, Changchun 130022, Peoples R China
关键词
deep learning; colorization; generative adversarial network; semantic optimization; edge preservation; NETWORK;
D O I
10.3390/electronics11193006
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As a medium for transmitting visual information, image is a direct reflection of the objective existence of the natural world. Grayscale images lack more visual information than color images. Therefore, it is of great significance to study the colorization of grayscale images. At present, the problems of semantic ambiguity, boundary overflow and lack of color saturation exist in both traditional and deep learning methods. To solve the above problems, an adversarial image colorization method based on semantic optimization and edge preservation is proposed. By improving generative and discriminative networks and designing loss functions, deeper semantic information and sharper edges of images can be learned by our network. Our experiments are carried out on the public datasets Place365 and ImageNet. The experimental results show that the method in this paper can reduce the color anomaly caused by semantic ambiguity, suppress the color blooming in the image boundary area and improve the saturation of the image. Our work achieves competitive results on objective indicators of peak signal-to-noise ratio (PSNR), structural similarity (SSIM) and learned perceptual image patch similarity (LPIPS), with values of 30.903 dB, 0.956 and 0.147 on Place365 and 30.545 dB, 0.946 and 0.150 on ImageNet, which proves that this method can effectively colorize grayscale images.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Double-Channel Guided Generative Adversarial Network for Image Colorization
    Du, Kangning
    Liu, Changtong
    Cao, Lin
    Guo, Yanan
    Zhang, Fan
    Wang, Tao
    [J]. IEEE ACCESS, 2021, 9 : 21604 - 21617
  • [42] A Sub-Image Edge Preservation Method for Histogram Equalization
    Peng, Yan-Tsung
    Tsai, Bing-Chuan
    Ruan, Shanq-Jang
    [J]. 2013 9TH INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATIONS AND SIGNAL PROCESSING (ICICS), 2013,
  • [43] An Innovative Image Enhancement Method for Edge Preservation in Wavelet Domain
    Jin, Jing
    Tang, Songyuan
    Shen, Yi
    [J]. 2015 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC), 2015, : 52 - 56
  • [44] Adversarial Colorization Of Icons Based On Structure And Color Conditions
    Sun, Tsai-Ho
    Lai, Chien-Hsun
    Wong, Sai-Keung
    Wang, Yu-Shuen
    [J]. PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 683 - 691
  • [45] Grey-scale image colorization by local correlation based optimization algorithm
    Nie, DD
    Ma, LZ
    Xiao, SJ
    Xiao, XZ
    [J]. VISUAL INFORMATION AND INFORMATION SYSTEMS, 2006, 3736 : 13 - 23
  • [46] Semantic-Sparse Colorization Network for Deep Exemplar-Based Colorization
    Bai, Yunpeng
    Dong, Chao
    Chai, Zenghao
    Wang, Andong
    Xu, Zhengzhuo
    Yuan, Chun
    [J]. COMPUTER VISION - ECCV 2022, PT VI, 2022, 13666 : 505 - 521
  • [47] Human Face Sketch to RGB Image with Edge Optimization and Generative Adversarial Networks
    Zhang, Feng
    Zhao, Huihuang
    Ying, Wang
    Liu, Qingyun
    Raj, Alex Noel Joseph
    Fu, Bin
    [J]. INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2020, 26 (06): : 1391 - 1401
  • [48] Fusion of handcrafted edge and residual learning features for image colorization
    Deshpande, Shabdali C.
    Pawer, Meenakshi M.
    Atkale, Dipali V.
    Yadav, Dhanashree M.
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (02) : 291 - 299
  • [49] Feature extraction method based on spectral dimensional edge preservation filtering for hyperspectral image classification
    Li, Zhijian
    Zhu, Qing
    Wang, Yaonan
    Zhang, Zhenjun
    Zhou, Xianen
    Lin, Anping
    Fan, Jingmin
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2020, 41 (01) : 90 - 113
  • [50] Fusion of handcrafted edge and residual learning features for image colorization
    Shabdali C. Deshpande
    Meenakshi M. Pawer
    Dipali V. Atkale
    Dhanashree M. Yadav
    [J]. Signal, Image and Video Processing, 2022, 16 : 291 - 299