Adversarial Image Colorization Method Based on Semantic Optimization and Edge Preservation

被引:1
|
作者
Gui, Tingting [1 ]
Zhan, Weida [1 ]
Gu, Xing [1 ]
Hu, Jiahui [1 ]
机构
[1] Changchun Univ Sci & Technol, Sch Elect Informat Engn, Changchun 130022, Peoples R China
关键词
deep learning; colorization; generative adversarial network; semantic optimization; edge preservation; NETWORK;
D O I
10.3390/electronics11193006
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As a medium for transmitting visual information, image is a direct reflection of the objective existence of the natural world. Grayscale images lack more visual information than color images. Therefore, it is of great significance to study the colorization of grayscale images. At present, the problems of semantic ambiguity, boundary overflow and lack of color saturation exist in both traditional and deep learning methods. To solve the above problems, an adversarial image colorization method based on semantic optimization and edge preservation is proposed. By improving generative and discriminative networks and designing loss functions, deeper semantic information and sharper edges of images can be learned by our network. Our experiments are carried out on the public datasets Place365 and ImageNet. The experimental results show that the method in this paper can reduce the color anomaly caused by semantic ambiguity, suppress the color blooming in the image boundary area and improve the saturation of the image. Our work achieves competitive results on objective indicators of peak signal-to-noise ratio (PSNR), structural similarity (SSIM) and learned perceptual image patch similarity (LPIPS), with values of 30.903 dB, 0.956 and 0.147 on Place365 and 30.545 dB, 0.946 and 0.150 on ImageNet, which proves that this method can effectively colorize grayscale images.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Adversarial Edge-Aware Image Colorization With Semantic Segmentation
    Kong, Guangqian
    Tian, Huan
    Duan, Xun
    Long, Huiyun
    [J]. IEEE ACCESS, 2021, 9 : 28194 - 28203
  • [2] Adversarial grayscale image colorization combined with global semantic optimization
    Wan Yuan-Yuan
    Wang Yu-qing
    Zhang Xiao-ning
    Li Da-qun
    Chen Xiao-lin
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2021, 36 (09) : 1305 - 1313
  • [3] ColorFool: Semantic Adversarial Colorization
    Shamsabadi, Ali Shahin
    Sanchez-Matilla, Ricardo
    Cavallaro, Andrea
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1148 - 1157
  • [4] Face Image Colorization Based on Generative Adversarial Networks
    Han, Xian-Jun
    Liu, Yan-Li
    Yang, Hong-Yu
    [J]. Beijing Ligong Daxue Xuebao/Transaction of Beijing Institute of Technology, 2019, 39 (12): : 1285 - 1291
  • [5] Video colorization with semantic preservation and consistency
    Zhao, Xiangjun
    Du, Zhenlong
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2023, 108
  • [6] Optimization based grayscale image colorization
    Nie Dongdong
    Ma Qinyong
    Ma Lizhuang
    Xiao Shuangjiu
    [J]. PATTERN RECOGNITION LETTERS, 2007, 28 (12) : 1445 - 1451
  • [7] ChromaGAN: Adversarial Picture Colorization with Semantic Class Distribution
    Vitoria, Patricia
    Raad, Lara
    Ballester, Coloma
    [J]. 2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2434 - 2443
  • [8] Fully automatic image colorization based on semantic segmentation technology
    Xu, Min
    Ding, YouDong
    [J]. PLOS ONE, 2021, 16 (11):
  • [9] Footwear Sketches Colorization Method based on Generative Adversarial Network
    Li, Xin
    Zhang, Yihang
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (12) : 143 - 149
  • [10] Automatic Image Colorization based on Multi-Discriminators Generative Adversarial Networks
    Mourchid, Youssef
    Donias, Marc
    Berthoumieu, Yannick
    [J]. 28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020), 2021, : 1532 - 1536