Human Face Sketch to RGB Image with Edge Optimization and Generative Adversarial Networks

被引:20
|
作者
Zhang, Feng [1 ]
Zhao, Huihuang [1 ,2 ]
Ying, Wang [1 ,2 ]
Liu, Qingyun [1 ,2 ]
Raj, Alex Noel Joseph [3 ]
Fu, Bin [4 ]
机构
[1] Hengyang Normal Univ, Coll Comp Sci & Technol, Hengyang 421002, Peoples R China
[2] Hunan Prov Key Lab Intelligent Informat Proc & Ap, Hengyang 421002, Peoples R China
[3] Key Lab Digital Signal & Image Proc Guangdong, Shantou 515063, Peoples R China
[4] Univ Texas Rio Grande Valley, Dept Comp Sci, Edinburg, TX USA
来源
基金
中国国家自然科学基金;
关键词
Human face sketch; generative adversarial networks; RGB image; edge optimization;
D O I
10.32604/iasc.2020.011750
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Generating an RGB image from a sketch is a challenging and interesting topic. This paper proposes a method to transform a face sketch into a color image based on generation confrontation network and edge optimization. A neural network model based on Generative Adversarial Networks for transferring sketch to RGB image is designed. The face sketch and its RGB image is taken as the training data set. The human face sketch is transformed into an RGB image by the training method of generative adversarial networks confrontation. Aiming to generate a better result especially in edge, an improved loss function based on edge optimization is proposed. The experimental results show that the clarity of the output image, the maintenance of facial features, and the color processing of the image are enhanced best by the image translation model based on the generative adversarial network. Finally, the results are compared with other existing methods. Analyzing the experimental results shows that the color face image generated by our method is closer to the target image, and has achieved a better performance in term of Structural Similarity (SSIM).
引用
收藏
页码:1391 / 1401
页数:11
相关论文
共 50 条
  • [1] Sketch to portrait generation with generative adversarial networks and edge constraint
    Liu, Qingyun
    Zhao, Huihuang
    Wang, Ying
    Zhang, Feng
    Ramasamy, Manimaran
    Qiao, Zhijun
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2021, 95
  • [2] Face image-sketch synthesis via generative adversarial fusion
    Sun, Jianyuan
    Yu, Hongchuan
    Zhang, Jian J.
    Dong, Junyu
    Yu, Hui
    Zhong, Guoqiang
    [J]. NEURAL NETWORKS, 2022, 154 : 179 - 189
  • [3] Evaluating the performance of face sketch generation using generative adversarial networks
    Sannidhan, M. S.
    Prabhu, G. Ananth
    Robbins, David E.
    Shasky, Charles
    [J]. PATTERN RECOGNITION LETTERS, 2019, 128 : 452 - 458
  • [4] Combining residual structure and edge loss for face image restoration with generative adversarial networks
    Zhao, Jia
    Liu, Bosheng
    Wu, Runxiu
    Han, Longzhe
    Chen, Ming
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (03) : 2571 - 2582
  • [5] Combining residual structure and edge loss for face image restoration with generative adversarial networks
    Jia Zhao
    Bosheng Liu
    Runxiu Wu
    Longzhe Han
    Ming Chen
    [J]. Signal, Image and Video Processing, 2024, 18 : 2571 - 2582
  • [6] Face Image Colorization Based on Generative Adversarial Networks
    Han X.-J.
    Liu Y.-L.
    Yang H.-Y.
    [J]. Beijing Ligong Daxue Xuebao/Transaction of Beijing Institute of Technology, 2019, 39 (12): : 1285 - 1291
  • [7] Sketch-based Image Retrieval using Generative Adversarial Networks
    Guo, Longteng
    Liu, Jing
    Wang, Yuhang
    Luo, Zhonghua
    Wen, Wei
    Lu, Hanqing
    [J]. PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17), 2017, : 1267 - 1268
  • [8] Normalized Face Image Generation with Perceptron Generative Adversarial Networks
    Liu, Xiaofeng
    Kumar, B. V. K. Vijaya
    Ge, Yubin
    Yang, Chao
    You, Jane
    Jia, Ping
    [J]. 2018 IEEE 4TH INTERNATIONAL CONFERENCE ON IDENTITY, SECURITY, AND BEHAVIOR ANALYSIS (ISBA), 2018,
  • [9] Face Image Inpainting Using Cascaded Generative Adversarial Networks
    Chen J.-Z.
    Wang J.
    Gong X.
    [J]. Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2019, 48 (06): : 910 - 917
  • [10] Color Face Image Generation with Improved Generative Adversarial Networks
    Chang, Yeong-Hwa
    Chung, Pei-Hua
    Chai, Yu-Hsiang
    Lin, Hung-Wei
    [J]. ELECTRONICS, 2024, 13 (07)