Human Face Sketch to RGB Image with Edge Optimization and Generative Adversarial Networks

被引:20
|
作者
Zhang, Feng [1 ]
Zhao, Huihuang [1 ,2 ]
Ying, Wang [1 ,2 ]
Liu, Qingyun [1 ,2 ]
Raj, Alex Noel Joseph [3 ]
Fu, Bin [4 ]
机构
[1] Hengyang Normal Univ, Coll Comp Sci & Technol, Hengyang 421002, Peoples R China
[2] Hunan Prov Key Lab Intelligent Informat Proc & Ap, Hengyang 421002, Peoples R China
[3] Key Lab Digital Signal & Image Proc Guangdong, Shantou 515063, Peoples R China
[4] Univ Texas Rio Grande Valley, Dept Comp Sci, Edinburg, TX USA
来源
基金
中国国家自然科学基金;
关键词
Human face sketch; generative adversarial networks; RGB image; edge optimization;
D O I
10.32604/iasc.2020.011750
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Generating an RGB image from a sketch is a challenging and interesting topic. This paper proposes a method to transform a face sketch into a color image based on generation confrontation network and edge optimization. A neural network model based on Generative Adversarial Networks for transferring sketch to RGB image is designed. The face sketch and its RGB image is taken as the training data set. The human face sketch is transformed into an RGB image by the training method of generative adversarial networks confrontation. Aiming to generate a better result especially in edge, an improved loss function based on edge optimization is proposed. The experimental results show that the clarity of the output image, the maintenance of facial features, and the color processing of the image are enhanced best by the image translation model based on the generative adversarial network. Finally, the results are compared with other existing methods. Analyzing the experimental results shows that the color face image generated by our method is closer to the target image, and has achieved a better performance in term of Structural Similarity (SSIM).
引用
收藏
页码:1391 / 1401
页数:11
相关论文
共 50 条
  • [41] Face Image Inpainting Based on Generative Adversarial Network
    Gao, Xinyi
    Minh Nguyen
    Yan, Wei Qi
    [J]. PROCEEDINGS OF THE 2021 36TH INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2021,
  • [42] GENERATIVE ADVERSARIAL MULTI-TASK LEARNING FOR FACE SKETCH SYNTHESIS AND RECOGNITION
    Wan, Weiguo
    Lee, Hyo Jong
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 4065 - 4069
  • [43] Image-Based Optimization of Electrical Machines Using Generative Adversarial Networks
    Heroth, Michael
    Schmid, Helmut C.
    Herrlert, Rainer
    Hofmannt, Wilfried
    [J]. 2023 IEEE INTERNATIONAL ELECTRIC MACHINES & DRIVES CONFERENCE, IEMDC, 2023,
  • [44] HCGAN: hierarchical contrast generative adversarial network for unpaired sketch face synthesis
    Du, Kangning
    Wang, Zhen
    Cao, Lin
    Guo, Yanan
    Tian, Shu
    Zhang, Fan
    [J]. PEERJ COMPUTER SCIENCE, 2024, 10
  • [45] Face hallucination based on edge enhanced generative adversarial network
    Lu T.
    Chen C.
    Xu R.
    Zhang Y.
    [J]. Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2020, 48 (01): : 87 - 92
  • [46] A review on Generative Adversarial Networks for image generation
    de Souza, Vinicius Luis Trevisan
    Marques, Bruno Augusto Dorta
    Batagelo, Harlen Costa
    Gois, Joao Paulo
    [J]. COMPUTERS & GRAPHICS-UK, 2023, 114 : 13 - 25
  • [47] Generative Adversarial Networks in Medical Image Processing
    Gong, Meiqin
    Chen, Siyu
    Chen, Qingyuan
    Zeng, Yuanqi
    Zhang, Yongqing
    [J]. CURRENT PHARMACEUTICAL DESIGN, 2021, 27 (15) : 1856 - 1868
  • [48] Review of Generative Adversarial Networks in Image Generation
    Chi, Wanle
    Choo, Yun Huoy
    Goh, Ong Sing
    [J]. JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2022, 26 (01) : 3 - 7
  • [49] Image Inpainting Using Generative Adversarial Networks
    Luo H.-L.
    Ao Y.
    Yuan P.
    [J]. Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (10): : 1891 - 1898
  • [50] Modified generative adversarial networks for image classification
    Zhao, Zhongtang
    Li, Ruixian
    [J]. EVOLUTIONARY INTELLIGENCE, 2023, 16 (06) : 1899 - 1906