Deep pelican based synthesis model for photo-sketch face synthesis and recognition

被引:0
|
作者
Balayesu, Narasimhula [1 ]
Reddy, Avuthu Avinash [2 ]
机构
[1] Vignans Fdn Sci Technol & Res, Dept Comp Sci & Engn, Vadlamudi 522213, Andhra Pradesh, India
[2] Vignans Fdn Sci Technol & Res, Dept Adv Comp Sci & Engn, Vadlamudi 522213, Andhra Pradesh, India
关键词
Sketch synthesis; Photosynthesis; Heterogeneous Recognition; Matching rate; Residual block; And Self-attention;
D O I
10.1007/s11042-024-18361-2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Face photo-sketch synthesis has a number of uses in digital entertainment in addition to its security applications. In the upcoming 10 years, recent advances in IoT technology are expected to become widespread. Photo sketch synthesis is still a difficult problem to solve due to the distinct qualities of photo and sketch. In this research, a photo to sketch and sketch to photo transformation problem is considered and investigated by the newly well-liked generative models. Traditional GAN-based methods have shown significant improvements, especially in the area of translation problems. However, they are known to be limited in their ability to produce realistic, high-resolution images. Photo-sketch synthesis (PSS) and Photo-sketch recognition (PSR) are two fascinating and related challenges that will be covered in this research. In order to do this, this research offers a novel synthesis framework called the Pelican generative self-attention adversarial synthesis model (PGS-ASM), which creates pictures of varying resolutions in an adversarial manner sequentially from low to high resolution. In addition, the minimization of additional loss functions affords suitable regularization with high-quality and high-resolution PSS. Using two well-known datasets, all findings are analyzed, and the proposed method has significantly improved image quality and PS matching accuracy. The reconstruction error, qualitative measure of structural similarity index (SSIM), feature similarity index (FSIM) and recognition accuracy are examined and compared with traditional adversarial models in the experimental scenario. In addition to this, the qualitative analysis under varying lightning, pose variations and Occlusions are evaluated also the ablation study and cross fold validation are conducted.
引用
下载
收藏
页码:71285 / 71310
页数:26
相关论文
共 50 条
  • [31] Toward Realistic Face Photo-Sketch Synthesis via Composition-Aided GANs
    Yu, Jun
    Xu, Xingxin
    Gao, Fei
    Shi, Shengjie
    Wang, Meng
    Tao, Dacheng
    Huang, Qingming
    IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (09) : 4350 - 4362
  • [32] IsGAN: Identity-sensitive generative adversarial network for face photo-sketch synthesis
    Yan, Lan
    Zheng, Wenbo
    Gou, Chao
    Wang, Fei-Yue
    PATTERN RECOGNITION, 2021, 119
  • [33] Face Photo-Sketch Transformation and Population Generation
    Kukharev, Georgy
    Oleinik, Andrei
    COMPUTER VISION AND GRAPHICS, ICCVG 2016, 2016, 9972 : 329 - 340
  • [34] Fast Face Sketch-Photo Image Synthesis and Recognition
    Chen, Zhenxue
    Wang, Kaifang
    Liu, Chengyun
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2016, 30 (10)
  • [35] Face sketch synthesis and recognition
    Tang, XO
    Wang, XG
    NINTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS I AND II, PROCEEDINGS, 2003, : 687 - 694
  • [36] Image Transformation using Limited Reference with Application to Photo-Sketch Synthesis
    Bai, Wei
    Li, Yanghao
    Liu, Jiaying
    Guo, Zongming
    2014 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING CONFERENCE, 2014, : 41 - 44
  • [37] Face photo-sketch portraits transformation via generation pipeline
    Guo, Mengsi
    Xiong, Mingfu
    Huang, Jin
    Hu, Xinrong
    Peng, Tao
    VISUAL COMPUTER, 2024, 41 (2): : 1183 - 1196
  • [38] Superpixel- Based Face Sketch-Photo Synthesis
    Peng, Chunlei
    Gao, Xinbo
    Wang, Nannan
    Li, Jie
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2017, 27 (02) : 288 - 299
  • [39] Transductive Face Sketch-Photo Synthesis
    Wang, Nannan
    Tao, Dacheng
    Gao, Xinbo
    Li, Xuelong
    Li, Jie
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (09) : 1364 - 1376
  • [40] Ipdm: identity preserving diffusion model for face sketch and photo synthesis
    Duoxun Tang
    Xinhang Jiang
    Ying Zhang
    Yuhang Dai
    Ye Lin
    Machine Vision and Applications, 2025, 36 (2)