Deep pelican based synthesis model for photo-sketch face synthesis and recognition

被引:0
|
作者
Balayesu, Narasimhula [1 ]
Reddy, Avuthu Avinash [2 ]
机构
[1] Vignans Fdn Sci Technol & Res, Dept Comp Sci & Engn, Vadlamudi 522213, Andhra Pradesh, India
[2] Vignans Fdn Sci Technol & Res, Dept Adv Comp Sci & Engn, Vadlamudi 522213, Andhra Pradesh, India
关键词
Sketch synthesis; Photosynthesis; Heterogeneous Recognition; Matching rate; Residual block; And Self-attention;
D O I
10.1007/s11042-024-18361-2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Face photo-sketch synthesis has a number of uses in digital entertainment in addition to its security applications. In the upcoming 10 years, recent advances in IoT technology are expected to become widespread. Photo sketch synthesis is still a difficult problem to solve due to the distinct qualities of photo and sketch. In this research, a photo to sketch and sketch to photo transformation problem is considered and investigated by the newly well-liked generative models. Traditional GAN-based methods have shown significant improvements, especially in the area of translation problems. However, they are known to be limited in their ability to produce realistic, high-resolution images. Photo-sketch synthesis (PSS) and Photo-sketch recognition (PSR) are two fascinating and related challenges that will be covered in this research. In order to do this, this research offers a novel synthesis framework called the Pelican generative self-attention adversarial synthesis model (PGS-ASM), which creates pictures of varying resolutions in an adversarial manner sequentially from low to high resolution. In addition, the minimization of additional loss functions affords suitable regularization with high-quality and high-resolution PSS. Using two well-known datasets, all findings are analyzed, and the proposed method has significantly improved image quality and PS matching accuracy. The reconstruction error, qualitative measure of structural similarity index (SSIM), feature similarity index (FSIM) and recognition accuracy are examined and compared with traditional adversarial models in the experimental scenario. In addition to this, the qualitative analysis under varying lightning, pose variations and Occlusions are evaluated also the ablation study and cross fold validation are conducted.
引用
收藏
页码:71285 / 71310
页数:26
相关论文
共 50 条
  • [1] Face Photo-Sketch Synthesis and Recognition
    Wang, Xiaogang
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, 31 (11) : 1955 - 1967
  • [2] An Unsupervised Method for Face Photo-Sketch Synthesis and Recognition
    Abdel-Aziz, Heba Ghreeb M.
    Ebeid, Hala M.
    Mostafa, Mostafa G. M.
    [J]. 2016 7TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS), 2016, : 221 - 226
  • [3] A Deep Collaborative Framework for Face Photo-Sketch Synthesis
    Zhu, Mingrui
    Li, Jie
    Wang, Nannan
    Gao, Xinbo
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (10) : 3096 - 3108
  • [4] A Mean Features Method for Face Photo-Sketch Synthesis and Recognition
    Abel-Aziz, Heba Ghareeb M.
    Ebeid, Hala M.
    Mostafa, Mostafa G. M.
    [J]. INTERNATIONAL CONFERENCE ON INFORMATICS AND SYSTEMS (INFOS 2016), 2016, : 107 - 113
  • [5] Photo-sketch synthesis and recognition based on subspace learning
    Xiao, Bing
    Gao, Xinbo
    Tao, Dacheng
    Yuan, Yuan
    Li, Jie
    [J]. NEUROCOMPUTING, 2010, 73 (4-6) : 840 - 852
  • [6] A Simple Framework for Face Photo-Sketch Synthesis
    Li, Xuewei
    Cao, Xiaochun
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2012, 2012
  • [7] Knowledge Distillation for Face Photo-Sketch Synthesis
    Zhu, Mingrui
    Li, Jie
    Wang, Nannan
    Gao, Xinbo
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (02) : 893 - 906
  • [8] Identity-aware CycleGAN for face photo-sketch synthesis and recognition
    Fang, Yuke
    Deng, Weihong
    Du, Junping
    Hu, Jiani
    [J]. PATTERN RECOGNITION, 2020, 102
  • [9] Face Photo-Sketch Recognition Using Bidirectional Collaborative Synthesis Network
    Bae, Seho
    Din, Nizam Ud
    Park, Hyunkyu
    Yi, Juneho
    [J]. PROCEEDINGS OF THE 2022 16TH INTERNATIONAL CONFERENCE ON UBIQUITOUS INFORMATION MANAGEMENT AND COMMUNICATION (IMCOM 2022), 2022,
  • [10] A Sketch-Transformer Network for Face Photo-Sketch Synthesis
    Zhu, Mingrui
    Liang, Changcheng
    Wang, Nannan
    Wang, Xiaoyu
    Li, Zhifeng
    Gao, Xinbo
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 1352 - 1358