GAN-Based High-Quality Face-Swapping Composite Network

被引:0
|
作者
Man, Qiaoyue [1 ]
Cho, Young-Im [1 ]
Gee, Seok-Jeong [1 ]
Kim, Woo-Je [2 ]
Jang, Kyoung-Ae [3 ]
机构
[1] Gachon Univ, Dept Comp Engn, 1342 Seongnamdaero, Seongnam Si 13120, South Korea
[2] Seoul Natl Univ Sci & Technol, Dept Ind Engn, 232 Gongneung Ro, Seoul 01811, South Korea
[3] Datatree Co, 1406 Bando Ivy Valley,204 Gasan Digital 1 Ro, Seoul 08502, South Korea
关键词
image processing; face fusion; convolutional neural network; generative adversarial network;
D O I
10.3390/electronics13153092
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Face swapping or face replacement is a challenging task that involves transferring a source face to a target face while maintaining the target's facial motion and expression. Although many studies have made a lot of encouraging progress, we have noticed that most of the current solutions have the problem of blurred images, abnormal features, and unnatural pictures after face swapping. To solve these problems, in this paper, we proposed a composite face-swapping generation network, which includes a face extraction module and a feature fusion generation module. This model retains the original facial expression features, as well as the background and lighting of the image while performing face swapping, making the image more realistic and natural. Compared with other excellent models, our model is more robust in terms of face identity, posture verification, and image quality.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] A GAN-Based Framework For High-Fidelity Face Swapping
    Zuo, Zheming
    Lian, Zhichao
    Wei, Zhihui
    [J]. 2022 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2022, : 700 - 705
  • [2] Using Fully Connected and Convolutional Net for GAN-Based Face Swapping
    Lin, Bo-Shue
    Hsu, Ding-Wen
    Shen, Chin-Han
    Hsiao, Hsu-Feng
    [J]. APCCAS 2020: PROCEEDINGS OF THE 2020 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS (APCCAS 2020), 2020, : 185 - 188
  • [3] GAN-based Vision Transformer for High-Quality Thermal Image Enhancement
    Marnissi, Mohamed Amine
    Fathallah, Abir
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW, 2023, : 817 - 825
  • [4] IMPROVING GAN-BASED VOCODER FOR FAST AND HIGH-QUALITY SPEECH SYNTHESIS
    He, Mengnan
    Guo, Tingwei
    Lu, Zhengxin
    Zhang, Ruixiong
    Gong, Caixia
    [J]. INTERSPEECH 2022, 2022, : 1601 - 1605
  • [5] High Fidelity Face-Swapping With Style ConvTransformer and Latent Space Selection
    Yang, Jiachen
    Cheng, Chen
    Xiao, Shuai
    Lan, Guipeng
    Wen, Jiabao
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 3604 - 3615
  • [6] Detail Fusion GAN: High-Quality Translation for Unpaired Images with GAN-based Data Augmentation
    Li, Ling
    Li, Yaochen
    Wu, Chuan
    Dong, Hang
    Jiang, Peilin
    Wang, Fei
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 1731 - 1736
  • [7] A Novel GAN-Based Network for Unmasking of Masked Face
    Din, Nizam Ud
    Javed, Kamran
    Bae, Seho
    Yi, Juneho
    [J]. IEEE ACCESS, 2020, 8 : 44276 - 44287
  • [8] A Dual GAN-Based Method for Augmenting High-Quality Rice Leaf Disease Images
    Vijayalakshmi, K.
    Sreenivasulu, K.
    Sandhya, M.
    Khaleelbasha, G.
    Naresh, M. Venkata
    [J]. 2024 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATION AND APPLIED INFORMATICS, ACCAI 2024, 2024,
  • [9] Improved performance of GaN-based light-emitting diodes with high-quality GaN grown on InN islands
    Lee, Sang-Jun
    Cho, Chu-Young
    Hong, Sang-Hyun
    Han, Sang-Heon
    Yoon, Sukho
    Park, Yongjo
    Park, Seong-Ju
    [J]. JOURNAL OF PHYSICS D-APPLIED PHYSICS, 2011, 44 (42)
  • [10] AmazingFS: A High-Fidelity and Occlusion-Resistant Video Face-Swapping Framework
    Zeng, Zhiqiang
    Shao, Wenhua
    Tong, Dingli
    Liu, Li
    [J]. ELECTRONICS, 2024, 13 (15)