Attention-aware conditional generative adversarial networks for facial age synthesis

被引:3
|
作者
Chen, Xiahui [1 ]
Sun, Yunlian [1 ]
Shu, Xiangbo [1 ]
Li, Qi [2 ,3 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Chinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
[3] Chinese Acad Sci, Artificial Intelligence Res, Qingdao 266300, Peoples R China
基金
中国国家自然科学基金;
关键词
Facial age synthesis; Channel attention; Attention mask; FACE RECOGNITION; PERCEPTION;
D O I
10.1016/j.neucom.2021.04.068
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Generative adversarial networks (GANs) have recently achieved impressive results in facial age synthesis. However, these methods usually select an autoencoder-style generator. And the bottleneck layer in the encoder-decoder generally gives rise to blurry and low-quality generation. To address this limitation, we propose a novel attention-aware conditional generative adversarial network (ACGAN). First, we utilize two different attention mechanisms to improve generation quality. On one hand, we integrate channel attention modules into the generator to enhance the discriminative representation power. On the other hand, we introduce a position attention mask to well-process images captured with various backgrounds and illuminations. Second, we deploy a local discriminator to enhance the central face region with informative details. Third, we adopt three types of losses to achieve accurate age generation and preserve personalized features: 1) The adversarial loss aims to synthesize photo-realistic faces with expected aging effects; 2) The identity loss intends to keep identity information unchanged; 3) The attention loss tries to improve the accuracy of attention mask regression. To assess the effectiveness of the proposed method, we conduct extensive experiments on several public aging databases. Experimental results on MORPH, CACD, and FG-NET show the effectiveness of the proposed framework. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:167 / 180
页数:14
相关论文
共 50 条
  • [1] Attention-Aware Generative Adversarial Networks (ATA-GANs)
    Kastaniotis, Dimitris
    Ntinou, Ioanna
    Tsourounis, Dimitrios
    Economou, George
    Fotopoulos, Spiros
    PROCEEDINGS 2018 IEEE 13TH IMAGE, VIDEO, AND MULTIDIMENSIONAL SIGNAL PROCESSING WORKSHOP (IVMSP), 2018,
  • [2] Towards the adversarial robustness of facial expression recognition: Facial attention-aware adversarial training
    Kim, Daeha
    Kim, Heeje
    Jung, Yoojin
    Kim, Seongho
    Song, Byung Cheol
    NEUROCOMPUTING, 2024, 584
  • [3] Multimodal attention for lip synthesis using conditional generative adversarial networks
    Vidal, Andrea
    Busso, Carlos
    SPEECH COMMUNICATION, 2023, 153
  • [4] Facial Expression Synthesis by U-Net Conditional Generative Adversarial Networks
    Wang, Xueping
    Li, Weixin
    Mu, Guodong
    Huang, Di
    Wang, Yunhong
    ICMR '18: PROCEEDINGS OF THE 2018 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, 2018, : 283 - 290
  • [5] Label Geometry Aware Discriminator for Conditional Generative Adversarial Networks
    Sapkota, Suman
    Khanal, Bidur
    Bhattarai, Binod
    Khanal, Bishesh
    Kim, Tae-Kyun
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2914 - 2920
  • [6] Facial Expression Transfer Based on Conditional Generative Adversarial Networks
    Fan, Yang
    Jiang, Xingguo
    Lan, Shuxing
    Lan, Jianghai
    IEEE ACCESS, 2023, 11 : 82276 - 82283
  • [7] BCGAN: Facial Expression Synthesis by Bottleneck-Layered Conditional Generative Adversarial Networks
    Shin, Yeji
    Bum, Junghyun
    Son, Chang-Hwan
    Choo, Hyunseung
    PROCEEDINGS OF THE 2021 15TH INTERNATIONAL CONFERENCE ON UBIQUITOUS INFORMATION MANAGEMENT AND COMMUNICATION (IMCOM 2021), 2021,
  • [8] Attention-Aware Discrimination for MR-to-CT Image Translation Using Cycle-Consistent Generative Adversarial Networks
    Kearney, Vasant
    Ziemer, Benjamin P.
    Perry, Alan
    Wang, Tianqi
    Chan, Jason W.
    Ma, Lijun
    Morin, Olivier
    Yom, Sue S.
    Solberg, Timothy D.
    RADIOLOGY-ARTIFICIAL INTELLIGENCE, 2020, 2 (02)
  • [9] MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis
    Kumar, Kundan
    Kumar, Rithesh
    de Boissiere, Thibault
    Gestin, Lucas
    Teoh, Wei Zhen
    Sotelo, Jose
    de Brebisson, Alexandre
    Bengio, Yoshua
    Courville, Aaron
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [10] PARALLEL WAVEFORM SYNTHESIS BASED ON GENERATIVE ADVERSARIAL NETWORKS WITH VOICING-AWARE CONDITIONAL DISCRIMINATORS
    Yamamoto, Ryuichi
    Song, Eunwoo
    Hwang, Min-Jae
    Kim, Jae-Min
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6039 - 6043