DEEP LEARNING FACE HALLUCINATION VIA ATTRIBUTES TRANSFER AND ENHANCEMENT

被引:8
|
作者
Li, Mengyan [1 ]
Sun, Yuechuan [1 ]
Zhang, Zhaoyu [1 ]
Xie, Haonian [1 ]
Yu, Jun [1 ]
机构
[1] Univ Sci & Technol China, Dept Automat, Hefei, Anhui, Peoples R China
基金
中国国家自然科学基金;
关键词
Face hallucination; facial attributes; face attribute transfer; face enhancement; face super-resolution;
D O I
10.1109/ICME.2019.00110
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Face hallucination technique aims to generate high-resolution (HR) face images from low-resolution (LR) inputs. Even though existing face hallucination methods have achieved great performance on the global region evaluation, most of them cannot reasonably restore local attributes, especially when ultra-resolving tiny LR face image (16x16 pixels) to its larger version (8x upscaling factor). In this paper, we propose a novel attribute-guided face transfer and enhancement network for face hallucination. Specifically, we first construct a face transfer network, which upsamples LR face images to HR feature maps, and then fuses facial attributes and the upsampled features to generate HR face images with rational attributes. Finally, a face enhancement network is developed based on generative adversarial network (GAN) to improve visual quality by exploiting a composite loss that combines image color, texture and content. Extensive experiments demonstrate that our method achieves superior face hallucination results and outperforms the state-of-the-art.
引用
收藏
页码:604 / 609
页数:6
相关论文
共 50 条
  • [1] Deep representation learning for face hallucination
    Lu, Tao
    Wang, Yu
    Xu, Ruobo
    Liu, Wei
    Fang, Wenhua
    Zhang, Yanduo
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (05) : 6305 - 6330
  • [2] Deep representation learning for face hallucination
    Tao Lu
    Yu Wang
    Ruobo Xu
    Wei Liu
    Wenhua Fang
    Yanduo Zhang
    [J]. Multimedia Tools and Applications, 2022, 81 : 6305 - 6330
  • [3] Identity-Preserving Face Hallucination via Deep Reinforcement Learning
    Cheng, Xiaojuan
    Lu, Jiwen
    Yuan, Bo
    Zhou, Jie
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (12) : 4796 - 4809
  • [4] Attention-Aware Face Hallucination via Deep Reinforcement Learning
    Cao, Qingxing
    Lin, Liang
    Shi, Yukai
    Liang, Xiaodan
    Li, Guanbin
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1656 - 1664
  • [5] Deep Learning Face Attributes in the Wild
    Liu, Ziwei
    Luo, Ping
    Wang, Xiaogang
    Tang, Xiaoou
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 3730 - 3738
  • [6] Tiny Face Hallucination via Relativistic Adversarial Learning
    Shao Wenze
    Zhang Miaomiao
    Li Haibo
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2021, 43 (09) : 2577 - 2585
  • [7] Face enhancement and hallucination in the wild
    Ding, Xin
    Hu, Ruimin
    Wang, Zhongyuan
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (03): : 2399 - 2412
  • [8] Face enhancement and hallucination in the wild
    Xin Ding
    Ruimin Hu
    Zhongyuan Wang
    [J]. Neural Computing and Applications, 2023, 35 : 2399 - 2412
  • [9] Identity-Aware Deep Face Hallucination via Adversarial Face Verification
    Kazemi, Hadi
    Taherkhani, Fariborz
    Nasrabadi, Nasser M.
    [J]. 2019 IEEE 10TH INTERNATIONAL CONFERENCE ON BIOMETRICS THEORY, APPLICATIONS AND SYSTEMS (BTAS), 2019,
  • [10] Joint Face Hallucination and Deblurring via Structure Generation and Detail Enhancement
    Song, Yibing
    Zhang, Jiawei
    Gong, Lijun
    He, Shengfeng
    Bao, Linchao
    Pan, Jinshan
    Yang, Qingxiong
    Yang, Ming-Hsuan
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2019, 127 (6-7) : 785 - 800