Multi-View Texture Learning for Face Super-Resolution

被引:1
|
作者
Wang, Yu [1 ]
Lu, Tao [1 ]
Yao, Feng [1 ]
Wu, Yuntao [1 ]
Zhang, Yanduo [1 ]
机构
[1] Wuhan Inst Technol, Sch Comp Sci & Engn, Hubei Key Lab Intelligent Robot, Wuhan 430073, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-view face image; texture compensation; face super-resolution; deep learning;
D O I
10.1587/transinf.2020EDP7223
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, single face image super-resolution (SR) using deep neural networks have been well developed. However, most of the face images captured by the camera in a real scene are from different views of the same person, and the existing traditionalmulti-frame image SR requires alignment between images. Due to multi-view face images contain texture information from different views, which can be used as effective prior information, how to use this prior information from multi-views to reconstruct frontal face images is challenging. In order to effectively solve the above problems, we propose a novel face SR network based on multi-view face images, which focus on obtaining more texture information from multi-view face images to help the reconstruction of frontal face images. And in this network, we also propose a texture attention mechanism to transfer high-precision texture compensation information to the frontal face image to obtain better visual effects. We conduct subjective and objective evaluations, and the experimental results show the great potential of using multi-view face images SR. The comparison with other state-of-the-art deep learning SR methods proves that the proposed method has excellent performance.
引用
收藏
页码:1028 / 1038
页数:11
相关论文
共 50 条
  • [41] Generalized face super-resolution
    Jia, Kui
    Gong, Shaogang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2008, 17 (06) : 873 - 886
  • [42] Combining Multi-view Stereo and Super Resolution in a Unified Framework
    Park, Haesol
    Lee, Kyoung Mu
    Lee, Sang Uk
    2012 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2012,
  • [43] Face Recognition Based on Multi-view Ensemble Learning
    Shi, Wenhui
    Jiang, Mingyan
    PATTERN RECOGNITION AND COMPUTER VISION, PT III, 2018, 11258 : 127 - 136
  • [44] Face Super-resolution Based on Multi-source References
    Wang, Rui
    Jian, Muwei
    Smith, Paul
    Yu, Hui
    2022 15TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTION (HSI), 2022,
  • [45] Multi-phase attention network for face super-resolution
    Hu, Tao
    Chen, Yunzhi
    PLOS ONE, 2023, 18 (02):
  • [46] Face Super-Resolution with Progressive Embedding of Multi-scale Face Priors
    Zhang, Chenggong
    Liu, Zhilei
    2022 IEEE INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS (IJCB), 2022,
  • [47] Face Super-Resolution via Robust Online Dictionary Learning
    Liu Fanghua
    Ruan Ruolin
    Ni Hao
    Wu Aixia
    2016 8TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS & SIGNAL PROCESSING (WCSP), 2016,
  • [48] Deep Learning-based Face Super-resolution: A Survey
    Jiang, Junjun
    Wang, Chenyang
    Liu, Xianming
    Ma, Jiayi
    ACM COMPUTING SURVEYS, 2023, 55 (01)
  • [49] A LEARNING APPROACH FOR SINGLE-FRAME FACE SUPER-RESOLUTION
    He, Yu
    Yap, Kim-Hui
    Chau, Lap-Pui
    ISCAS: 2009 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-5, 2009, : 770 - 773
  • [50] Learning Degradation for Real-World Face Super-Resolution
    Chen, Jin
    Chen, Jun
    Wang, Xiaofen
    Xu, Dongshu
    Liang, Chao
    Han, Zhen
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT II, 2024, 14496 : 120 - 131