Multi-View Texture Learning for Face Super-Resolution

被引:1
|
作者
Wang, Yu [1 ]
Lu, Tao [1 ]
Yao, Feng [1 ]
Wu, Yuntao [1 ]
Zhang, Yanduo [1 ]
机构
[1] Wuhan Inst Technol, Sch Comp Sci & Engn, Hubei Key Lab Intelligent Robot, Wuhan 430073, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-view face image; texture compensation; face super-resolution; deep learning;
D O I
10.1587/transinf.2020EDP7223
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, single face image super-resolution (SR) using deep neural networks have been well developed. However, most of the face images captured by the camera in a real scene are from different views of the same person, and the existing traditionalmulti-frame image SR requires alignment between images. Due to multi-view face images contain texture information from different views, which can be used as effective prior information, how to use this prior information from multi-views to reconstruct frontal face images is challenging. In order to effectively solve the above problems, we propose a novel face SR network based on multi-view face images, which focus on obtaining more texture information from multi-view face images to help the reconstruction of frontal face images. And in this network, we also propose a texture attention mechanism to transfer high-precision texture compensation information to the frontal face image to obtain better visual effects. We conduct subjective and objective evaluations, and the experimental results show the great potential of using multi-view face images SR. The comparison with other state-of-the-art deep learning SR methods proves that the proposed method has excellent performance.
引用
收藏
页码:1028 / 1038
页数:11
相关论文
共 50 条
  • [31] Multi-frame super-resolution for face recognition
    Wheeler, Frederick W.
    Liu, Xiaoming
    Tu, Peter H.
    2007 FIRST IEEE INTERNATIONAL CONFERENCE ON BIOMETRICS: THEORY, APPLICATIONS AND SYSTEMS, 2007, : 193 - 198
  • [32] Super-resolution face view synthesis using a mobile face capture system
    Figueroa-Villanueva, Miguel A.
    Stockman, George C.
    2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS, 2006, : 2725 - +
  • [33] Face Super-Resolution Based on Online Dictionary Learning
    Liu Fanghua
    Ruan Ruolin
    Ni Hao
    Wu Aixia
    2016 9TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2016), 2016, : 195 - 200
  • [34] Cross-Guided Optimization of Radiance Fields with Multi-View Image Super-Resolution for High-Resolution Novel View Synthesis
    Yoon, Youngho
    Yoon, Kuk-Jin
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 12428 - 12438
  • [35] A Joint Learning-Based Method for Multi-View Depth Map Super Resolution
    Li, Jing
    Lu, Zhichao
    Zeng, Gang
    Gan, Rui
    Wang, Long
    Zha, Hongbin
    2013 SECOND IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR 2013), 2013, : 456 - 460
  • [36] VIRTUAL VIEW RENDERING USING SUPER-RESOLUTION WITH MULTI VIEW IMAGES
    Ham, Bumsub
    Min, Dongbo
    Choi, Jinwook
    Sohn, Kwanghoon
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 2345 - 2348
  • [37] A multi-view references image super-resolution framework for generating the large-FOV and high-resolution image
    Jiang, Jiaqin
    Li, Li
    Tan, Bin
    Duan, Lunhao
    Yao, Jian
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 100
  • [38] Optical flow based super-resolution of Chang'E-1 CCD multi-view images
    Chen, Wangli, 1600, Editorial Board of Medical Journal of Wuhan University (39):
  • [39] A depth-based Multi-view Super-Resolution Method Using Image Fusion and Blind Deblurring
    Fan, Jun
    Zeng, Xiangrong
    Huangpeng, Qizi
    Liu, Yan
    Long, Xin
    Feng, Jing
    Zhou, Jinglun
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2016, 10 (10): : 5129 - 5152
  • [40] MULTI-VIEW FACE DETECTION WITH THE MULTI-RESOLUTION MPP CLASSIFIERS
    Yang, Xu
    Yang, Xin
    Xiong, Hui-Lin
    PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 1770 - 1775