Multi-View Texture Learning for Face Super-Resolution

被引:1
|
作者
Wang, Yu [1 ]
Lu, Tao [1 ]
Yao, Feng [1 ]
Wu, Yuntao [1 ]
Zhang, Yanduo [1 ]
机构
[1] Wuhan Inst Technol, Sch Comp Sci & Engn, Hubei Key Lab Intelligent Robot, Wuhan 430073, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-view face image; texture compensation; face super-resolution; deep learning;
D O I
10.1587/transinf.2020EDP7223
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, single face image super-resolution (SR) using deep neural networks have been well developed. However, most of the face images captured by the camera in a real scene are from different views of the same person, and the existing traditionalmulti-frame image SR requires alignment between images. Due to multi-view face images contain texture information from different views, which can be used as effective prior information, how to use this prior information from multi-views to reconstruct frontal face images is challenging. In order to effectively solve the above problems, we propose a novel face SR network based on multi-view face images, which focus on obtaining more texture information from multi-view face images to help the reconstruction of frontal face images. And in this network, we also propose a texture attention mechanism to transfer high-precision texture compensation information to the frontal face image to obtain better visual effects. We conduct subjective and objective evaluations, and the experimental results show the great potential of using multi-view face images SR. The comparison with other state-of-the-art deep learning SR methods proves that the proposed method has excellent performance.
引用
收藏
页码:1028 / 1038
页数:11
相关论文
共 50 条
  • [1] Face Super-Resolution by Learning Multi-view Texture Compensation
    Wang, Yu
    Lu, Tao
    Xu, Ruobo
    Zhang, Yanduo
    [J]. MULTIMEDIA MODELING (MMM 2020), PT II, 2020, 11962 : 350 - 360
  • [2] Learned Multi-View Texture Super-Resolution
    Richard, Audrey
    Cherabier, Ian
    Oswald, Martin R.
    Tsiminaki, Vagia
    Pollefeys, Marc
    Schindler, Konrad
    [J]. 2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, : 533 - 543
  • [3] Improving Multi-View Stereo via Super-Resolution
    Lomurno, Eugenio
    Romanoni, Andrea
    Matteucci, Matteo
    [J]. IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT II, 2022, 13232 : 102 - 113
  • [4] Synthetic aperture imaging using multi-view super-resolution
    Zhang, Jiaqing
    Pei, Zhao
    Jin, Min
    Zhang, Wenwen
    Li, Jun
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (03)
  • [5] Space-Angle Super-Resolution for Multi-View Images
    Sun, Yuqi
    Cheng, Ri
    Yan, Bo
    Zhou, Shili
    [J]. PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 750 - 759
  • [6] A new closed loop method of super-resolution for multi-view images
    Zhang, Jing
    Cao, Yang
    Zheng, Zhigang
    Chen, Changwen
    Wang, Zengfu
    [J]. MACHINE VISION AND APPLICATIONS, 2014, 25 (07) : 1685 - 1695
  • [7] Image super-resolution via multi-view information fusion networks
    Jiang, Xinrui
    Wang, Nannan
    Xin, Jingwei
    Yang, Xi
    Yu, Yi
    Gao, Xinbo
    [J]. NEUROCOMPUTING, 2020, 402 : 29 - 37
  • [8] A new closed loop method of super-resolution for multi-view images
    Jing Zhang
    Yang Cao
    Zhigang Zheng
    Changwen Chen
    Zengfu Wang
    [J]. Machine Vision and Applications, 2014, 25 : 1685 - 1695
  • [9] A depth-based super-resolution method for multi-view color images
    Fan, Jun
    Zeng, Xiangrong
    Huangpeng, Qizi
    Zhou, Jinglun
    Feng, Jing
    [J]. FIRST INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION, 2016, 0011
  • [10] Geometry-Aware Reference Synthesis for Multi-View Image Super-Resolution
    Cheng, Ri
    Sun, Yuqi
    Yan, Bo
    Tan, Weimin
    Ma, Chenxi
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6083 - 6093