Multi-View Texture Learning for Face Super-Resolution

被引:1
|
作者
Wang, Yu [1 ]
Lu, Tao [1 ]
Yao, Feng [1 ]
Wu, Yuntao [1 ]
Zhang, Yanduo [1 ]
机构
[1] Wuhan Inst Technol, Sch Comp Sci & Engn, Hubei Key Lab Intelligent Robot, Wuhan 430073, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-view face image; texture compensation; face super-resolution; deep learning;
D O I
10.1587/transinf.2020EDP7223
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, single face image super-resolution (SR) using deep neural networks have been well developed. However, most of the face images captured by the camera in a real scene are from different views of the same person, and the existing traditionalmulti-frame image SR requires alignment between images. Due to multi-view face images contain texture information from different views, which can be used as effective prior information, how to use this prior information from multi-views to reconstruct frontal face images is challenging. In order to effectively solve the above problems, we propose a novel face SR network based on multi-view face images, which focus on obtaining more texture information from multi-view face images to help the reconstruction of frontal face images. And in this network, we also propose a texture attention mechanism to transfer high-precision texture compensation information to the frontal face image to obtain better visual effects. We conduct subjective and objective evaluations, and the experimental results show the great potential of using multi-view face images SR. The comparison with other state-of-the-art deep learning SR methods proves that the proposed method has excellent performance.
引用
收藏
页码:1028 / 1038
页数:11
相关论文
共 50 条
  • [21] Learning wavelet coefficients for face super-resolution
    Liu Ying
    Sun Dinghua
    Wang Fuping
    Lim Keng Pang
    Chiew Tuan Kiang
    Lai Yi
    VISUAL COMPUTER, 2021, 37 (07): : 1613 - 1622
  • [22] Learning to Have an Ear for Face Super-Resolution
    Meishvili, Givi
    Jenni, Simon
    Favaro, Paolo
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1361 - 1371
  • [23] Contour-texture preservation transformer for face super-resolution
    Wu, Ziyi
    Zhang, Yanduo
    Lu, Tao
    Zhao, Kanghui
    Wang, Jiaming
    NEUROCOMPUTING, 2025, 626
  • [24] Multi-view and multi-scale super-resolution method of logging curves based on fractal theory
    Han, Jian
    Wang, Sijie
    Cao, Zhimin
    Li, Jialu
    Liu, Meng
    REVIEW OF SCIENTIFIC INSTRUMENTS, 2022, 93 (12):
  • [25] Learning Texture Transformer Network for Image Super-Resolution
    Yang, Fuzhi
    Yang, Huan
    Fu, Jianlong
    Lu, Hongtao
    Guo, Baining
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5790 - 5799
  • [26] MULTI-VIEW VIDEO SUPER-RESOLUTION FOR HYBRID CAMERAS USING MODIFIED NLM AND ADAPTIVE THRESHOLDING
    Lengyel, Robert
    Soroushmehr, S. M. Reza
    Shirani, Shahram
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 5437 - 5441
  • [27] A Multi-view Super-Resolution Method with Joint-optimization of Image Fusion and Blind Deblurring
    Fan, Jun
    Wu, Yue
    Zeng, Xiangrong
    Huangpeng, Qizi
    Liu, Yan
    Long, Xin
    Zhou, Jinglun
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2018, 12 (05): : 2366 - 2395
  • [28] Statistical learning of multi-view face detection
    Li, SZ
    Zhu, L
    Zhang, ZQ
    Blake, A
    Zhang, HJ
    Shum, H
    COMPUTER VISION - ECCV 2002, PT IV, 2002, 2353 : 67 - 81
  • [29] SUPER-RESOLUTION FOR DIFFERENTLY EXPOSED MIXED-RESOLUTION MULTI-VIEW IMAGES ADAPTED BY A HISTOGRAM MATCHING METHOD
    Richter, Thomas
    Kaup, Andre
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 2022 - 2026
  • [30] Tangential and exponential kernel weighted regression model for multi-view face video super resolution
    Deshmukh, Amar B.
    Rani, N. Usha
    JOURNAL OF ENGINEERING RESEARCH, 2019, 7 (02): : 178 - 195