ATFaceGAN: Single Face Semantic Aware Image Restoration and Recognition from Atmospheric Turbulence

被引:27
|
作者
Lau C.P. [1 ]
Castillo C.D. [1 ]
Chellappa R. [1 ]
机构
[1] AIEM Laboratory, Johns Hopkins University, Baltimore, MD
关键词
face recognition; face verification; generative adversarial networks; Image restoration; turbulence mitigation;
D O I
10.1109/TBIOM.2021.3058316
中图分类号
学科分类号
摘要
Degradation due to atmospheric turbulence is common while capturing images at long ranges. To mitigate the degradation due to turbulence which includes deformation and blur, we propose a generative single frame restoration algorithm which disentangles the blur and deformation due to turbulence and reconstructs a restored image. The disentanglement is achieved by decomposing the distortion due to turbulence into blur and deformation components using a deblur generator and a deformation correction generator, respectively. Two paths of restoration are implemented to regularize the disentanglement and generate two restored images from a given degraded image. A fusion function combines the features of the restored images to reconstruct a sharp image with rich details. Adversarial and perceptual losses are added to reconstruct a sharp image and suppress the artifacts respectively. Extensive experiments demonstrate the effectiveness of the proposed restoration algorithm, which achieves satisfactory performance for face restoration and face recognition tasks. © 2019 IEEE.
引用
收藏
页码:240 / 251
页数:11
相关论文
共 50 条
  • [21] Restoration of Single pixel imaging in atmospheric turbulence by Fourier filter and CGAN
    Zhang Leihong
    Bian Zhixiang
    Ye Hualong
    Wang Zhaorui
    Wang Kaimin
    Zhang Dawei
    Applied Physics B, 2021, 127
  • [22] Atmospheric turbulence-degraded image restoration using principal components analysis
    Li, Dalong
    Mersereau, Russell M.
    Simske, Steven
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2007, 4 (03) : 340 - 344
  • [23] Simulation of atmospheric turbulence for a qualitative evaluation of image restoration algorithms with motion detection
    Huebner, Claudia S.
    Gladysz, Szymon
    OPTICS IN ATMOSPHERIC PROPAGATION AND ADAPTIVE SYSTEMS XV, 2012, 8535
  • [24] Atmospheric turbulence degraded image restoration using a modified dilated convolutional network
    Su, Changdong
    Wu, Xiaoqing
    Guo, Yiming
    Zhang, Shitai
    Wang, Zhiyuan
    Shi, Dongfeng
    IET IMAGE PROCESSING, 2022, 16 (13) : 3507 - 3517
  • [25] A Novel Algorithm for Face Recognition Based on a Single Image
    Tan, Nutao
    Huang, Lei
    Liu, Changping
    PROCEEDINGS OF THE 2008 CHINESE CONFERENCE ON PATTERN RECOGNITION (CCPR 2008), 2008, : 241 - 245
  • [26] Face recognition with single training image per person
    Yin, HT
    Fu, P
    Meng, SW
    ISTM/2005: 6TH INTERNATIONAL SYMPOSIUM ON TEST AND MEASUREMENT, VOLS 1-9, CONFERENCE PROCEEDINGS, 2005, : 6092 - 6095
  • [27] RESTORATION OF HOLOGRAPHIC IMAGE DEGRADED BY ATMOSPHERIC-TURBULENCE THROUGH SPATIAL-FILTERING
    FUJISAKI, K
    TATEIBA, M
    JOURNAL OF ELECTROMAGNETIC WAVES AND APPLICATIONS, 1994, 8 (03) : 315 - 327
  • [28] Image Reconstruction from Videos Distorted by Atmospheric Turbulence
    Zhu, Xiang
    Milanfar, Peyman
    VISUAL INFORMATION PROCESSING AND COMMUNICATION, 2010, 7543
  • [29] Towards a Flexible Semantic Guided Model for Single Image Enhancement and Restoration
    Wu, Yuhui
    Wang, Guoqing
    Liu, Shaochong
    Yang, Yang
    Li, Wei
    Tang, Xiongxin
    Gu, Shuhang
    Li, Chongyi
    Shen, Heng Tao
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (12) : 9921 - 9939
  • [30] Face recognition using elastic local reconstruction based on a single face image
    Xie, Xudong
    Lam, Kin-Man
    PATTERN RECOGNITION, 2008, 41 (01) : 406 - 417