ATFaceGAN: Single Face Semantic Aware Image Restoration and Recognition from Atmospheric Turbulence

被引:27
|
作者
Lau C.P. [1 ]
Castillo C.D. [1 ]
Chellappa R. [1 ]
机构
[1] AIEM Laboratory, Johns Hopkins University, Baltimore, MD
关键词
face recognition; face verification; generative adversarial networks; Image restoration; turbulence mitigation;
D O I
10.1109/TBIOM.2021.3058316
中图分类号
学科分类号
摘要
Degradation due to atmospheric turbulence is common while capturing images at long ranges. To mitigate the degradation due to turbulence which includes deformation and blur, we propose a generative single frame restoration algorithm which disentangles the blur and deformation due to turbulence and reconstructs a restored image. The disentanglement is achieved by decomposing the distortion due to turbulence into blur and deformation components using a deblur generator and a deformation correction generator, respectively. Two paths of restoration are implemented to regularize the disentanglement and generate two restored images from a given degraded image. A fusion function combines the features of the restored images to reconstruct a sharp image with rich details. Adversarial and perceptual losses are added to reconstruct a sharp image and suppress the artifacts respectively. Extensive experiments demonstrate the effectiveness of the proposed restoration algorithm, which achieves satisfactory performance for face restoration and face recognition tasks. © 2019 IEEE.
引用
收藏
页码:240 / 251
页数:11
相关论文
共 50 条
  • [41] Super-resolution in image restoration of wide area images viewed through atmospheric turbulence
    Lambert, A
    Fraser, D
    Jahromi, MRS
    Hunt, BR
    IMAGE RECONSTRUCTION FROM INCOMPLETE DATA II, 2002, 4792 : 35 - 43
  • [42] A novel atmospheric turbulence-degraded image restoration algorithm based on support vector regression
    Liu Chun-Sheng
    Li Ming
    SIGNAL ANALYSIS, MEASUREMENT THEORY, PHOTO-ELECTRONIC TECHNOLOGY, AND ARTIFICIAL INTELLIGENCE, PTS 1 AND 2, 2006, 6357
  • [43] Semantic-Aware Graph Matching Mechanism for Multi-Label Image Recognition
    Wu, Yanan
    Feng, Songhe
    Wang, Yang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (11) : 6788 - 6803
  • [44] Denoising, Edge Aware Restoration and Enhancement of Single Shallow Coastal Water Image
    Cecilia, Mary
    Murugan, S. Sakthivel
    FLUCTUATION AND NOISE LETTERS, 2022, 21 (01):
  • [45] KomNET: Face Image Dataset from Various Media for Face Recognition
    Astawa, I. Nyoman Gede Arya
    Putra, I. Ketut Gede Darma
    Sudarma, Made
    Hartati, Rukmi Sari
    DATA IN BRIEF, 2020, 31
  • [46] Discriminative Probabilistic Latent Semantic Analysis with Application to Single Sample Face Recognition
    Zhou, Daoxiang
    Yang, Dan
    Zhang, Xiaohong
    Huang, Sheng
    Feng, Shu
    NEURAL PROCESSING LETTERS, 2019, 49 (03) : 1273 - 1298
  • [47] KomNET: Face Image Dataset from Various Media for Face Recognition
    Astawa, I. Nyoman Gede Arya
    Putra, I. Ketut Gede Darma
    Sudarma, Made
    Hartati, Rukmi Sari
    DATA IN BRIEF, 2020, 31
  • [48] Discriminative Probabilistic Latent Semantic Analysis with Application to Single Sample Face Recognition
    Daoxiang Zhou
    Dan Yang
    Xiaohong Zhang
    Sheng Huang
    Shu Feng
    Neural Processing Letters, 2019, 49 : 1273 - 1298
  • [49] Intensity-Aware Single-Image Deraining With Semantic and Color Regularization
    Xu, Ke
    Tian, Xin
    Yang, Xin
    Yin, Baocai
    Lau, Rynson W. H.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 8497 - 8509
  • [50] Super-Resolution Iris Image Restoration using Single Image for Iris Recognition
    Shin, Kwang Yong
    Kang, Byung Jun
    Park, Kang Ryoung
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2010, 4 (02): : 117 - 137