ATFaceGAN: Single Face Semantic Aware Image Restoration and Recognition from Atmospheric Turbulence

被引:27
|
作者
Lau C.P. [1 ]
Castillo C.D. [1 ]
Chellappa R. [1 ]
机构
[1] AIEM Laboratory, Johns Hopkins University, Baltimore, MD
关键词
face recognition; face verification; generative adversarial networks; Image restoration; turbulence mitigation;
D O I
10.1109/TBIOM.2021.3058316
中图分类号
学科分类号
摘要
Degradation due to atmospheric turbulence is common while capturing images at long ranges. To mitigate the degradation due to turbulence which includes deformation and blur, we propose a generative single frame restoration algorithm which disentangles the blur and deformation due to turbulence and reconstructs a restored image. The disentanglement is achieved by decomposing the distortion due to turbulence into blur and deformation components using a deblur generator and a deformation correction generator, respectively. Two paths of restoration are implemented to regularize the disentanglement and generate two restored images from a given degraded image. A fusion function combines the features of the restored images to reconstruct a sharp image with rich details. Adversarial and perceptual losses are added to reconstruct a sharp image and suppress the artifacts respectively. Extensive experiments demonstrate the effectiveness of the proposed restoration algorithm, which achieves satisfactory performance for face restoration and face recognition tasks. © 2019 IEEE.
引用
收藏
页码:240 / 251
页数:11
相关论文
共 50 条
  • [31] Dependency-Aware Attention Control for Unconstrained Face Recognition with Image Sets
    Liu, Xiaofeng
    Kumar, B. V. K. Vijaya
    Yang, Chao
    Tang, Qingming
    You, Jane
    COMPUTER VISION - ECCV 2018, PT XI, 2018, 11215 : 573 - 590
  • [32] Unsupervised face recognition from image sequences
    Raytchev, B
    Murase, H
    2001 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL I, PROCEEDINGS, 2001, : 1042 - 1045
  • [33] Unified probabilistic models for face recognition from a single example image per person
    Pin Liao
    Li Shen
    Journal of Computer Science and Technology, 2004, 19 : 383 - 392
  • [34] Face recognition from a single image per person using common subfaces method
    Li, Jun-Bao
    Pan, Jeng-Shyang
    Chu, Shu-Chuan
    ADVANCES IN NEURAL NETWORKS - ISNN 2007, PT 2, PROCEEDINGS, 2007, 4492 : 905 - +
  • [35] Unified probabilistic models for face recognition from a single example image per person
    Liao, P
    Shen, L
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2004, 19 (03) : 383 - 392
  • [36] Single hazy image restoration using robust atmospheric scattering model
    Dai, Chenggang
    Lin, Mingxing
    Wu, Xiaojian
    Zhang, Dong
    SIGNAL PROCESSING, 2020, 166
  • [37] Face Recognition Based on a Single Image and Local Binary Pattern
    Tan, Nutao
    Huang, Lei
    Liu, Changping
    2008 INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION TECHNOLOGY APPLICATION, VOL II, PROCEEDINGS, 2008, : 366 - 370
  • [38] Representative Feature Chain for Single Gallery Image Face Recognition
    Chen, Shaokang
    Sanderson, Conrad
    Sun, Sai
    Lovell, Brian C.
    19TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1-6, 2008, : 112 - 115
  • [39] A facial sparse descriptor for single image based face recognition
    Liu, Na
    Lai, Jian-Huang
    Zheng, Wei-Shi
    NEUROCOMPUTING, 2012, 93 : 77 - 87
  • [40] From one to many: Pose-Aware Metric Learning for single-sample face recognition
    Deng, Weihong
    Hu, Jiani
    Wu, Zhongjun
    Guo, Jun
    PATTERN RECOGNITION, 2018, 77 : 426 - 437