ATFaceGAN: Single Face Semantic Aware Image Restoration and Recognition from Atmospheric Turbulence

被引:27
|
作者
Lau C.P. [1 ]
Castillo C.D. [1 ]
Chellappa R. [1 ]
机构
[1] AIEM Laboratory, Johns Hopkins University, Baltimore, MD
关键词
face recognition; face verification; generative adversarial networks; Image restoration; turbulence mitigation;
D O I
10.1109/TBIOM.2021.3058316
中图分类号
学科分类号
摘要
Degradation due to atmospheric turbulence is common while capturing images at long ranges. To mitigate the degradation due to turbulence which includes deformation and blur, we propose a generative single frame restoration algorithm which disentangles the blur and deformation due to turbulence and reconstructs a restored image. The disentanglement is achieved by decomposing the distortion due to turbulence into blur and deformation components using a deblur generator and a deformation correction generator, respectively. Two paths of restoration are implemented to regularize the disentanglement and generate two restored images from a given degraded image. A fusion function combines the features of the restored images to reconstruct a sharp image with rich details. Adversarial and perceptual losses are added to reconstruct a sharp image and suppress the artifacts respectively. Extensive experiments demonstrate the effectiveness of the proposed restoration algorithm, which achieves satisfactory performance for face restoration and face recognition tasks. © 2019 IEEE.
引用
收藏
页码:240 / 251
页数:11
相关论文
共 50 条
  • [1] ATFaceGAN: Single Face Image Restoration and Recognition from Atmospheric Turbulence
    Lau, Chun Pong
    Souri, Hossein
    Chellappa, Rama
    2020 15TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2020), 2020, : 32 - 39
  • [2] CNN-Based Restoration of a Single Face Image Degraded by Atmospheric Turbulence
    Yasarla, Rajeev
    Patel, Vishal M.
    IEEE TRANSACTIONS ON BIOMETRICS, BEHAVIOR, AND IDENTITY SCIENCE, 2022, 4 (02): : 222 - 233
  • [3] Image restoration from sequences under atmospheric turbulence effects
    Li, Junshan
    Zhang, Jiao
    Sui, Zhongshan
    AOPC 2017: OPTICAL SENSING AND IMAGING TECHNOLOGY AND APPLICATIONS, 2017, 10462
  • [4] Semantic-Aware Detail Enhancement for Blind Face Restoration
    Zhao, Huimin
    Zhou, Xiaoqiang
    Cao, Jie
    Huang, Huaibo
    Zheng, Aihua
    He, Ran
    2024 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, FG 2024, 2024,
  • [5] Progress in the restoration of image sequences degraded by atmospheric turbulence
    Gal, Ronen
    Kiryati, Nahum
    Sochen, Nir
    PATTERN RECOGNITION LETTERS, 2014, 48 : 8 - 14
  • [6] Joint Face Image Restoration and Frontalization for Recognition
    Tu, Xiaoguang
    Zhao, Jian
    Liu, Qiankun
    Ai, Wenjie
    Guo, Guodong
    Li, Zhifeng
    Liu, Wei
    Feng, Jiashi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (03) : 1285 - 1298
  • [7] Deformation-aware image restoration from atmospheric turbulence based on quasiconformal geometry and pulse-coupled neural network
    Yin, Jie
    Sun, Tao
    Zhang, Guorong
    Wu, Yuhao
    Zhang, Xiao
    VISUAL COMPUTER, 2024,
  • [8] Progressive Semantic-Aware Style Transformation for Blind Face Restoration
    Chen, Chaofeng
    Li, Xiaoming
    Yang, Lingbo
    Lin, Xianhui
    Zhang, Lei
    Wong, Kwan-Yee K.
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 11891 - 11900
  • [9] Atmospheric Turbulence Degraded-Image Restoration by Kurtosis Minimization
    Li, Dalong
    Simske, Steven
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (02) : 244 - 247
  • [10] Atmospheric Turbulence Restoration by Diffeomorphic Image Registration and Blind Deconvolution
    Gilles, Jerome
    Dagobert, Tristan
    De Franchis, Carlo
    ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, PROCEEDINGS, 2008, 5259 : 400 - 409