QC-StyleGAN - Quality Controllable Image Generation and Manipulation

被引:0
|
作者
Dat Viet Thanh Nguyen [1 ]
Phong Tran [1 ,2 ]
Dinh, Tan M. [1 ]
Anh Tuan Tran [1 ]
Cuong Pham [1 ,3 ]
机构
[1] VinAI Res, Hanoi, Vietnam
[2] MBZUAI, Abu Dhabi, U Arab Emirates
[3] Posts & Telecommun Inst Technol, Ho Chi Minh City, Vietnam
来源
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022) | 2022年
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The introduction of high-quality image generation models, particularly the StyleGAN family, provides a powerful tool to synthesize and manipulate images. However, existing models are built upon high-quality (HQ) data as desired outputs, making them unfit for in-the-wild low-quality (LQ) images, which are common inputs for manipulation. In this work, we bridge this gap by proposing a novel GAN structure that allows for generating images with controllable quality. The network can synthesize various image degradation and restore the sharp image via a quality control code. Our proposed QC-StyleGAN can directly edit LQ images without altering their quality by applying GAN inversion and manipulation techniques. It also provides for free an image restoration solution that can handle various degradations, including noise, blur, compression artifacts, and their mixtures. Finally, we demonstrate numerous other applications such as image degradation synthesis, transfer, and interpolation.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Laser controllable generation and manipulation of micro-bubbles in water
    Angelsky, O. V.
    Bekshaev, A. Ya.
    Maksimyak, P. P.
    Maksimyak, A. P.
    Hanson, S. G.
    Kontush, S. M.
    THIRTEENTH INTERNATIONAL CONFERENCE ON CORRELATION OPTICS, 2017, 10612
  • [22] Multi-Label Car Damage Image Generation Based on Few Shot StyleGAN
    Ding, Kai
    Yang, Jiaxi
    Yang, Yao
    Na, Chongning
    Computer Engineering and Applications, 2023, 59 (23) : 202 - 210
  • [23] High-Quality Font Generation Based on StyleGAN2 and FSFont Font Generation Model
    Shimamura, Yuki
    Niimi, Michiharu
    2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 820 - 825
  • [24] Injecting 3D Perception of Controllable NeRF-GAN into StyleGAN for Editable Portrait Image Synthesis
    Kwak, Jeong-gi
    Li, Yuanming
    Yoon, Dongsik
    Kim, Donghyeon
    Han, David
    Ko, Hanseok
    COMPUTER VISION - ECCV 2022, PT XVII, 2022, 13677 : 236 - 253
  • [25] Toward Open-World Text-Driven Face Generation and Manipulation via StyleGAN3
    Li, Zonglin
    Zhang, Zhaoxin
    Liu, Peiqiang
    Liu, Qinglin
    Sun, Xin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 12862 - 12872
  • [26] Adversarially Approximated Autoencoder for Image Generation and Manipulation
    Xu, Wenju
    Keshmiri, Shawn
    Wang, Guanghui
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (09) : 2387 - 2396
  • [27] Removing the Quality Tax in Controllable Face Generation
    Huang, Yiwen
    Yu, Zhiqiu
    Yi, Xinjie
    Wang, Yue
    Tompkin, James
    2024 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION, WACV 2024, 2024, : 5352 - 5361
  • [28] Controllable image generation based on causal representation learning
    Huang, Shanshan
    Wang, Yuanhao
    Gong, Zhili
    Liao, Jun
    Wang, Shu
    Liu, Li
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2024, 25 (01) : 135 - 148
  • [29] Diverse single image generation with controllable global structure
    Mahendren, Sutharsan
    Edussooriya, Chamira U. S.
    Rodrigo, Ranga
    NEUROCOMPUTING, 2023, 528 : 97 - 112
  • [30] Controllable Counterfactual Generation for Interpretable Medical Image Classification
    Liu, Shiyu
    Wang, Fan
    Ren, Zehua
    Lian, Chunfeng
    Ma, Jianhua
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT X, 2024, 15010 : 143 - 152