QC-StyleGAN - Quality Controllable Image Generation and Manipulation

被引:0
|
作者
Dat Viet Thanh Nguyen [1 ]
Phong Tran [1 ,2 ]
Dinh, Tan M. [1 ]
Anh Tuan Tran [1 ]
Cuong Pham [1 ,3 ]
机构
[1] VinAI Res, Hanoi, Vietnam
[2] MBZUAI, Abu Dhabi, U Arab Emirates
[3] Posts & Telecommun Inst Technol, Ho Chi Minh City, Vietnam
来源
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022) | 2022年
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The introduction of high-quality image generation models, particularly the StyleGAN family, provides a powerful tool to synthesize and manipulate images. However, existing models are built upon high-quality (HQ) data as desired outputs, making them unfit for in-the-wild low-quality (LQ) images, which are common inputs for manipulation. In this work, we bridge this gap by proposing a novel GAN structure that allows for generating images with controllable quality. The network can synthesize various image degradation and restore the sharp image via a quality control code. Our proposed QC-StyleGAN can directly edit LQ images without altering their quality by applying GAN inversion and manipulation techniques. It also provides for free an image restoration solution that can handle various degradations, including noise, blur, compression artifacts, and their mixtures. Finally, we demonstrate numerous other applications such as image degradation synthesis, transfer, and interpolation.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Controllable image generation and manipulation
    Patras, Ioannis
    PROCEEDINGS OF THE 2ND ACM INTERNATIONAL WORKSHOP ON MULTIMEDIA AI AGAINST DISCRIMINATION, MAD 2023, 2023, : 1 - 1
  • [2] Designing an Encoder for StyleGAN Image Manipulation
    Tov, Omer
    Alaluf, Yuval
    Nitzan, Yotam
    Patashnik, Or
    Cohen-Or, Daniel
    ACM TRANSACTIONS ON GRAPHICS, 2021, 40 (04):
  • [3] User-Controllable Latent Transformer for StyleGAN Image Layout Editing
    Endo, Y.
    COMPUTER GRAPHICS FORUM, 2022, 41 (07) : 395 - 406
  • [4] Linearly Controllable GAN: Unsupervised Feature Categorization and Decomposition for Image Generation and Manipulation
    Lee, Sehyung
    Kim, Mijung
    Chae, Yeongnam
    Stenger, Bjorn
    COMPUTER VISION-ECCV 2024, PT IV, 2025, 15062 : 229 - 245
  • [5] StyleGAN-based CLIP-guided Image Shape Manipulation
    Qian, Yuchen
    Yamamoto, Kohei
    Yanai, Keiji
    19TH INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING, CBMI 2022, 2022, : 162 - 166
  • [6] Text guided image manipulation using LiT and StyleGAN2
    Todmal, Shantanu
    Hazra, Tanmoy
    2024 IEEE 3RD INTERNATIONAL CONFERENCE ON COMPUTING AND MACHINE INTELLIGENCE, ICMI 2024, 2024,
  • [7] StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generation
    Wu, Zongze
    Lischinski, Dani
    Shechtman, Eli
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12858 - 12867
  • [8] High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD
    Cao, Xiangang
    Wei, Hengyang
    Wang, Peng
    Zhang, Chiyu
    Huang, Shikai
    Li, Hu
    SENSORS, 2023, 23 (01)
  • [9] Dual Mapping of 2D StyleGAN for 3D-Aware Image Generation and Manipulation (Student Abstract)
    Chen, Zhuo
    Zhao, Haimei
    Wang, Chaoyue
    Yuan, Bo
    Li, Xiu
    THIRTY-EIGTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 21, 2024, : 23458 - 23459
  • [10] DrawingInStyles: Portrait Image Generation and Editing With Spatially Conditioned StyleGAN
    Su, Wanchao
    Ye, Hui
    Chen, Shu-Yu
    Gao, Lin
    Fu, Hongbo
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (10) : 4074 - 4088