StarEnhancer: Learning Real-Time and Style-Aware Image Enhancement

被引:23
|
作者
Song, Yuda [1 ]
Qian, Hui [1 ]
Du, Xin [2 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou, Peoples R China
[2] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou, Peoples R China
关键词
NETWORK;
D O I
10.1109/ICCV48922.2021.00409
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image enhancement is a subjective process whose targets vary with user preferences. In this paper, we propose a deep learning-based image enhancement method covering multiple tonal styles using only a single model dubbed StarEnhancer. It can transform an image from one tonal style to another, even if that style is unseen. With a simple one-time setting, users can customize the model to make the enhanced images more in line with their aesthetics. To make the method more practical, we propose a well-designed enhancer that can process a 4K-resolution image over 200 FPS but surpasses the contemporaneous single style image enhancement methods in terms of PSNR, SSIM, and LPIPS. Finally, our proposed enhancement method has good interactability, which allows the user to fine-tune the enhanced image using intuitive options.
引用
收藏
页码:4106 / 4115
页数:10
相关论文
共 50 条
  • [1] A Style-Aware Content Loss for Real-Time HD Style Transfer
    Sanakoyeu, Artsiom
    Kotovenko, Dmytro
    Lang, Sabine
    Ommer, Bjoern
    COMPUTER VISION - ECCV 2018, PT VIII, 2018, 11212 : 715 - 731
  • [2] Style-Aware Contrastive Learning for Multi-Style Image Captioning
    Zhou, Yucheng
    Long, Guodong
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 2257 - 2267
  • [3] A Style-aware Discriminator for Controllable Image Translation
    Kim, Kunhee
    Park, Sanghun
    Jeon, Eunyeong
    Kim, Taehun
    Kim, Daijin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18218 - 18227
  • [4] Parallel Style-Aware Image Cloning for Artworks
    Zhao, Yandan
    Jin, Xiaogang
    Xu, Yingqing
    Zhao, Hanli
    Ai, Meng
    Zhou, Kun
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2015, 21 (02) : 229 - 240
  • [5] Multi-Model Style-Aware Diffusion Learning for Semantic Image Synthesis
    Niu, Yunfang
    Wu, Lingxiang
    Zhang, Yufeng
    Zhu, Yousong
    Zhu, Guibo
    Wang, Jinqiao
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (11)
  • [6] Disentangling Structure and Aesthetics for Style-aware Image Completion
    Gilbert, Andrew
    Collomosse, John
    Jin, Hailin
    Price, Brian
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 1848 - 1856
  • [7] Unsupervised learning of style-aware facial animation from real acting performances
    Paier, Wolfgang
    Hilsmann, Anna
    Eisert, Peter
    GRAPHICAL MODELS, 2023, 129
  • [8] Fashion Style-Aware Embeddings for Clothing Image Retrieval
    Naka, Rino
    Katsurai, Marie
    Yanagi, Keisuke
    Goto, Ryosuke
    PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2022, 2022, : 49 - 53
  • [9] Style-Aware Image Recommendation for Social Media Marketing
    Zhang, Yiwei
    Yamasaki, Toshihiko
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3106 - 3114
  • [10] Multitask bilateral learning for real-time image enhancement
    Kong, Kyeongbo
    Lee, Junggi
    Song, Woo-Jin
    Kang, Minsung
    Kwon, Kyung Joon
    Kim, Seong Gyun
    JOURNAL OF THE SOCIETY FOR INFORMATION DISPLAY, 2019, 27 (10) : 630 - 645