StyleBlit: Fast Example-Based Stylization with Local Guidance

被引:17
|
作者
Sykora, D. [1 ]
Jamriska, O. [1 ]
Texler, O. [1 ]
Fiser, J. [2 ]
Lukac, M. [2 ]
Lu, J. [2 ]
Shechtman, E. [2 ]
机构
[1] Czech Tech Univ, Fac Elect Engn, Prague, Czech Republic
[2] Adobe Res, San Francisco, CA USA
关键词
TEXTURE SYNTHESIS; IMAGE; DEFORMATION; MODEL;
D O I
10.1111/cgf.13621
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We present StyleBlitan efficient example-based style transfer algorithm that can deliver high-quality stylized renderings in real-time on a single-core CPU. Our technique is especially suitable for style transfer applications that use local guidance - descriptive guiding channels containing large spatial variations. Local guidance encourages transfer of content from the source exemplar to the target image in a semantically meaningful way. Typical local guidance includes, e.g., normal values, texture coordinates or a displacement field. Contrary to previous style transfer techniques, our approach does not involve any computationally expensive optimization. We demonstrate that when local guidance is used, optimization-based techniques converge to solutions that can be well approximated by simple pixel-level operations. Inspired by this observation, we designed an algorithm that produces results visually similar to, if not better than, the state-of-the-art, and is several orders of magnitude faster. Our approach is suitable for scenarios with low computational budget such as games and mobile applications.
引用
收藏
页码:83 / 91
页数:9
相关论文
共 50 条
  • [1] HelpingHand: Example-based Stroke Stylization
    Lu, Jingwan
    Yu, Fisher
    Finkelstein, Adam
    DiVerdi, Stephen
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (04):
  • [2] WISE: Whitebox Image Stylization by Example-Based Learning
    Loetzsch, Winfried
    Reimann, Max
    Buessemeyer, Martin
    Semmo, Amir
    Doellner, Juergen
    Trapp, Matthias
    [J]. COMPUTER VISION - ECCV 2022, PT XVII, 2022, 13677 : 135 - 152
  • [3] Accounting standards, implementation guidance, and example-based reasoning
    Clor-Proell, Shana
    Nelson, Mark W.
    [J]. JOURNAL OF ACCOUNTING RESEARCH, 2007, 45 (04) : 699 - 730
  • [4] StyleProp: Real-time Example-based Stylization of 3D Models
    Hauptfleisch, F.
    Texler, O.
    Texler, A.
    Krivanek, J.
    Sykora, D.
    [J]. COMPUTER GRAPHICS FORUM, 2020, 39 (07) : 575 - 586
  • [5] StyLit: Illumination-Guided Example-Based Stylization of 3D Renderings
    Fiser, Jakub
    Jamriska, Ondrej
    Lukac, Michal
    Shechtman, Eli
    Asente, Paul
    Lu, Jingwan
    Sykora, Daniel
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (04):
  • [6] Fast Texture Synthesis for Discrete Example-Based Elements
    Huang, Zhengrui
    Lin, Xiaohong
    Chen, Chongcheng
    [J]. IEEE ACCESS, 2020, 8 : 76683 - 76691
  • [7] Example-based Multiple Local Color Transfer by Strokes
    Wen, Chung-Lin
    Hsieh, Chang-Hsi
    Chen, Bing-Yu
    Ouhyoung, Ming
    [J]. COMPUTER GRAPHICS FORUM, 2008, 27 (07) : 1765 - 1772
  • [8] Fast and Reliable Example-Based Mesh IK for Stylized Deformations
    Wampler, Kevin
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (06):
  • [9] Example-Based Reasoning and Fact-Weighting Guidance in Accounting Standards
    Capps, Greg
    Koonce, Lisa
    White, Brian J.
    [J]. CONTEMPORARY ACCOUNTING RESEARCH, 2017, 34 (01) : 582 - 600
  • [10] Novel example-based shape learning for fast face alignment
    Chai, XJ
    Shan, SG
    Gao, W
    Cao, B
    [J]. 2003 INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOL III, PROCEEDINGS, 2003, : 141 - 144