StyleBlit: Fast Example-Based Stylization with Local Guidance

被引:17
|
作者
Sykora, D. [1 ]
Jamriska, O. [1 ]
Texler, O. [1 ]
Fiser, J. [2 ]
Lukac, M. [2 ]
Lu, J. [2 ]
Shechtman, E. [2 ]
机构
[1] Czech Tech Univ, Fac Elect Engn, Prague, Czech Republic
[2] Adobe Res, San Francisco, CA USA
关键词
TEXTURE SYNTHESIS; IMAGE; DEFORMATION; MODEL;
D O I
10.1111/cgf.13621
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We present StyleBlitan efficient example-based style transfer algorithm that can deliver high-quality stylized renderings in real-time on a single-core CPU. Our technique is especially suitable for style transfer applications that use local guidance - descriptive guiding channels containing large spatial variations. Local guidance encourages transfer of content from the source exemplar to the target image in a semantically meaningful way. Typical local guidance includes, e.g., normal values, texture coordinates or a displacement field. Contrary to previous style transfer techniques, our approach does not involve any computationally expensive optimization. We demonstrate that when local guidance is used, optimization-based techniques converge to solutions that can be well approximated by simple pixel-level operations. Inspired by this observation, we designed an algorithm that produces results visually similar to, if not better than, the state-of-the-art, and is several orders of magnitude faster. Our approach is suitable for scenarios with low computational budget such as games and mobile applications.
引用
收藏
页码:83 / 91
页数:9
相关论文
共 50 条
  • [41] Example-based Spatial Search at Scale
    Zhang, Hanyuan
    Luo, Siqiang
    Shi, Jieming
    Yan, Jing Nathan
    Sun, Weiwei
    [J]. 2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 539 - 551
  • [42] Example-based hinting of TrueType fonts
    Zongker, DE
    Wade, G
    Salesin, DH
    [J]. SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, : 411 - 416
  • [43] Example-Based Rendering of Eye Movements
    Banf, Michael
    Blanz, Volker
    [J]. COMPUTER GRAPHICS FORUM, 2009, 28 (02) : 659 - 666
  • [44] Example-Based Hair Geometry Synthesis
    Wang, Lvdi
    Yu, Yizhou
    Zhou, Kun
    Guo, Baining
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03):
  • [45] Example-based Enhancement of Degraded Video
    Hung, Edson M.
    Garcia, Diogo C.
    de Queiroz, Ricardo L.
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2014, 21 (09) : 1140 - 1144
  • [46] Example-based caricature generation with exaggeration
    Liang, L
    Chen, H
    Xu, YQ
    Shum, HY
    [J]. 10TH PACIFIC CONFERENCE ON COMPUTER GRAPHICS AND APPLICATIONS, PROCEEDINGS, 2002, : 386 - 393
  • [47] Texture Compilation for Example-Based Synthesis
    Ali, J. Amjath
    Janet, J.
    [J]. INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2011), 2011, 8285
  • [48] Example-based Chinese Calligraphy Synthesis
    Li, Wei
    Chen, Yumin
    Tang, Chao
    Yu, Shaoyong
    [J]. PROCEEDINGS OF THE 2018 INTERNATIONAL CONFERENCE ON ADVANCED CONTROL, AUTOMATION AND ARTIFICIAL INTELLIGENCE (ACAAI 2018), 2018, 155 : 253 - 256
  • [49] Example-based Facade Texture Synthesis
    Dai, Dengxin
    Riemenschneider, Hayko
    Schmitt, Gerhard
    Van Gool, Luc
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 1065 - 1072
  • [50] EXAMPLE-BASED BRIGHTNESS AND CONTRAST ENHANCEMENT
    Narasimha, Rajesh
    Batur, Aziz Umit
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 2459 - 2463