Towards Layer-wise Image Vectorization

被引:10
|
作者
Ma, Xu [1 ]
Zhou, Yuqian [2 ,3 ]
Xu, Xingqian [2 ]
Sun, Bin [1 ]
Filev, Valerii [4 ]
Orlov, Nikita [4 ]
Fu, Yun [1 ]
Shi, Humphrey [2 ,4 ]
机构
[1] Northeastern Univ, Boston, MA 02115 USA
[2] UICI, Urbana, IL USA
[3] Adobe Res, San Jose, CA USA
[4] Picsart AI Res PAIR, San Francisco, CA USA
关键词
D O I
10.1109/CVPR52688.2022.01583
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image rasterization is a mature technique in computer graphics, while image vectorization, the reverse path of rasterization, remains a major challenge. Recent advanced deep learning-based models achieve vectorization and semantic interpolation of vector graphs and demonstrate a better topology of generating new figures. However, deep models cannot be easily generalized to out-of-domain testing data. The generated SVGs also contain complex and redundant shapes that are not quite convenient for further editing. Specifically, the crucial layer-wise topology and fundamental semantics in images are still not well understood and thus not Ally explored. In this work, we propose Layer-wise Image Vectorization, namely LIVE, to convert raster images to SVGs and simultaneously maintain its image topology. LIVE can generate compact SVG forms with layer-wise structures that are semantically consistent with human perspective. We progressively add new bezier paths and optimize these paths with the layer-wise framework, newly designed loss functions, and component-wise path initialization technique. Our experiments demonstrate that LIVE presents more plausible vectorized forms than prior works and can be generalized to new images. With the help of this newly learned topology, LIVE initiates human editable SVGs for both designers and other downstream applications.
引用
收藏
页码:16293 / 16302
页数:10
相关论文
共 50 条
  • [1] Compressing Neural Networks: Towards Determining the Optimal Layer-wise Decomposition
    Liebenuein, Lucas
    Maalouf, Alaa
    Gal, Oren
    Feldman, Dan
    Rus, Daniela
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [2] A layer-wise deep stacking model for social image popularity prediction
    Zehang Lin
    Feitao Huang
    Yukun Li
    Zhenguo Yang
    Wenyin Liu
    [J]. World Wide Web, 2019, 22 : 1639 - 1655
  • [3] Layer-Wise Adaptive Updating for Few-Shot Image Classification
    Qin, Yunxiao
    Zhang, Weiguo
    Wang, Zezheng
    Zhao, Chenxu
    Shi, Jingping
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 2044 - 2048
  • [4] A layer-wise deep stacking model for social image popularity prediction
    Lin, Zehang
    Huang, Feitao
    Li, Yukun
    Yang, Zhenguo
    Liu, Wenyin
    [J]. WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2019, 22 (04): : 1639 - 1655
  • [5] WAYS OF IMPROVING LAYER-WISE CARBONISATION
    SYSKOV, KI
    RAKHANSK.PD
    [J]. COKE & CHEMISTRY USSR, 1970, (07): : 13 - &
  • [6] Towards Layer-Wise Optimization of Contextual Neural Networks with Constant Field of Aggregation
    Mikusova, Miroslava
    Fuchs, Antonin
    Karasinski, Adrian
    Baruah, Rashmi Dutta
    Palak, Rafal
    Burnell, Erik Dawid
    Wolk, Krzysztof
    [J]. INTELLIGENT INFORMATION AND DATABASE SYSTEMS, ACIIDS 2021, 2021, 12672 : 743 - 753
  • [7] Layer-wise enhanced transformer with multi-modal fusion for image caption
    Li, Jingdan
    Wang, Yi
    Zhao, Dexin
    [J]. MULTIMEDIA SYSTEMS, 2023, 29 (03) : 1043 - 1056
  • [8] Layer-wise enhanced transformer with multi-modal fusion for image caption
    Jingdan Li
    Yi Wang
    Dexin Zhao
    [J]. Multimedia Systems, 2023, 29 : 1043 - 1056
  • [9] Layer-Wise Representation Fusion for Compositional Generalization
    Zheng, Yafang
    Lin, Lei
    Li, Shuangtao
    Yuan, Yuxuan
    Lai, Zhaohong
    Liu, Shan
    Fu, Biao
    Chen, Yidong
    Shi, Xiaodong
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 17, 2024, : 19706 - 19714
  • [10] Transkimmer: Transformer Learns to Layer-wise Skim
    Guan, Yue
    Li, Zhengyi
    Leng, Jingwen
    Lin, Zhouhan
    Guo, Minyi
    [J]. PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 7275 - 7286