DualSmoke: Sketch-based smoke illustration design with two-stage generative model

被引:0
|
作者
Xie, Haoran [1 ]
Arihara, Keisuke [1 ]
Sato, Syuhei [2 ]
Miyata, Kazunori [1 ]
机构
[1] Japan Adv Inst Sci & Technol, Grad Sch Adv Sci & Technol, 1-1 Nomi, Ishikawa 9231292, Japan
[2] Hosei Univ, Grad Sch Comp & Informat Sci, 3-7-2 Kajino Cho, Koganei, Tokyo 1848584, Japan
关键词
smoke simulation; flow control; generative adversarial network (GAN); finite-time lyapunov exponent (FTLE); Lagrangian coherent structure (LCS); COHERENT STRUCTURES; SIMULATION;
D O I
10.1007/s41095-022-0318-0
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The dynamic effects of smoke are impressive in illustration design, but it is a troublesome and challenging issue for inexpert users to design smoke effects without domain knowledge of fluid simulations. In this work, we propose DualSmoke, a two-stage global-to-local generation framework for interactive smoke illustration design. In the global stage, the proposed approach utilizes fluid patterns to generate Lagrangian coherent structures from the user's hand-drawn sketches. In the local stage, detailed flow patterns are obtained from the generated coherent structure. Finally, we apply a guiding force field to the smoke simulator to produce the desired smoke illustration. To construct the training dataset, DualSmoke generates flow patterns using finite-time Lyapunov exponents of the velocity fields. The synthetic sketch data are generated from the flow patterns by skeleton extraction. Our user study verifies that the proposed design interface can provide various smoke illustration designs with good user usability. Our code is available at https://githubcom/shasph/DualSmoke.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] SketchOpt: Sketch-based Parametric Model Retrieval for Generative Design
    Keshavarzi, Mohammad
    Hotson, Clayton
    Cheng, Chin-Yi
    Nourbakhsh, Mehdi
    Bergin, Michael
    Asl, Mohammad Rahmani
    [J]. EXTENDED ABSTRACTS OF THE 2021 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'21), 2021,
  • [2] TexControl: Sketch-Based Two-Stage Fashion Image Generation Using Diffusion Model
    Zhang, Yongming
    Zhang, Tianyu
    Xie, Haoran
    [J]. 2024 NICOGRAPH INTERNATIONAL, NICOINT 2024, 2024, : 64 - 68
  • [3] Sketch-based Dynamic Illustration of Fluid Systems
    Zhu, Bo
    Iwata, Michiaki
    Haraguchi, Ryo
    Ashihara, Takashi
    Umetani, Nobuyuki
    Igarashi, Takeo
    Nakazawa, Kazuo
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (06):
  • [4] Sketch2VF: Sketch-based flow design with conditional generative adversarial network
    Hu, Zhongyuan
    Xie, Haoran
    Fukusato, Tsukasa
    Sato, Takahiro
    Igarashi, Takeo
    [J]. COMPUTER ANIMATION AND VIRTUAL WORLDS, 2019, 30 (3-4)
  • [5] Generative Model for Zero-Shot Sketch-Based Image Retrieval
    Verma, Vinay Kumar
    Mishra, Aakansha
    Mishra, Ashish
    Rai, Piyush
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 704 - 713
  • [6] Research on Sketch-based Design
    Lu, Zhangping
    Yuan, Hao
    Bi, Wei
    Tang, Lei
    [J]. 2009 IEEE 10TH INTERNATIONAL CONFERENCE ON COMPUTER-AIDED INDUSTRIAL DESIGN & CONCEPTUAL DESIGN, VOLS 1-3: E-BUSINESS, CREATIVE DESIGN, MANUFACTURING - CAID&CD'2009, 2009, : 1170 - +
  • [7] Two-stage Sketch Colorization
    Zhang, Lvmin
    Li, Chengze
    Wong, Tien-Tsin
    Ji, Yi
    Liu, Chunping
    [J]. SIGGRAPH ASIA'18: SIGGRAPH ASIA 2018 TECHNICAL PAPERS, 2018,
  • [8] Two-stage Sketch Colorization
    Zhang, Lvmin
    Li, Chengze
    Wong, Tien-Tsin
    Ji, Yi
    Liu, Chunping
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (06):
  • [9] A framework for sketch-based cooperative design
    Jiang, Wei
    Sun, Zhengxing
    [J]. COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN III, 2007, 4402 : 139 - +
  • [10] A sketch-based collaborative design system
    Fan, Z
    Chi, M
    Oliveira, MM
    [J]. XVI BRAZILIAN SYMPOSIUM ON COMPUTER GRAPHICS AND IMAGE PROCESSING, PROCEEDINGS, 2003, : 125 - 131