SMooDi: Stylized Motion Diffusion Model

被引:0
|
作者
Zhong, Lei [1 ]
Xie, Yiming [1 ]
Jampani, Varun [2 ]
Sun, Deqing [3 ]
Jiang, Huaizu [1 ]
机构
[1] Northeastern Univ, Boston, MA 02115 USA
[2] Stabil AI, London, England
[3] Google Res, Mountain View, CA USA
来源
关键词
Motion synthesis; Diffusion model; Stylized motion;
D O I
10.1007/978-3-031-73232-4_23
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce a novel Stylized Motion Diffusion model, dubbed SMooDi, to generate stylized motion driven by content texts and style motion sequences. Unlike existing methods that either generate motion of various content or transfer style from one sequence to another, SMooDi can rapidly generate motion across a broad range of content and diverse styles. To this end, we tailor a pre-trained text-to-motion model for stylization. Specifically, we propose style guidance to ensure that the generated motion closely matches the reference style, alongside a lightweight style adaptor that directs the motion towards the desired style while ensuring realism. Experiments across various applications demonstrate that our proposed framework outperforms existing methods in stylized motion generation. Project Page: https://neu-vi.github.io/SMooDi/
引用
收藏
页码:405 / 421
页数:17
相关论文
共 50 条
  • [21] Stylized Model of Levy Process in Risk Estimation
    Yun, Xin
    Ye, Yanyi
    Liu, Hao
    Li, Yi
    Lai, Kin-Keung
    MATHEMATICS, 2023, 11 (06)
  • [22] StyleAdapter: A Unified Stylized Image Generation Model
    Wang, Zhouxia
    Wang, Xintao
    Xie, Liangbin
    Qi, Zhongang
    Shan, Ying
    Wang, Wenping
    Luo, Ping
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, : 1894 - 1911
  • [23] An asset return model capturing stylized facts
    L. C. G. Rogers
    Liang Zhang
    Mathematics and Financial Economics, 2011, 5 : 101 - 119
  • [24] An asset return model capturing stylized facts
    Rogers, L. C. G.
    Zhang, Liang
    MATHEMATICS AND FINANCIAL ECONOMICS, 2011, 5 (02) : 101 - 119
  • [25] A stylized model of 'Momentum' processes: a research note
    Bandyopadhyay, S.
    Bandyopadhyay, S.
    JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 2010, 61 (06) : 1057 - 1062
  • [26] STYLIZED MODEL OF DEVALUATION-INFLATION SPIRAL
    RODRIGUEZ, CA
    INTERNATIONAL MONETARY FUND STAFF PAPERS, 1978, 25 (01): : 76 - 89
  • [27] DS-Fusion: Artistic Typography via Discriminated and Stylized Diffusion
    Tanveer, Maham
    Wang, Yizhi
    Mahdavi-Amiri, Ali
    Zhang, Hao
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 374 - 384
  • [28] Arbitrary Motion Style Transfer with Multi-condition Motion Latent Diffusion Model
    Song, Wenfeng
    Jin, Xingliang
    Li, Shuai
    Chen, Chenglizhao
    Hao, Aimin
    Hou, Xia
    Li, Ning
    Qin, Hong
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 821 - 830
  • [29] Local Action-Guided Motion Diffusion Model for Text-to-Motion Generation
    Jin, Peng
    Li, Hao
    Cheng, Zesen
    Li, Kehan
    Yu, Runyi
    Liu, Chang
    Ji, Xiangyang
    Yuan, Li
    Chen, Jie
    COMPUTER VISION - ECCV 2024, PT XXV, 2025, 15083 : 392 - 409
  • [30] EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generation
    Zhou, Wenyang
    Dou, Zhiyang
    Cao, Zeyu
    Liao, Zhouyingcheng
    Wang, Jingbo
    Wang, Wenjia
    Liu, Yuan
    Komura, Taku
    Wang, Wenping
    Liu, Lingjie
    COMPUTER VISION - ECCV 2024, PT II, 2025, 15060 : 18 - 38