Learning a deep motion interpolation network for human skeleton animations

被引:1
|
作者
Zhou, Chi [1 ,2 ]
Lai, Zhangjiong [2 ]
Wang, Suzhen [2 ]
Li, Lincheng [1 ,2 ]
Sun, Xiaohan [1 ]
Ding, Yu [1 ,2 ]
机构
[1] Zhejiang Univ, Hangzhou, Zhejiang, Peoples R China
[2] Netease Fuxi AI Lab, Virtual Human Grp, Hangzhou, Zhejiang, Peoples R China
关键词
image inpainting; motion control; motion interpolation; animation; deep learning;
D O I
10.1002/cav.2003
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Motion interpolation technology produces transition motion frames between two discrete movements. It is wildly used in video games, virtual reality and augmented reality. In the fields of computer graphics and animations, our data-driven method generates transition motions of two arbitrary animations without additional control signals. In this work, we propose a novel carefully designed deep learning framework, named deep motion interpolation network (DMIN), to learn human movement habits from a real dataset and then to perform the interpolation function specific for human motions. It is a data-driven approach to capture overall rhythm of two given discrete movements and generate natural in-between motion frames. The sequence-by-sequence architecture allows completing all missing frames within single forward inference, which reduces computation time for interpolation. Experiments on human motion datasets show that our network achieves promising interpolation performance. The ablation study demonstrates the effectiveness of the carefully designed DMIN.(1)
引用
下载
收藏
页数:12
相关论文
共 50 条
  • [21] Dynamic Dense Graph Convolutional Network for Skeleton-Based Human Motion Prediction
    Wang, Xinshun
    Zhang, Wanying
    Wang, Can
    Gao, Yuan
    Liu, Mengyuan
    IEEE Transactions on Image Processing, 2024, 33 : 1 - 15
  • [22] A Deep Learning Approach for Contour Interpolation
    Zhao, Chenxi
    Duan, Ye
    Yang, Deshan
    2021 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR), 2021,
  • [23] A Deep Learning Approach for Contour Interpolation
    Zhao, C.
    Duan, Y.
    Li, H.
    Kim, H.
    Henke, L.
    Yang, D.
    MEDICAL PHYSICS, 2021, 48 (06)
  • [24] Skeleton-Aware Networks for Deep Motion Retargeting
    Aberman, Kfir
    Li, Peizhuo
    Lischinski, Dani
    Sorkine-Hornung, Olga
    Cohen-Or, Daniel
    Chen, Baoquan
    ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (04):
  • [25] Deep network for human action recognition using Weber motion
    Chaudhary, Sachin
    Murala, Subrahmanyam
    NEUROCOMPUTING, 2019, 367 : 207 - 216
  • [26] Contour interpolation by deep learning approach
    Zhao, Chenxi
    Duan, Ye
    Yang, Deshan
    JOURNAL OF MEDICAL IMAGING, 2022, 9 (06)
  • [27] Learning to Dress: Synthesizing Human Dressing Motion via Deep Reinforcement Learning
    Clegg, Alexander
    Yu, Wenhao
    Tan, Jie
    Liu, C. Karen
    Turk, Greg
    SIGGRAPH ASIA'18: SIGGRAPH ASIA 2018 TECHNICAL PAPERS, 2018,
  • [28] Motion Recognition Based on Deep Learning and Human Joint Points
    Wang, Junping
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [29] Human motion similarity evaluation based on deep metric learning
    Yidan Zhang
    Lei Nie
    Scientific Reports, 14 (1)
  • [30] Learning to Dress: Synthesizing Human Dressing Motion via Deep Reinforcement Learning
    Clegg, Alexander
    Yu, Wenhao
    Tan, Jie
    Liu, C. Karen
    Turk, Greg
    ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (06):