Learning a deep motion interpolation network for human skeleton animations

被引:1
|
作者
Zhou, Chi [1 ,2 ]
Lai, Zhangjiong [2 ]
Wang, Suzhen [2 ]
Li, Lincheng [1 ,2 ]
Sun, Xiaohan [1 ]
Ding, Yu [1 ,2 ]
机构
[1] Zhejiang Univ, Hangzhou, Zhejiang, Peoples R China
[2] Netease Fuxi AI Lab, Virtual Human Grp, Hangzhou, Zhejiang, Peoples R China
关键词
image inpainting; motion control; motion interpolation; animation; deep learning;
D O I
10.1002/cav.2003
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Motion interpolation technology produces transition motion frames between two discrete movements. It is wildly used in video games, virtual reality and augmented reality. In the fields of computer graphics and animations, our data-driven method generates transition motions of two arbitrary animations without additional control signals. In this work, we propose a novel carefully designed deep learning framework, named deep motion interpolation network (DMIN), to learn human movement habits from a real dataset and then to perform the interpolation function specific for human motions. It is a data-driven approach to capture overall rhythm of two given discrete movements and generate natural in-between motion frames. The sequence-by-sequence architecture allows completing all missing frames within single forward inference, which reduces computation time for interpolation. Experiments on human motion datasets show that our network achieves promising interpolation performance. The ablation study demonstrates the effectiveness of the carefully designed DMIN.(1)
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Deep Geometric Neural Network for Spatial Interpolation
    Zhang, Minxing
    Yu, Dazhou
    Li, Yun
    Zhao, Liang
    30TH ACM SIGSPATIAL INTERNATIONAL CONFERENCE ON ADVANCES IN GEOGRAPHIC INFORMATION SYSTEMS, ACM SIGSPATIAL GIS 2022, 2022, : 516 - 519
  • [42] Quantifying the osteocyte network in the human skeleton
    Buenzli, Pascal R.
    Sims, Natalie A.
    BONE, 2015, 75 : 144 - 150
  • [43] LEARNING EXPLICIT SHAPE AND MOTION EVOLUTION MAPS FOR SKELETON-BASED HUMAN ACTION RECOGNITION
    Liu, Hong
    Tu, Juanhui
    Liu, Mengyuan
    Ding, Runwei
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 1333 - 1337
  • [44] A Deep Bi-directional Attention Network for Human Motion Recovery
    Cui, Qiongjie
    Sun, Huaijiang
    Li, Yupeng
    Kong, Yue
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 701 - 707
  • [45] DEEP PYRAMID VARIATION LEARNING FOR IMAGE INTERPOLATION
    Qiang, Fu
    Yang, Wenhan
    Li, Ying
    Liu, Jiaying
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 544 - 549
  • [46] Sinogram interpolation for sparse-view micro-CT with deep learning neural network
    Dong, Xu
    Vekhande, Swapnil
    Cao, Guohua
    MEDICAL IMAGING 2019: PHYSICS OF MEDICAL IMAGING, 2019, 10948
  • [47] Skeleton-based motion capture for robust reconstruction of human motion
    Herda, L
    Fua, P
    Plänkers, R
    Boulic, R
    Thalmann, D
    COMPUTER ANIMATION 2000, PROCEEDINGS, 2000, : 77 - 83
  • [48] Deep-learning cardiac motion analysis for human survival prediction
    Ghalib A. Bello
    Timothy J. W. Dawes
    Jinming Duan
    Carlo Biffi
    Antonio de Marvao
    Luke S. G. E. Howard
    J. Simon R. Gibbs
    Martin R. Wilkins
    Stuart A. Cook
    Daniel Rueckert
    Declan P. O’Regan
    Nature Machine Intelligence, 2019, 1 : 95 - 104
  • [49] Transfer Learning of Deep Neural Network Human Pose Estimator by Domain-Specific Data for Video Motion Capturing
    Ooke, Natsu
    Ikegami, Yosuke
    Yamamoto, Ko
    Nakamura, Yoshihiko
    2022 IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND ITS SOCIAL IMPACTS (ARSO), 2022,
  • [50] Estimation on Human Motion Posture Using Improved Deep Reinforcement Learning
    Ma, Wenjing
    Zhao, Jianguang
    Zhu, Guangquan
    Journal of Computers (Taiwan), 2023, 34 (04) : 97 - 110