Learning a deep motion interpolation network for human skeleton animations

被引:1
|
作者
Zhou, Chi [1 ,2 ]
Lai, Zhangjiong [2 ]
Wang, Suzhen [2 ]
Li, Lincheng [1 ,2 ]
Sun, Xiaohan [1 ]
Ding, Yu [1 ,2 ]
机构
[1] Zhejiang Univ, Hangzhou, Zhejiang, Peoples R China
[2] Netease Fuxi AI Lab, Virtual Human Grp, Hangzhou, Zhejiang, Peoples R China
关键词
image inpainting; motion control; motion interpolation; animation; deep learning;
D O I
10.1002/cav.2003
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Motion interpolation technology produces transition motion frames between two discrete movements. It is wildly used in video games, virtual reality and augmented reality. In the fields of computer graphics and animations, our data-driven method generates transition motions of two arbitrary animations without additional control signals. In this work, we propose a novel carefully designed deep learning framework, named deep motion interpolation network (DMIN), to learn human movement habits from a real dataset and then to perform the interpolation function specific for human motions. It is a data-driven approach to capture overall rhythm of two given discrete movements and generate natural in-between motion frames. The sequence-by-sequence architecture allows completing all missing frames within single forward inference, which reduces computation time for interpolation. Experiments on human motion datasets show that our network achieves promising interpolation performance. The ablation study demonstrates the effectiveness of the carefully designed DMIN.(1)
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Learning to dress: Synthesizing human dressing motion via deep reinforcement learning
    Clegg A.
    Yu W.
    Tan J.
    Liu C.K.
    Turk G.
    2018, Association for Computing Machinery, 2 Penn Plaza, Suite 701, New York, NY 10121-0701, United States (37):
  • [32] Flexible human motion transition via hybrid deep neural network and quadruple-like structure learning
    Peng, Shu-Juan
    Zhang, Liang-Yu
    Liu, Xin
    INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2021, 24 (02) : 136 - 146
  • [33] Human Interaction Recognition through Deep Learning Network
    Berlin, S. Jeba
    John, Mala
    2016 IEEE INTERNATIONAL CARNAHAN CONFERENCE ON SECURITY TECHNOLOGY (ICCST), 2016, : 143 - 146
  • [34] Human skeleton reconstruction for optical motion capture
    Gao, C. (gcm211@163.com), 1600, Binary Information Press, P.O. Box 162, Bethel, CT 06801-0162, United States (09):
  • [35] Deep Learning for Human Activity Recognition on 3D Human Skeleton: Survey and Comparative Study
    Nguyen, Hung-Cuong
    Nguyen, Thi-Hao
    Scherer, Rafal
    Le, Van-Hung
    SENSORS, 2023, 23 (11)
  • [36] An Intelligent System for Detecting Abnormal Behavior in Students Based on the Human Skeleton and Deep Learning
    Ding, Yourong
    Bao, Ke
    Zhang, Jianzhong
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [37] Skeleton Based Human Action Recognition for Smart City Application Using Deep Learning
    Rashmi, M.
    Guddeti, Ram Mohana Reddy
    2020 INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS & NETWORKS (COMSNETS), 2020,
  • [38] Key frame and skeleton extraction for deep learning-based human action recognition
    Hai-Hong Phan
    Trung Tin Nguyen
    Ngo Huu Phuc
    Nguyen Huu Nhan
    Do Minh Hieu
    Cao Truong Tran
    Bao Ngoc Vi
    2021 RIVF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION TECHNOLOGIES (RIVF 2021), 2021, : 180 - 185
  • [39] Prediction of Human Activities Based on a New Structure of Skeleton Features and Deep Learning Model
    Jaouedi, Neziha
    Perales, Francisco J.
    Buades, Jose Maria
    Boujnah, Noureddine
    Bouhlel, Med Salim
    SENSORS, 2020, 20 (17) : 1 - 15
  • [40] An Intelligent System for Detecting Abnormal Behavior in Students Based on the Human Skeleton and Deep Learning
    Ding, Yourong
    Bao, Ke
    Zhang, Jianzhong
    Computational Intelligence and Neuroscience, 2022, 2022