Learning a deep motion interpolation network for human skeleton animations

被引:3
|
作者
Chen, Qiaorui [1 ,2 ]
Zhang, Shuai [1 ,2 ]
Zheng, Yao [1 ,2 ]
机构
[1] Zhejiang Univ, Ctr Engn & Sci Computat, Hangzhou 310027, Zhejiang, Peoples R China
[2] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou 310027, Zhejiang, Peoples R China
关键词
image inpainting; motion control; motion interpolation; animation; deep learning;
D O I
10.1002/cav.2019
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Motion interpolation technology produces transition motion frames between two discrete movements. It is wildly used in video games, virtual reality and augmented reality. In the fields of computer graphics and animations, our data-driven method generates transition motions of two arbitrary animations without additional control signals. In this work, we propose a novel carefully designed deep learning framework, named deep motion interpolation network (DMIN), to learn human movement habits from a real dataset and then to perform the interpolation function specific for human motions. It is a data-driven approach to capture overall rhythm of two given discrete movements and generate natural in-between motion frames. The sequence-by-sequence architecture allows completing all missing frames within single forward inference, which reduces computation time for interpolation. Experiments on human motion datasets show that our network achieves promising interpolation performance. The ablation study demonstrates the effectiveness of the carefully designed DMIN.(1)
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Skeleton Motion History based Human Action Recognition Using Deep Learning
    Phyo, Cho Nilar
    Zin, Thi Thi
    Tin, Pyke
    [J]. 2017 IEEE 6TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE), 2017,
  • [2] Egocentric 3D Skeleton Learning in a Deep Neural Network Encodes Obese-like Motion Representations
    Kwon, Jea
    Sa, Moonsun
    Kim, Hyewon
    Seong, Yejin
    Lee, C. Justin
    [J]. EXPERIMENTAL NEUROBIOLOGY, 2024, 33 (03) : 119 - 128
  • [3] A Survey on Deep Learning for Skeleton-Based Human Animation
    Mourot, Lucas
    Hoyet, Ludovic
    Le Clerc, Francois
    Schnitzler, Francois
    Hellier, Pierre
    [J]. COMPUTER GRAPHICS FORUM, 2022, 41 (01) : 122 - 157
  • [4] Recognition of human motion with deep reinforcement learning
    Seok W.
    Park C.
    [J]. IEIE Transactions on Smart Processing and Computing, 2018, 7 (03): : 245 - 250
  • [5] Human Motion Analysis with Deep Metric Learning
    Coskun, Huseyin
    Tan, David Joseph
    Conjeti, Sailesh
    Navab, Nassir
    Tombari, Federico
    [J]. COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 : 693 - 710
  • [6] Human motion modeling with deep learning: A survey
    Ye, Zijie
    Wu, Haozhe
    Jia, Jia
    [J]. AI OPEN, 2022, 3 : 35 - 39
  • [7] Anatomy Learning System on Human Skeleton Using Leap Motion Controller
    Nainggolan, Farhan L.
    Siregar, Baihaqi
    Fahmi, Fahmi
    [J]. 2016 3RD INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCES (ICCOINS), 2016, : 465 - 470
  • [8] Skeleton-based Motion Recognition Model by using Graph Convolutional Network and Deep Neural Network
    Chen, Ke
    Li, Min
    Yao, Guohui
    [J]. ACM International Conference Proceeding Series, 2023, : 409 - 413
  • [9] Laser Curve Extraction of Wheelset Based on Deep Learning Skeleton Extraction Network
    Luo, Shuai
    Yang, Kai
    Yang, Lijuan
    Wang, Yong
    Gao, Xiaorong
    Jiang, Tianci
    Li, Chunjiang
    [J]. SENSORS, 2022, 22 (03)
  • [10] Interactive video animations as a study guide for the human skeleton: 1. The scapula
    Casey, Gregory Patrick
    Oliver, Peter David
    Cork, Robert John
    [J]. FASEB JOURNAL, 2013, 27