Flexible human motion transition via hybrid deep neural network and quadruple-like structure learning

被引:3
|
作者
Peng, Shu-Juan [1 ]
Zhang, Liang-Yu [2 ,3 ]
Liu, Xin [2 ,3 ]
机构
[1] Huaqiao Univ, Coll Comp Sci & Technol, Xiamen 361021, Peoples R China
[2] Huaqiao Univ, Xiamen Key Lab Comp Vis & Pattern Recognit, Xiamen 361021, Peoples R China
[3] Huaqiao Univ, Fujian Key Lab Big Data Intelligence & Secur, Xiamen 361021, Peoples R China
关键词
skeletal motion transition; hybrid deep learning; convolutional restricted Boltzmann machine; quadruples-like data structure; MODEL;
D O I
10.1504/IJCSE.2021.115100
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Skeletal motion transition is of crucial importance to the animation creation. In this paper, we propose a hybrid deep learning framework that allows for efficient human motion transition. First, we integrate a convolutional restricted Boltzmann machine with deep belief network to extract the spatio-temporal features of each motion style, featuring on appropriate detection of transition points. Then, a quadruples-like data structure is exploited for motion graph building, motion splitting and indexing. Accordingly, the similar frames fulfilling the transition segments can be efficiently retrieved. Meanwhile, the transition length is reasonably computed according to the average speed of the motion joints. As a result, different kinds of diverse motions can be well transited with satisfactory performance. The experimental results show that the proposed transition approach brings substantial improvements over the state-of-the-art methods.
引用
收藏
页码:136 / 146
页数:11
相关论文
共 50 条
  • [1] Efficient Human Motion Transition via Hybrid Deep Neural Network and Reliable Motion Graph Mining
    Zhou, Bing
    Liu, Xin
    Peng, Shujuan
    Zhong, Bineng
    Du, Jixiang
    COMPUTER VISION, PT I, 2017, 771 : 717 - 728
  • [2] A Hybrid Deep Neural Network for Online Learning
    Chavan, Trupti R.
    Nandedkar, Abhijeet V.
    2017 NINTH INTERNATIONAL CONFERENCE ON ADVANCES IN PATTERN RECOGNITION (ICAPR), 2017, : 368 - 373
  • [3] Flexible Job-Shop Scheduling via Graph Neural Network and Deep Reinforcement Learning
    Song, Wen
    Chen, Xinyang
    Li, Qiqiang
    Cao, Zhiguang
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (02) : 1600 - 1610
  • [4] The Structure of Deep Neural Network for Interpretable Transfer Learning
    Kim, Dowan
    Lim, Woohyun
    Hong, Minye
    Kim, Hyeoncheol
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2019, : 181 - 184
  • [5] Automatic fish detection in underwater videos by a deep neural network-based hybrid motion learning system
    Salman, Ahmad
    Siddiqui, Shoaib Ahmad
    Shafait, Faisal
    Mian, Ajmal
    Shortis, Mark R.
    Khurshid, Khawar
    Ulges, Adrian
    Schwanecke, Ulrich
    ICES JOURNAL OF MARINE SCIENCE, 2020, 77 (04) : 1295 - 1307
  • [6] Learning a deep convolutional neural network via tensor decomposition
    Oymak, Samet
    Soltanolkotabi, Mahdi
    INFORMATION AND INFERENCE-A JOURNAL OF THE IMA, 2021, 10 (03) : 1031 - 1071
  • [7] Probabilistic Human Motion Prediction via A Bayesian Neural Network
    Xu, Jie
    Chen, Xingyu
    Lan, Xuguang
    Zheng, Nanning
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 3190 - 3196
  • [8] Hybrid deep neural network model for human action recognition
    Ijjina, Earnest Paul
    Mohan, Chalavadi Krishna
    APPLIED SOFT COMPUTING, 2016, 46 : 936 - 952
  • [9] Learning a deep motion interpolation network for human skeleton animations
    Zhou, Chi
    Lai, Zhangjiong
    Wang, Suzhen
    Li, Lincheng
    Sun, Xiaohan
    Ding, Yu
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2021, 32 (3-4)
  • [10] Chromatin accessibility prediction via a hybrid deep convolutional neural network
    Liu, Qiao
    Xia, Fei
    Yin, Qijin
    Jiang, Rui
    BIOINFORMATICS, 2018, 34 (05) : 732 - 738