Flexible human motion transition via hybrid deep neural network and quadruple-like structure learning

被引:3
|
作者
Peng, Shu-Juan [1 ]
Zhang, Liang-Yu [2 ,3 ]
Liu, Xin [2 ,3 ]
机构
[1] Huaqiao Univ, Coll Comp Sci & Technol, Xiamen 361021, Peoples R China
[2] Huaqiao Univ, Xiamen Key Lab Comp Vis & Pattern Recognit, Xiamen 361021, Peoples R China
[3] Huaqiao Univ, Fujian Key Lab Big Data Intelligence & Secur, Xiamen 361021, Peoples R China
关键词
skeletal motion transition; hybrid deep learning; convolutional restricted Boltzmann machine; quadruples-like data structure; MODEL;
D O I
10.1504/IJCSE.2021.115100
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Skeletal motion transition is of crucial importance to the animation creation. In this paper, we propose a hybrid deep learning framework that allows for efficient human motion transition. First, we integrate a convolutional restricted Boltzmann machine with deep belief network to extract the spatio-temporal features of each motion style, featuring on appropriate detection of transition points. Then, a quadruples-like data structure is exploited for motion graph building, motion splitting and indexing. Accordingly, the similar frames fulfilling the transition segments can be efficiently retrieved. Meanwhile, the transition length is reasonably computed according to the average speed of the motion joints. As a result, different kinds of diverse motions can be well transited with satisfactory performance. The experimental results show that the proposed transition approach brings substantial improvements over the state-of-the-art methods.
引用
收藏
页码:136 / 146
页数:11
相关论文
共 50 条
  • [41] Embedding Human Knowledge into Deep Neural Network via Attention Map
    Mitsuhara, Masahiro
    Fukui, Hiroshi
    Sakashita, Yusuke
    Ogata, Takanori
    Hirakawa, Tsubasa
    Yamashita, Takayoshi
    Fujiyoshi, Hironobu
    VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 626 - 636
  • [42] Flexible job shop scheduling via deep reinforcement learning with meta-path-based heterogeneous graph neural network
    Wan, Lanjun
    Fu, Long
    Li, Changyun
    Li, Keqin
    KNOWLEDGE-BASED SYSTEMS, 2024, 296
  • [43] Transfer Learning of Deep Neural Network Human Pose Estimator by Domain-Specific Data for Video Motion Capturing
    Ooke, Natsu
    Ikegami, Yosuke
    Yamamoto, Ko
    Nakamura, Yoshihiko
    2022 IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND ITS SOCIAL IMPACTS (ARSO), 2022,
  • [44] Human Activity Recognition via Hybrid Deep Learning Based Model
    Khan, Imran Ullah
    Afzal, Sitara
    Lee, Jong Weon
    SENSORS, 2022, 22 (01)
  • [45] Learning a Deep Cascaded Neural Network for Multiple Motion Commands Prediction in Autonomous Driving
    Hu, Xuemin
    Tang, Bo
    Chen, Long
    Song, Sheng
    Tong, Xiuchi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (12) : 7585 - 7596
  • [46] Adaptive Deep Learning with Optimization Hybrid Convolutional Neural Network and Recurrent Neural Network for Prediction Lemon Fruit Ripeness
    Watnakornbuncha, Darunee
    Am-Dee, Noppadol
    Sangsongfa, Adisak
    PRZEGLAD ELEKTROTECHNICZNY, 2024, 100 (03): : 202 - 211
  • [47] Deep learning of subsurface flow via theory-guided neural network
    Wang, Nanzhe
    Zhang, Dongxiao
    Chang, Haibin
    Li, Heng
    JOURNAL OF HYDROLOGY, 2020, 584
  • [48] LEARNING SUMMARY STATISTIC FOR APPROXIMATE BAYESIAN COMPUTATION VIA DEEP NEURAL NETWORK
    Jiang, Bai
    Wu, Tung-Yu
    Zheng, Charles
    Wong, Wing H.
    STATISTICA SINICA, 2017, 27 (04) : 1595 - 1618
  • [49] Deep Neural Network Hardware Deployment Optimization via Advanced Active Learning
    Sun, Qi
    Bai, Chen
    Geng, Hao
    Yu, Bei
    PROCEEDINGS OF THE 2021 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2021), 2021, : 1510 - 1515
  • [50] Servo Health Monitoring Based on Feature Learning via Deep Neural Network
    Zhou, Yajing
    Zheng, Yuemin
    Tao, Jin
    Sun, Mingwei
    Sun, Qinglin
    Dehmer, Matthias
    Chen, Zengqiang
    IEEE ACCESS, 2021, 9 : 160887 - 160896