Flexible human motion transition via hybrid deep neural network and quadruple-like structure learning

被引:3
|
作者
Peng, Shu-Juan [1 ]
Zhang, Liang-Yu [2 ,3 ]
Liu, Xin [2 ,3 ]
机构
[1] Huaqiao Univ, Coll Comp Sci & Technol, Xiamen 361021, Peoples R China
[2] Huaqiao Univ, Xiamen Key Lab Comp Vis & Pattern Recognit, Xiamen 361021, Peoples R China
[3] Huaqiao Univ, Fujian Key Lab Big Data Intelligence & Secur, Xiamen 361021, Peoples R China
关键词
skeletal motion transition; hybrid deep learning; convolutional restricted Boltzmann machine; quadruples-like data structure; MODEL;
D O I
10.1504/IJCSE.2021.115100
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Skeletal motion transition is of crucial importance to the animation creation. In this paper, we propose a hybrid deep learning framework that allows for efficient human motion transition. First, we integrate a convolutional restricted Boltzmann machine with deep belief network to extract the spatio-temporal features of each motion style, featuring on appropriate detection of transition points. Then, a quadruples-like data structure is exploited for motion graph building, motion splitting and indexing. Accordingly, the similar frames fulfilling the transition segments can be efficiently retrieved. Meanwhile, the transition length is reasonably computed according to the average speed of the motion joints. As a result, different kinds of diverse motions can be well transited with satisfactory performance. The experimental results show that the proposed transition approach brings substantial improvements over the state-of-the-art methods.
引用
收藏
页码:136 / 146
页数:11
相关论文
共 50 条
  • [21] Dynamic scheduling for flexible job shop with insufficient transportation resources via graph neural network and deep reinforcement learning
    Zhang, Min
    Wang, Liang
    Qiu, Fusheng
    Liu, Xiaorui
    COMPUTERS & INDUSTRIAL ENGINEERING, 2023, 186
  • [22] Hybrid Deep Learning Based Moving Object Detection via Motion prediction
    Lu, Yi
    Chen, Yaran
    Zhao, Dongbin
    Li, Haoran
    2018 CHINESE AUTOMATION CONGRESS (CAC), 2018, : 1442 - 1447
  • [23] ANRL: Attributed Network Representation Learning via Deep Neural Networks
    Zhang, Zhen
    Yang, Hongxia
    Bu, Jiajun
    Zhou, Sheng
    Yu, Pinggang
    Zhang, Jianwei
    Ester, Martin
    Wang, Can
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 3155 - 3161
  • [24] A hybrid deep segmentation network for fundus vessels via deep-learning framework
    Yang, Lei
    Wang, Huaixin
    Zeng, Qingshan
    Liu, Yanhong
    Bian, Guibin
    NEUROCOMPUTING, 2021, 448 : 168 - 178
  • [25] Real time human motion recognition via spiking neural network
    Yang Jing
    Wu Qingyuan
    Huang Maiqi
    Luo Ting
    2018 3RD ASIA CONFERENCE ON POWER AND ELECTRICAL ENGINEERING (ACPEE 2018), 2018, 366
  • [26] Human and object detection using Hybrid Deep Convolutional Neural Network
    Mukilan, P.
    Semunigus, Wogderess
    SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (07) : 1913 - 1923
  • [27] Human and object detection using Hybrid Deep Convolutional Neural Network
    P. Mukilan
    Wogderess Semunigus
    Signal, Image and Video Processing, 2022, 16 : 1913 - 1923
  • [28] A hybrid deep learning model by combining convolutional neural network and recurrent neural network to detect forest fire
    Ghosh, Rajib
    Kumar, Anupam
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (27) : 38643 - 38660
  • [29] A hybrid deep learning model by combining convolutional neural network and recurrent neural network to detect forest fire
    Rajib Ghosh
    Anupam Kumar
    Multimedia Tools and Applications, 2022, 81 : 38643 - 38660
  • [30] A deep hybrid neural network for single image dehazing via wavelet transform
    Dharejo, Fayaz Ali
    Zhou, Yuanchun
    Deeba, Farah
    Jatoi, Munsif Ali
    Khan, Muhammad Ashfaq
    Mallah, Ghulam Ali
    Ghaffar, Abdul
    Chhattal, Muhammad
    Du, Yi
    Wang, Xuezhi
    OPTIK, 2021, 231