Gaussian process dynamical models for human motion

被引:595
|
作者
Wang, Jack M. [1 ]
Fleet, David J. [1 ]
Hertzmann, Aaron [1 ]
机构
[1] Univ Toronto, Dept Comp Sci, Toronto, ON M5S 2E4, Canada
基金
加拿大创新基金会; 加拿大自然科学与工程研究理事会; 美国国家科学基金会;
关键词
machine learning; motion; tracking; animation; stochastic processes; time series analysis;
D O I
10.1109/TPAMI.2007.1167
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce Gaussian process dynamical models (GPDMs) for nonlinear time series analysis, with applications to learning models of human pose and motion from high-dimensional motion capture data. A GPDM is a latent variable model. It comprises a low-dimensional latent space with associated dynamics, as well as a map from the latent space to an observation space. We marginalize out the model parameters in closed form by using Gaussian process priors for both the dynamical and the observation mappings. This results in a nonparametric model for dynamical systems that accounts for uncertainty in the model. We demonstrate the approach and compare four learning algorithms on human motion capture data, in which each pose is 50-dimensional. Despite the use of small data sets, the GPDM learns an effective representation of the nonlinear dynamics in these spaces.
引用
收藏
页码:283 / 298
页数:16
相关论文
共 50 条
  • [1] MOTION PREDICTION WITH GAUSSIAN PROCESS DYNAMICAL MODELS
    Qu, Shi
    Wu, Lingda
    Wei, Yingmei
    Yu, Ronghuan
    [J]. 3RD INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND COMPUTER SCIENCE (ITCS 2011), PROCEEDINGS, 2011, : 162 - 165
  • [2] Motion optimization using Gaussian process dynamical models
    Kang, Hyuk
    Park, F. C.
    [J]. MULTIBODY SYSTEM DYNAMICS, 2015, 34 (04) : 307 - 325
  • [3] Motion optimization using Gaussian process dynamical models
    Hyuk Kang
    F. C. Park
    [J]. Multibody System Dynamics, 2015, 34 : 307 - 325
  • [4] Gaussian process dynamical models for human motion (vol 30, pg 283, 2008)
    Wang, Jack M.
    Fleet, David J.
    Hertzmann, Aaron
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008, 30 (06) : 1118 - 1118
  • [5] Human Motion Tracking with Monocular Video by Introducing a Graph Structure into Gaussian Process Dynamical Models
    Xu, Jianfeng
    Takagi, Koichi
    Sakazawa, Shigeyuki
    [J]. ADVANCES IN IMAGE AND VIDEO TECHNOLOGY, PT I, 2011, 7087 : 370 - 383
  • [6] Revisiting Gaussian Process Dynamical Models
    Zhao, Jing
    Sun, Shiliang
    [J]. PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), 2015, : 1047 - 1053
  • [7] Prediction With Approximated Gaussian Process Dynamical Models
    Beckers, Thomas
    Hirche, Sandra
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (12) : 6460 - 6473
  • [8] Gaussian Process Dynamical Models for Emotion Recognition
    Garcia, Hernan F.
    Alvarez, Mauricio A.
    Orozco, Alvaro
    [J]. ADVANCES IN VISUAL COMPUTING (ISVC 2014), PT II, 2014, 8888 : 799 - 808
  • [9] Gaussian Process Dynamical Models over Dual Quaternions
    Lang, Muriel
    Kleinsteuber, Martin
    Dunkley, Oliver
    Hirche, Sandra
    [J]. 2015 EUROPEAN CONTROL CONFERENCE (ECC), 2015, : 2847 - 2852
  • [10] Gaussian Process Dynamical Models for Multimodal Affect Recognition
    Garcia, Hernan F.
    Alvarez, Mauricio A.
    Orozco, Alvaro A.
    [J]. 2016 38TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2016, : 850 - 853