Dynamic Inertial Poser (DynaIP): Part-Based Motion Dynamics Learning for Enhanced Human Pose Estimation with Sparse Inertial Sensors

被引:1
|
作者
Zhang, Yu
Xia, Songpengcheng
Chu, Lei
Yang, Jiarui
Wu, Qi
Ling Pei
机构
关键词
D O I
10.1109/CVPR52733.2024.00185
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces a novel human pose estimation approach using sparse inertial sensors, addressing the short-comings of previous methods reliant on synthetic data. It leverages a diverse array of real inertial motion capture data from different skeleton formats to improve motion diversity and model generalization. This method features two innovative components: a pseudo-velocity regression model for dynamic motion capture with inertial sensors, and a part-based model dividing the body and sensor data into three regions, each focusing on their unique characteristics. The approach demonstrates superior performance over state-of- the-art models across five public datasets, notably reducing pose error by 19% on the DIP-IMU dataset, thus representing a significant improvement in inertial sensor-based human pose estimation. Our codes are available at https://github.com/dx118/dynaip
引用
收藏
页码:1889 / 1899
页数:11
相关论文
共 50 条
  • [21] Fusion of Multiple Lidars and Inertial Sensors for the Real-Time Pose Tracking of Human Motion
    Patil, Ashok Kumar
    Balasubramanyam, Adithya
    Ryu, Jae Yeong
    Kumar, Pavan B. N.
    Chakravarthi, Bharatesh
    Chai, Young Ho
    SENSORS, 2020, 20 (18) : 1 - 16
  • [22] Ambient Motion Estimation in Dynamic Scenes Using Wearable Visual-Inertial Sensors
    He, Hongsheng
    Tan, Jindong
    2014 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2014, : 1002 - 1007
  • [23] Human motion classification based on inertial sensors with Extreme Gradient Boosting
    Peng, Zhiqiang
    Zhang, Yue
    2018 INTERNATIONAL CONFERENCE ON IMAGE AND VIDEO PROCESSING, AND ARTIFICIAL INTELLIGENCE, 2018, 10836
  • [24] HUMAN MOTION LOCALIZATION AND INTERACTION BASED ON WEARABLE INERTIAL AND CONTACT SENSORS
    Yuan, Qilong
    Chen, I-Ming
    NATURE INSPIRED MOBILE ROBOTICS, 2013, : 807 - 814
  • [25] Visual-Inertial Fusion-Based Human Pose Estimation: A Review
    Li, Tong
    Yu, Haoyong
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [26] Data fusion estimation of inertial sensors based on multiscale Stochastic dynamic models
    Zhou, Xuemei
    Wu, Jiantong
    2007 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, VOLS I-V, CONFERENCE PROCEEDINGS, 2007, : 647 - 651
  • [27] A Bayesian Part-based Approach to 3D Human Pose and Camera Estimation
    Brau, Ernesto
    Jiang, Hao
    2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 1762 - 1767
  • [28] Towards HMM based Human Motion Recognition using MEMS Inertial Sensors
    Shi, Guangyi
    Zou, Yuexian
    Jin, Yufeng
    Cui, Xiaole
    Li, Wen J.
    2008 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS, VOLS 1-4, 2009, : 1762 - +
  • [29] Uniting holistic and part-based attitudes for accurate and robust deep human pose estimation
    Faranak Shamsafar
    Hossein Ebrahimnezhad
    Journal of Ambient Intelligence and Humanized Computing, 2021, 12 : 2339 - 2353
  • [30] Uniting holistic and part-based attitudes for accurate and robust deep human pose estimation
    Shamsafar, Faranak
    Ebrahimnezhad, Hossein
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 12 (02) : 2339 - 2353