Dynamic Inertial Poser (DynaIP): Part-Based Motion Dynamics Learning for Enhanced Human Pose Estimation with Sparse Inertial Sensors

被引:1
|
作者
Zhang, Yu
Xia, Songpengcheng
Chu, Lei
Yang, Jiarui
Wu, Qi
Ling Pei
机构
关键词
D O I
10.1109/CVPR52733.2024.00185
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces a novel human pose estimation approach using sparse inertial sensors, addressing the short-comings of previous methods reliant on synthetic data. It leverages a diverse array of real inertial motion capture data from different skeleton formats to improve motion diversity and model generalization. This method features two innovative components: a pseudo-velocity regression model for dynamic motion capture with inertial sensors, and a part-based model dividing the body and sensor data into three regions, each focusing on their unique characteristics. The approach demonstrates superior performance over state-of- the-art models across five public datasets, notably reducing pose error by 19% on the DIP-IMU dataset, thus representing a significant improvement in inertial sensor-based human pose estimation. Our codes are available at https://github.com/dx118/dynaip
引用
收藏
页码:1889 / 1899
页数:11
相关论文
共 50 条
  • [1] Vector-based Inertial Poser: Human pose estimation with high gain observer and deep learning using sparse IMU sensors
    Nouriani, A.
    McGovern, R. A.
    Rajamani, R.
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 95
  • [2] Deep Inertial Poser: Learning to Reconstruct Human Pose from Sparse Inertial Measurements in Real Time
    Huang, Yinghao
    Kaufmann, Manuel
    Aksan, Emre
    Black, Michael J.
    Hilliges, Otmar
    Pons-Moll, Gerard
    ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (06):
  • [3] Deep Inertial Poser: Learning to Reconstruct Human Pose from Sparse Inertial Measurements in Real Time
    Huang, Yinghao
    Kaufmann, Manuel
    Aksan, Emre
    Black, Michael J.
    Hilliges, Otmar
    Pons-Moll, Gerard
    SIGGRAPH ASIA'18: SIGGRAPH ASIA 2018 TECHNICAL PAPERS, 2018,
  • [4] Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUs
    von Marcard, T.
    Rosenhahn, B.
    Black, M. J.
    Pons-Moll, G.
    COMPUTER GRAPHICS FORUM, 2017, 36 (02) : 349 - 360
  • [5] LiDAR-aid Inertial Poser: Large-scale Human Motion Capture by Sparse Inertial and LiDAR Sensors
    Ren, Yiming
    Zhao, Chengfeng
    He, Yannan
    Cong, Peishan
    Liang, Han
    Yu, Jingyi
    Xu, Lan
    Ma, Yuexin
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (05) : 2337 - 2347
  • [6] Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensors
    Yi, Xinyu
    Zhou, Yuxiao
    Habermann, Marc
    Shimada, Soshi
    Golyanik, Vladislav
    Theobalt, Christian
    Xu, Feng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 13157 - 13168
  • [7] Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Ranging
    Armani, Rayan
    Qian, Changlin
    Jiang, Jiaxi
    Holz, Christian
    PROCEEDINGS OF SIGGRAPH 2024 CONFERENCE PAPERS, 2024,
  • [8] Physical Non-inertial Poser (PNP): Modeling Non-inertial Effects in Sparse-inertial Human Motion Capture
    Yi, Xinyu
    Zhou, Yuxiao
    Xu, Feng
    PROCEEDINGS OF SIGGRAPH 2024 CONFERENCE PAPERS, 2024,
  • [9] Pose estimation using line-based dynamic vision and inertial sensors
    Rehbinder, H
    Ghosh, BK
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2003, 48 (02) : 186 - 199
  • [10] A novel method for hand pose estimation based on inertial and magnetic sensors
    Fang, Bin
    Sun, Fuchun
    PROCESSING OF 2014 INTERNATIONAL CONFERENCE ON MULTISENSOR FUSION AND INFORMATION INTEGRATION FOR INTELLIGENT SYSTEMS (MFI), 2014,