Dynamic Inertial Poser (DynaIP): Part-Based Motion Dynamics Learning for Enhanced Human Pose Estimation with Sparse Inertial Sensors

被引:1
|
作者
Zhang, Yu
Xia, Songpengcheng
Chu, Lei
Yang, Jiarui
Wu, Qi
Ling Pei
机构
关键词
D O I
10.1109/CVPR52733.2024.00185
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces a novel human pose estimation approach using sparse inertial sensors, addressing the short-comings of previous methods reliant on synthetic data. It leverages a diverse array of real inertial motion capture data from different skeleton formats to improve motion diversity and model generalization. This method features two innovative components: a pseudo-velocity regression model for dynamic motion capture with inertial sensors, and a part-based model dividing the body and sensor data into three regions, each focusing on their unique characteristics. The approach demonstrates superior performance over state-of- the-art models across five public datasets, notably reducing pose error by 19% on the DIP-IMU dataset, thus representing a significant improvement in inertial sensor-based human pose estimation. Our codes are available at https://github.com/dx118/dynaip
引用
收藏
页码:1889 / 1899
页数:11
相关论文
共 50 条
  • [41] Event-Domain Knowledge in Inertial Sensor Based State Estimation of Human Motion
    Koller, Tom L.
    Laue, Tim
    Frese, Udo
    2022 25TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION 2022), 2022,
  • [42] A complementary observer-based approach for the estimation of motion in rigid bodies using inertial and magnetic sensors
    Fourati, H.
    Manamanni, N.
    Afilal, L.
    Van Hove, P.
    Handrich, Y.
    2010 IEEE INTERNATIONAL CONFERENCE ON CONTROL APPLICATIONS, 2010, : 422 - 427
  • [43] A Novel Kalman Filter for Human Motion Tracking With an Inertial-Based Dynamic Inclinometer
    Ligorio, Gabriele
    Sabatini, Angelo M.
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2015, 62 (08) : 2033 - 2043
  • [44] Preliminary studies of measuring skateboarding forces by combining inertial sensors and camera-based pose estimation. Poster
    Zoellner, Michael
    Krause, Moritz
    PROCEEDINGS OF THE 8TH INTERNATIONAL WORKSHOP ON SENSOR-BASED ACTIVITY RECOGNITION AND ARTIFICIAL INTELLIGENCE, IWOAR 2023, 2023,
  • [45] Human Motion Estimation Based on EMG-Inertial Fusion: A Gaussian Filtering Network Approach
    Yang X.-S.
    Li F.-X.
    Hu F.
    Zhang W.-A.
    Zidonghua Xuebao/Acta Automatica Sinica, 2024, 50 (05): : 991 - 1000
  • [46] A Novel Framework Based on Deep Learning Architecture for Continuous Human Activity Recognition with Inertial Sensors
    Suglia, Vladimiro
    Palazzo, Lucia
    Bevilacqua, Vitoantonio
    Passantino, Andrea
    Pagano, Gaetano
    D'Addio, Giovanni
    SENSORS, 2024, 24 (07)
  • [47] Joint Wheel-Slip and Vehicle-Motion Estimation Based on Inertial, GPS, and Wheel-Speed Sensors
    Berntorp, Karl
    IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2016, 24 (03) : 1020 - 1027
  • [48] Extended Kalman Filter-Based Methods for Pose Estimation Using Visual, Inertial and Magnetic Sensors: Comparative Analysis and Performance Evaluation
    Ligorio, Gabriele
    Sabatini, Angelo Maria
    SENSORS, 2013, 13 (02): : 1919 - 1941
  • [49] An efficient deep learning-based approach for human activity recognition using smartphone inertial sensors
    Djemili R.
    Zamouche M.
    International Journal of Computers and Applications, 2023, 45 (04) : 323 - 336
  • [50] HUMAN ACTION RECOGNITION BASED ON 3D SKELETON PART-BASED POSE ESTIMATION AND TEMPORAL MULTI-RESOLUTION ANALYSIS
    Halim, A. Aly
    Dartigues-Pallez, C.
    Precioso, F.
    Riveill, M.
    Benslimane, A.
    Ghoneim, S.
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 3041 - 3045