mmPose-FK: A Forward Kinematics Approach to Dynamic Skeletal Pose Estimation Using mmWave Radars

被引:0
|
作者
Hu, Shuting [1 ]
Cao, Siyang [1 ]
Toosizadeh, Nima [2 ]
Barton, Jennifer [3 ]
Hector, Melvin G. [4 ]
Fain, Mindy J. [4 ]
机构
[1] Univ Arizona, Dept Elect & Comp Engn, Tucson, AZ 85721 USA
[2] Rutgers State Univ, Dept Rehabil & Movement Sci, Newark, NJ 07107 USA
[3] Univ Arizona, Dept Biomed Engn, Tucson, AZ 85721 USA
[4] Univ Arizona, Dept Med, Tucson, AZ USA
基金
美国国家卫生研究院;
关键词
Forward kinematics (FKs); millimeter wave (mmWave) radars; pose estimation;
D O I
10.1109/JSEN.2023.3348199
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this article, we propose mmPose-FK, a novel millimeter wave (mmWave) radar-based pose estimation method that employs a dynamic forward kinematics (FKs) approach to address the challenges posed by low resolution, specularity, and noise artifacts commonly associated with mmWave radars. These issues often result in unstable joint poses that vibrate over time, reducing the effectiveness of traditional pose estimation techniques. To overcome these limitations, we integrate the FK mechanism into the deep learning model and develop an end-to-end solution driven by data. Our comprehensive experiments using various matrices and benchmarks highlight the superior performance of mmPose-FK, especially when compared to our previous research methods. The proposed method provides more accurate pose estimation and ensures increased stability and consistency, which underscores the continuous improvement of our methodology, showcasing superior capabilities over its antecedents. Moreover, the model can output joint rotations and human bone lengths, which could be further utilized for various applications such as gait parameter analysis and height estimation. This makes mmPose-FK a highly promising solution for a wide range of applications in the field of human pose estimation and beyond.
引用
收藏
页码:6469 / 6481
页数:13
相关论文
共 11 条
  • [1] mmPose-NLP: A Natural Language Processing Approach to Precise Skeletal Pose Estimation Using mmWave Radars
    Sengupta, Arindam
    Cao, Siyang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (11) : 8418 - 8429
  • [2] Vulnerable Road User Skeletal Pose Estimation Using mmWave Radars
    Zeng, Zhiyuan
    Liang, Xingdong
    Li, Yanlei
    Dang, Xiangwei
    REMOTE SENSING, 2024, 16 (04)
  • [3] SUPER: Seated Upper Body Pose Estimation using mmWave Radars
    Zhang, Bo
    Zhou, Zimeng
    Jiang, Boyu
    Zheng, Rong
    9TH ACM/IEEE CONFERENCE ON INTERNET OF THINGS DESIGN AND IMPLEMENTATION, IOTDI 2024, 2024, : 181 - 191
  • [4] mm-Pose: Real-Time Human Skeletal Posture Estimation Using mmWave Radars and CNNs
    Sengupta, Arindam
    Jin, Feng
    Zhang, Renyuan
    Cao, Siyang
    IEEE SENSORS JOURNAL, 2020, 20 (17) : 10032 - 10044
  • [5] Stabilizing Skeletal Pose Estimation using mmWave Radar via Dynamic Model and Filtering
    Hu, Shuting
    Sengupta, Arindam
    Cao, Siyang
    2022 IEEE-EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL AND HEALTH INFORMATICS (BHI) JOINTLY ORGANISED WITH THE IEEE-EMBS INTERNATIONAL CONFERENCE ON WEARABLE AND IMPLANTABLE BODY SENSOR NETWORKS (BSN'22), 2022,
  • [6] NLP based Skeletal Pose Estimation using mmWave Radar Point-Cloud: A Simulation Approach
    Sengupta, Arindam
    Jin, Feng
    Cao, Siyang
    2020 IEEE RADAR CONFERENCE (RADARCONF20), 2020,
  • [7] A Sliding Window-Based CNN-BiGRU Approach for Human Skeletal Pose Estimation Using mmWave Radar
    Luo, Yuquan
    He, Yuqiang
    Li, Yaxin
    Liu, Huaiqiang
    Wang, Jun
    Gao, Fei
    SENSORS, 2025, 25 (04)
  • [8] Pose Estimation of a Cable-Driven Parallel Robot Using Kalman Filtering and Forward Kinematics Error Covariance Bounds
    Puri, Neel
    Caverly, Ryan James
    PROCEEDINGS OF THE 2022 USCTOMM SYMPOSIUM ON MECHANICAL SYSTEMS AND ROBOTICS, 2022, 118 : 65 - 75
  • [9] 3D ego-Motion Estimation Using low-Cost mmWave Radars via Radar Velocity Factor for Pose-Graph SLAM
    Park, Yeong Sang
    Shin, Young-Sik
    Kim, Joowan
    Kim, Ayoung
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 7691 - 7698
  • [10] Poster: Dynamic Ego-Velocity Estimation Using Moving mmWave Radar: A Phase-Based Approach
    Sen, Argha
    Chakraborty, Soham
    Tripathy, Soham
    Chakraborty, Sandip
    PROCEEDINGS OF THE 2024 THE 22ND ANNUAL INTERNATIONAL CONFERENCE ON MOBILE SYSTEMS, APPLICATIONS AND SERVICES, MOBISYS 2024, 2024, : 692 - 693