Real-time 3D Pose Estimation from Single Depth Images

被引:6
|
作者
Schnuerer, Thomas [1 ,2 ]
Fuchs, Stefan [2 ]
Eisenbach, Markus [1 ]
Gross, Horst-Michael [1 ]
机构
[1] Ilmenau Univ Technol, Neuroinformat & Cognit Robot Lab, D-98684 Ilmenau, Germany
[2] Honda Res Inst Europe GmbH, D-63073 Offenbach, Germany
关键词
Real-time 3D Joint Estimation; Human-Robot-Interaction; Deep Learning;
D O I
10.5220/0007394707160724
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
To allow for safe Human-Robot-Interaction in industrial scenarios like manufacturing plants, it is essential to always be aware of the location and pose of humans in the shared workspace. We introduce a real-time 3D pose estimation system using single depth images that is aimed to run on limited hardware, such as a mobile robot. For this, we optimized a CNN-based 2D pose estimation architecture to achieve high frame rates while simultaneously requiring fewer resources. Building upon this architecture, we extended the system for 3D estimation to directly predict Cartesian body joint coordinates. We evaluated our system on a newly created dataset by applying it to a specific industrial workbench scenario. The results show that our system's performance is competitive to the state of the art at more than five times the speed for single person pose estimation.
引用
收藏
页码:716 / 724
页数:9
相关论文
共 50 条
  • [21] Automatic Real-Time Pose Estimation of Machinery from Images
    Bertels, Marcel
    Jutzi, Boris
    Ulrich, Markus
    [J]. SENSORS, 2022, 22 (07)
  • [22] Downsizing Heatmap Resolution for real-time 3D Human Pose Estimation
    Kong, Dae-hyeon
    Kang, Suk-ju
    [J]. 2021 36TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC), 2021,
  • [23] REAL-TIME 3D RECONSTRUCTION AND POSE ESTIMATION FOR HUMAN MOTION ANALYSIS
    Graf, Holger
    Yoon, Sang Min
    Malerczyk, Cornelius
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 3981 - 3984
  • [24] Real-time modeling of face deformation for 3D head pose estimation
    Oka, K
    Sato, Y
    [J]. ANALYSIS AND MODELLING OF FACES AND GESTURES, PROCEEDINGS, 2005, 3723 : 308 - 320
  • [25] EventHands: Real-Time Neural 3D Hand Pose Estimation from an Event Stream
    Rudnev, Viktor
    Golyanik, Vladislav
    Wang, Jiayi
    Seidel, Hans-Peter
    Mueller, Franziska
    Elgharib, Mohamed
    Theobalt, Christian
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 12365 - 12375
  • [26] 3D Convolutional Neural Networks for Efficient and Robust Hand Pose Estimation from Single Depth Images
    Ge, Liuhao
    Liang, Hui
    Yuan, Junsong
    Thalmann, Daniel
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5679 - 5688
  • [27] Real-time estimation of 3D scene geometry from a single image
    Jung, Chanho
    Kim, Changick
    [J]. PATTERN RECOGNITION, 2012, 45 (09) : 3256 - 3269
  • [28] Real-Time 3D Face Recognition with the Integration of Depth and Intensity Images
    Xiong, Pengfei
    Huang, Lei
    Liu, Changping
    [J]. IMAGE ANALYSIS AND RECOGNITION: 8TH INTERNATIONAL CONFERENCE, ICIAR 2011, PT II: 8TH INTERNATIONAL CONFERENCE, ICIAR 2011, 2011, 6754 : 222 - 232
  • [29] Accurate and Efficient 3D Human Pose Estimation Algorithm using Single Depth Images for Pose Analysis in Golf
    Park, Soonchan
    Chang, Ju Yong
    Jeong, Hyuk
    Lee, Jae-Ho
    Park, Ji-Young
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 105 - 113
  • [30] Real-time pose estimation of 3-D objects from camera images using neural networks
    Wunsch, P
    Winkler, S
    Hirzinger, G
    [J]. 1997 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION - PROCEEDINGS, VOLS 1-4, 1997, : 3232 - 3237