Learning to Estimate 3D Human Pose From Point Cloud

被引:22
|
作者
Zhou, Yufan [1 ]
Dong, Haiwei [1 ]
Saddik, Abdulmotaleb El [1 ]
机构
[1] Univ Ottawa, Sch Elect Engn & Comp Sci, Multimedia Comp Res Lab, Ottawa, ON K1N 6N5, Canada
关键词
Three-dimensional displays; Pose estimation; Feature extraction; Cameras; Solid modeling; Deep learning; Sensors; Edge feature; pose regression network; depth image;
D O I
10.1109/JSEN.2020.2999849
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
3D pose estimation is a challenging problem in computer vision. Most of the existing neural-network-based approaches address color or depth images through convolution networks (CNNs). In this paper, we study the task of 3D human pose estimation from depth images. Different from the existing CNN-based human pose estimation method, we propose a deep human pose network for 3D pose estimation by taking the point cloud data as input data to model the surface of complex human structures. We first cast the 3D human pose estimation from 2D depth images to 3D point clouds and directly predict the 3D joint position. Our experiments on two public datasets show that our approach achieves higher accuracy than previous state-of-art methods. The reported results on both ITOP and EVAL datasets demonstrate the effectiveness of our method on the targeted tasks.
引用
收藏
页码:12334 / 12342
页数:9
相关论文
共 50 条
  • [1] Learning to Estimate 3D Human Pose and Shape from a Single Color Image
    Pavlakos, Georgios
    Zhu, Luyang
    Zhou, Xiaowei
    Daniilidis, Kostas
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 459 - 468
  • [2] Surface and underwater human pose recognition based on temporal 3D point cloud deep learning
    Wang, Haijian
    Wu, Zhenyu
    Zhao, Xuemei
    [J]. SCIENTIFIC REPORTS, 2024, 14 (01)
  • [3] Surface and underwater human pose recognition based on temporal 3D point cloud deep learning
    Haijian Wang
    Zhenyu Wu
    Xuemei Zhao
    [J]. Scientific Reports, 14
  • [4] Efficient Human Pose Estimation via 3D Event Point Cloud
    Chen, Jiaan
    Shi, Hao
    Ye, Yaozu
    Yang, Kailun
    Sun, Lei
    Wang, Kaiwei
    [J]. 2022 INTERNATIONAL CONFERENCE ON 3D VISION, 3DV, 2022, : 104 - 113
  • [5] Learning from 3D (Point Cloud) Data
    Hsu, Winston H.
    [J]. PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 2697 - 2698
  • [6] Learning to Estimate 3D Hand Pose from Single RGB Images
    Zimmermann, Christian
    Brox, Thomas
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 4913 - 4921
  • [7] 3D Static Point Cloud Registration by Estimating Temporal Human Pose at Multiview
    Park, Byung-Seo
    Kim, Woosuk
    Kim, Jin-Kyum
    Hwang, Eui Seok
    Kim, Dong-Wook
    Seo, Young-Ho
    [J]. SENSORS, 2022, 22 (03)
  • [8] Weakly Supervised Adversarial Learning for 3D Human Pose Estimation from Point Clouds
    Zhang, Zihao
    Hu, Lei
    Deng, Xiaoming
    Xia, Shihong
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (05) : 1851 - 1859
  • [9] Learning 3D Human Pose from Structure and Motion
    Dabral, Rishabh
    Mundhada, Anurag
    Kusupati, Uday
    Afaque, Safeer
    Sharma, Abhishek
    Jain, Arjun
    [J]. COMPUTER VISION - ECCV 2018, PT IX, 2018, 11213 : 679 - 696
  • [10] RGB-D FUSION FOR POINT-CLOUD-BASED 3D HUMAN POSE ESTIMATION
    Ying, Jiaming
    Zhao, Xu
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3108 - 3112