A practical framework of multi-person 3D human pose estimation with a single RGB camera

被引:1
|
作者
Ma, Le [1 ,4 ]
Lian, Sen [1 ,4 ]
Wang, Shandong [3 ]
Meng, Weiliang [1 ,2 ,4 ,5 ]
Xiao, Jun [1 ]
Zhang, Xiaopeng [1 ,2 ,4 ]
机构
[1] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
[2] Zhejiang Lab, Hangzhou, Peoples R China
[3] Intel Labs China, Beijing, Peoples R China
[4] Chinese Acad Sci, Inst Automat, NLPR, Beijing, Peoples R China
[5] Chinese Acad Sci, Inst Software, State Key Lab Comp Sci, Beijing, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Skeleton; Neural network; Detection; Real-time;
D O I
10.1109/VRW52623.2021.00092
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We propose a practical framework named 'DN-2DPN-3DPN' for multi-person 3D pose estimation with a single RGB camera. Our framework performs three-stages tasks on the input video: our DetectNet(DN) firstly detects the people's bounding box individually for each frame of the video, while our 2DPoseNet(2DPN) estimates the 2D poses for each person in the second stage, and our 3DPoseNet(3DPN) is finally applied to obtain the 3D poses of the people. Experiments validate that our method can achieve state-of-the-art performance for multi-person 3D human pose estimation on the Human3.6M dataset.
引用
收藏
页码:420 / 421
页数:2
相关论文
共 50 条
  • [1] Single-Shot Multi-Person 3D Pose Estimation From Monocular RGB
    Mehta, Dushyant
    Sotnychenko, Oleksandr
    Mueller, Franziska
    Xu, Weipeng
    Sridhar, Srinath
    Pons-Moll, Gerard
    Theobalt, Christian
    [J]. 2018 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2018, : 120 - 130
  • [2] Multi-person 3D pose estimation from a single image captured by a fisheye camera
    Zhang, Yahui
    You, Shaodi
    Karaoglu, Sezer
    Gevers, Theo
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 222
  • [3] Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image
    Moon, Gyeongsik
    Chang, Ju Yong
    Lee, Kyoung Mu
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 10132 - 10141
  • [4] Multi-person 3D Pose Estimation and Tracking in Sports
    Bridgeman, Lewis
    Volino, Marco
    Guillemaut, Jean-Yves
    Hilton, Adrian
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 2487 - 2496
  • [5] Multi-Person 3D Human Pose Estimation from Monocular Images
    Dabral, Rishabh
    Gundavarapu, Nitesh B.
    Mitra, Rahul
    Sharma, Abhishek
    Ramakrishnan, Ganesh
    Jain, Arjun
    [J]. 2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, : 405 - 414
  • [6] VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wild
    Zhang, Yifu
    Wang, Chunyu
    Wang, Xinggang
    Liu, Wenyu
    Zeng, Wenjun
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (02) : 2613 - 2626
  • [7] Explicit Occlusion Reasoning for Multi-person 3D Human Pose Estimation
    Liu, Qihao
    Zhang, Yi
    Bai, Song
    Yuille, Alan
    [J]. COMPUTER VISION - ECCV 2022, PT V, 2022, 13665 : 497 - 517
  • [8] Multi-Person 3D Pose Estimation With Occlusion Reasoning
    Chen, Xipeng
    Zhang, Junzheng
    Wang, Keze
    Wei, Pengxu
    Lin, Liang
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 878 - 889
  • [9] Center point to pose: Multiple views 3D human pose estimation for multi-person
    Liu, Huan
    Wu, Jian
    He, Rui
    [J]. PLOS ONE, 2022, 17 (09):
  • [10] AnimePose: Multi-person 3D pose estimation and animation
    Kumarapu, Laxman
    Mukherjee, Prerana
    [J]. PATTERN RECOGNITION LETTERS, 2021, 147 : 16 - 24