A survey on 3D hand pose estimation: Cameras, methods, and datasets

被引:60
|
作者
Li, Rui [1 ]
Liu, Zhenyu [1 ]
Tan, Jianrong [1 ]
机构
[1] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Hand pose estimation; Hand tracking; Depth camera; Human-computer interaction; REGRESSION FORESTS; KINECT; SYSTEM; SENSOR; ACCURACY; MOTION; MODEL;
D O I
10.1016/j.patcog.2019.04.026
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D Hand pose estimation has received an increasing amount of attention, especially since consumer depth cameras came onto the market in 2010. Although substantial progress has occurred recently, no overview has kept up with the latest developments. To bridge the gap, we provide a comprehensive survey, including depth cameras, hand pose estimation methods, and public benchmark datasets. First, a markerless approach is proposed to evaluate the tracking accuracy of depth cameras with the aid of a numerical control linear motion guide. Traditional approaches focus only on static characteristics. The evaluation of dynamic tracking capability has been long neglected. Second, we summarize the state-of-the-art methods and analyze the lines of research. Third, existing benchmark datasets and evaluation criteria are identified to provide further insight into the field of hand pose estimation. In addition, realistic challenges, recent trends, dataset creation and annotation, and open problems for future research directions are also discussed. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:251 / 272
页数:22
相关论文
共 50 条
  • [41] Realistic Depth Image Synthesis for 3D Hand Pose Estimation
    Zhou, Jun
    Xu, Chi
    Ge, Yuting
    Cheng, Li
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 5246 - 5256
  • [42] Denoising Diffusion for 3D Hand Pose Estimation from Images
    Ivashechkin, Maksym
    Mendez, Oscar
    Bowden, Richard
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 3128 - 3137
  • [43] Review on 3D Hand Pose Estimation Based on a RGB Image
    Xiao Y.
    Liu Y.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2024, 36 (02): : 161 - 172
  • [44] Dynamic Iterative Refinement for Efficient 3D Hand Pose Estimation
    Yang, John
    Bhalgat, Yash
    Chang, Simyung
    Porikli, Fatih
    Kwak, Nojun
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 2703 - 2713
  • [45] Real-Time 3D Hand Pose Estimation with 3D Convolutional Neural Networks
    Ge, Liuhao
    Liang, Hui
    Yuan, Junsong
    Thalmann, Daniel
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (04) : 956 - 970
  • [46] Temporally Consistent 3D Human Pose Estimation Using Dual 360° Cameras
    Shere, Matthew
    Kim, Hansung
    Hilton, Adrian
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 81 - 90
  • [47] Keypoint Fusion for RGB-D Based 3D Hand Pose Estimation
    Liu, Xingyu
    Ren, Pengfei
    Gao, Yuanyuan
    Wang, Jingyu
    Sun, Haifeng
    Qi, Qi
    Zhuang, Zirui
    Liao, Jianxin
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 4, 2024, : 3756 - 3764
  • [48] Deep Learning Methods for 3D Human Pose Estimation under Different Supervision Paradigms: A Survey
    Zhang, Dejun
    Wu, Yiqi
    Guo, Mingyue
    Chen, Yilin
    ELECTRONICS, 2021, 10 (18)
  • [49] Differentiable Spatial Regression: A Novel Method for 3D Hand Pose Estimation
    Zhang, Xingyuan
    Zhang, Fuhai
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 166 - 176
  • [50] 3D Hand Shape and Pose Estimation from a Single RGB Image
    Ge, Liuhao
    Ren, Zhou
    Li, Yuncheng
    Xue, Zehao
    Wang, Yingying
    Cai, Jianfei
    Yuan, Junsong
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10825 - 10834