Survey on depth and RGB image-based 3D hand shape and pose estimation

被引:0
|
作者
Lin HUANG [1 ]
Boshen ZHANG [2 ]
Zhilin GUO [3 ]
Yang XIAO [4 ]
Zhiguo CAO [4 ]
Junsong YUAN [1 ]
机构
[1] Department of Computer Science and Engineering, State University of New York at Buffalo
[2] You Tu Lab,Tencent
[3] Department of Computer Science, Fu Foundation School of Engineering and Applied Science, Columbia University
[4] National Key Laboratory of Science and Technology on Multispectral Information Processing, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology
基金
美国国家科学基金会; 中国国家自然科学基金; 国家重点研发计划;
关键词
D O I
暂无
中图分类号
TP391.41 [];
学科分类号
080203 ;
摘要
The field of vision-based human hand three-dimensional(3 D) shape and pose estimation has attracted significant attention recently owing to its key role in various applications, such as natural humancomputer interactions. With the availability of large-scale annotated hand datasets and the rapid developments of deep neural networks(DNNs), numerous DNN-based data-driven methods have been proposed for accurate and rapid hand shape and pose estimation. Nonetheless, the existence of complicated hand articulation, depth and scale ambiguities, occlusions, and finger similarity remain challenging. In this study, we present a comprehensive survey of state-of-the-art 3 D hand shape and pose estimation approaches using RGB-D cameras. Related RGB-D cameras, hand datasets, and a performance analysis are also discussed to provide a holistic view of recent achievements. We also discuss the research potential of this rapidly growing field.
引用
收藏
页码:207 / 234
页数:28
相关论文
共 50 条
  • [1] Survey on depth and RGB image-based 3D hand shape and pose estimation
    Huang L.
    Zhang B.
    Guo Z.
    Xiao Y.
    Cao Z.
    Yuan J.
    Virtual Reality and Intelligent Hardware, 2021, 3 (03): : 207 - 234
  • [2] 3D Hand Shape and Pose Estimation from a Single RGB Image
    Ge, Liuhao
    Ren, Zhou
    Li, Yuncheng
    Xue, Zehao
    Wang, Yingying
    Cai, Jianfei
    Yuan, Junsong
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10825 - 10834
  • [3] Review on 3D Hand Pose Estimation Based on a RGB Image
    Xiao Y.
    Liu Y.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2024, 36 (02): : 161 - 172
  • [4] 3D interacting hand pose and shape estimation from a single RGB image
    Gao, Chengying
    Yang, Yujia
    Li, Wensheng
    NEUROCOMPUTING, 2022, 474 : 25 - 36
  • [5] Realistic Depth Image Synthesis for 3D Hand Pose Estimation
    Zhou, Jun
    Xu, Chi
    Ge, Yuting
    Cheng, Li
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 5246 - 5256
  • [6] 3D hand pose and shape estimation from RGB images for keypoint-based hand gesture recognition
    Avola, Danilo
    Cinque, Luigi
    Fagioli, Alessio
    Foresti, Gian Luca
    Fragomeni, Adriano
    Pannone, Daniele
    PATTERN RECOGNITION, 2022, 129
  • [7] Keypoint Fusion for RGB-D Based 3D Hand Pose Estimation
    Liu, Xingyu
    Ren, Pengfei
    Gao, Yuanyuan
    Wang, Jingyu
    Sun, Haifeng
    Qi, Qi
    Zhuang, Zirui
    Liao, Jianxin
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 4, 2024, : 3756 - 3764
  • [8] 3D Hand Pose Estimation from RGB Using Privileged Learning with Depth Data
    Yuan, Shanxin
    Stenger, Bjorn
    Kim, Tae-Kyun
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 2866 - 2873
  • [9] DGGAN: Depth-image Guided Generative Adversarial Networks for Disentangling RGB and Depth Images in 3D Hand Pose Estimation
    Chen, Liangjian
    Lin, Shih-Yao
    Xie, Yusheng
    Lin, Yen-Yu
    Fan, Wei
    Xie, Xiaohui
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 400 - 408
  • [10] HMTNet: 3D Hand Pose Estimation From Single Depth Image Based on Hand Morphological Topology
    Zhou, Weiguo
    Jiang, Xin
    Chen, Chen
    Mei, Sijia
    Liu, Yun-Hui
    IEEE SENSORS JOURNAL, 2020, 20 (11) : 6004 - 6011