Survey on depth and RGB image-based 3D hand shape and pose estimation

被引:0
|
作者
Lin HUANG [1 ]
Boshen ZHANG [2 ]
Zhilin GUO [3 ]
Yang XIAO [4 ]
Zhiguo CAO [4 ]
Junsong YUAN [1 ]
机构
[1] Department of Computer Science and Engineering, State University of New York at Buffalo
[2] You Tu Lab,Tencent
[3] Department of Computer Science, Fu Foundation School of Engineering and Applied Science, Columbia University
[4] National Key Laboratory of Science and Technology on Multispectral Information Processing, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology
基金
美国国家科学基金会; 中国国家自然科学基金; 国家重点研发计划;
关键词
D O I
暂无
中图分类号
TP391.41 [];
学科分类号
080203 ;
摘要
The field of vision-based human hand three-dimensional(3 D) shape and pose estimation has attracted significant attention recently owing to its key role in various applications, such as natural humancomputer interactions. With the availability of large-scale annotated hand datasets and the rapid developments of deep neural networks(DNNs), numerous DNN-based data-driven methods have been proposed for accurate and rapid hand shape and pose estimation. Nonetheless, the existence of complicated hand articulation, depth and scale ambiguities, occlusions, and finger similarity remain challenging. In this study, we present a comprehensive survey of state-of-the-art 3 D hand shape and pose estimation approaches using RGB-D cameras. Related RGB-D cameras, hand datasets, and a performance analysis are also discussed to provide a holistic view of recent achievements. We also discuss the research potential of this rapidly growing field.
引用
收藏
页码:207 / 234
页数:28
相关论文
共 50 条
  • [31] Hand Pose Estimation from a Single RGB-D Image
    Kuznetsova, Alina
    Rosenhahn, Bodo
    ADVANCES IN VISUAL COMPUTING, PT II, 2013, 8034 : 592 - 602
  • [32] Hand Shape and 3D Pose Estimation Using Depth Data from a Single Cluttered Frame
    Doliotis, Paul
    Athitsos, Vassilis
    Kosmopoulos, Dimitrios
    Perantonis, Stavros
    ADVANCES IN VISUAL COMPUTING, ISVC 2012, PT I, 2012, 7431 : 148 - 158
  • [33] Depth-based 3D Hand Pose Tracking
    Quach, Kha Gia
    Chi Nhan Duong
    Luu, Khoa
    Bui, Tien D.
    2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 2746 - 2751
  • [34] Single image-based head pose estimation with spherical parametrization and 3D morphing
    Yuan, Hui
    Li, Mengyu
    Hou, Junhui
    Xiao, Jimin
    PATTERN RECOGNITION, 2020, 103
  • [35] 3D Pose Estimation Based on Reinforce Learning for 2D Image-Based 3D Model Retrieval
    Nie, Wei-Zhi
    Jia, Wen-Wu
    Li, Wen-Hui
    Liu, An-An
    Zhao, Si-Cheng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 (23) : 1021 - 1034
  • [36] Latent Distribution-Based 3D Hand Pose Estimation From Monocular RGB Images
    Li, Moran
    Wang, Jialong
    Sang, Nong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (12) : 4883 - 4894
  • [37] A Survey of Image-based 3D Reconstruction
    Fu, Xinfang
    Li, Yueqiang
    PROCEEDINGS OF THE 2017 INTERNATIONAL CONFERENCE ON MECHANICAL, ELECTRONIC, CONTROL AND AUTOMATION ENGINEERING (MECAE 2017), 2017, 61 : 180 - 183
  • [38] Image-Based Pose Estimation for 3-D Modeling in Rapid, Hand-Held Motion
    Strobl, Klaus H.
    Mair, Elmar
    Hirzinger, Gerd
    2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011, : 2593 - 2600
  • [39] 3D Hand Pose Estimation From Monocular RGB With Feature Interaction Module
    Guo, Shaoxiang
    Rigall, Eric
    Ju, Yakun
    Dong, Junyu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (08) : 5293 - 5306
  • [40] 3D Hand Pose Estimation from Monocular RGB with Feature Interaction Module
    Guo, Shaoxiang
    Rigall, Eric
    Ju, Yakun
    Dong, Junyu
    IEEE Transactions on Circuits and Systems for Video Technology, 2022, 32 (08): : 5293 - 5306