GENERATING A 3D HAND MODEL FROM FRONTAL COLOR AND RANGE SCANS

被引:0
|
作者
Asad, Muhammad [1 ]
Gentet, Enguerrand [2 ]
Basaru, Rilwan Remilekun [1 ]
Slabaugh, Greg [1 ]
机构
[1] City Univ London, London, England
[2] Ecole Normale Suprieure Cachan, Cachan, France
关键词
Hand model; pose estimation; reconstruction;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Realistic 3D modeling of human hand anatomy has a number of important applications, including real-time tracking, pose estimation, and human-computer interaction. However the use of RGB-D sensors to accurately capture the full 3D shape of a hand is limited by self-occlusions, relatively smaller size of the hand and the requirement to capture multiple images. In this paper, we propose a method for generating a detailed, realistic hand model from a single frontal range scan and registered color image. In essence, our method converts this 2.5D data into a fully 3D model. The proposed approach extracts joint locations from the color image using a fingertip and interfinger region detector with a Naive Bayes probabilistic model. Direct correspondence between these joint locations in the range scan and a synthetic hand model are used to perform rigid registration, followed by a thin-plate-spline deformation that non-rigidly registers a synthetic model. This reconstructed model maintains similar geometric properties as the range scan, but also includes the back side of the hand. Experimental results demonstrate the promise of the method to produce detailed and realistic 3D hand geometry.
引用
收藏
页码:4589 / 4593
页数:5
相关论文
共 50 条
  • [21] 3D MODELING OF OUTDOOR SCENES FROM OMNIDIRECTIONAL RANGE AND COLOR IMAGES
    Asai, Toshihiro
    Kanbara, Masayuki
    Yokoya, Naokazu
    COMPUTER VISION AND GRAPHICS (ICCVG 2004), 2006, 32 : 118 - 124
  • [22] 3D reconstruction of outdoor environments from omnidirectional range and color images
    Asai, T
    Kanbara, M
    Yokoya, N
    STEREOSCOPIC DISPLAYS AND VIRTUAL REALITY SYSTEMS XII, 2005, 5664 : 579 - 588
  • [23] Sensor-aware Normal Estimation for Point Clouds from 3D Range Scans
    Comino, M.
    Andujar, C.
    Chica, A.
    Brunet, P.
    COMPUTER GRAPHICS FORUM, 2018, 37 (05) : 233 - 243
  • [24] The Laser Color Detection for 3D Range Scanning Using Gaussian Mixture Model
    Chmelar, Pavel
    Beran, Ladislav
    Kudriavtseva, Nataliia
    2015 25TH INTERNATIONAL CONFERENCE RADIOELEKTRONIKA (RADIOELEKTRONIKA), 2015, : 248 - 253
  • [25] Mapping with Dynamic-Object Probabilities Calculated from Single 3D Range Scans
    Ruchti, Philipp
    Burgard, Wolfram
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 6331 - 6336
  • [26] Generating 3D architectural models based on hand motion and gesture
    Yi, Xiao
    Qin, Shengfeng
    Kang, Jinsheng
    COMPUTERS IN INDUSTRY, 2009, 60 (09) : 677 - 685
  • [27] A detailed 3D model of the human hand
    S. Gehrmann
    K. H. Höhne
    W. Linhart
    A. Pommert
    U. Tiede
    S. Yarar
    Journal of Visualization, 2004, 7 : 271 - 271
  • [28] A detailed 3D model of the human hand
    Gehrmann, S
    Höhne, KH
    Linhart, W
    Pommert, A
    Tiede, U
    Yarar, S
    JOURNAL OF VISUALIZATION, 2004, 7 (04) : 271 - 271
  • [29] 3D Hand Skeleton Model Estimation from a Depth Image
    Fan, Chin-Yun
    Lin, Meng-Hsuan
    Su, Te-Feng
    Lai, Shang-Hong
    Yu, Chih-Hsiang
    2015 14TH IAPR INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS (MVA), 2015, : 489 - 492
  • [30] Producing animations from 3D face scans
    Robinson, A
    Rodrigues, MA
    Alboul, L
    GAME-ON 2005: 6TH INTERNATIONAL CONFERENCE ON INTELLIGENT GAMES AND SIMULATION, 2005, : 57 - 64