Human Bas-Relief Generation From a Single Photograph

被引:4
|
作者
Yang, Zhenjie [1 ]
Chen, Beijia [1 ]
Zheng, Youyi [2 ]
Chen, Xiang [2 ]
Zhou, Kun [2 ]
机构
[1] Zhejiang Univ, Hangzhou 310027, Zhejiang, Peoples R China
[2] Zhejiang Univ, State Key Lab CAD & CG, Zijingang Campus, Hangzhou 310058, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Shape; Solid modeling; Estimation; Computational modeling; Image reconstruction; Image resolution; Human bas-relief; multi-person; occlusion resolution; contour matching; single image;
D O I
10.1109/TVCG.2021.3092877
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We present a semi-automatic method for producing human bas-relief from a single photograph. Given an input photo of one or multiple persons, our method first estimates a 3D skeleton for each person in the image. SMPL models are then fitted to the 3D skeletons to generate a 3D guide model. To align the 3D guide model with the image, we compute a 2D warping field to non-rigidly register the projected contours of the guide model with the body contours in the image. Then the normal map of the 3D guide model is warped by the 2D deformation field to reconstruct an overall base shape. Finally, the base shape is integrated with a fine-scale normal map to produce the final bas-relief. To tackle the complex intra- and inter-body interactions, we design an occlusion relationship resolution method that operates at the level of 3D skeletons with minimal user inputs. To tightly register the model contours to the image contours, we propose a non-rigid point matching algorithm harnessing user-specified sparse correspondences. Experiments demonstrate that our human bas-relief generation method is capable of producing perceptually realistic results on various single-person and multi-person images, on which the state-of-the-art depth and pose estimation methods often fail.
引用
收藏
页码:4558 / 4569
页数:12
相关论文
共 50 条
  • [31] Reflections on the generalized bas-relief ambiguity
    Chandraker, MK
    Kahl, F
    Kriegman, DJ
    2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, : 788 - 795
  • [32] Pose Selection for Animated Scenes and a Case Study of Bas-relief Generation
    Wang, Meili
    Guo, Shihui
    Liao, Minghong
    He, Dongjian
    Chang, Jian
    Zhang, Jian
    Zhang, Zhiyi
    CGI'17: PROCEEDINGS OF THE COMPUTER GRAPHICS INTERNATIONAL CONFERENCE, 2017,
  • [33] Realtime digital bas-relief modeling
    Zhou, Shizhe
    Liu, Ligang
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2010, 22 (03): : 434 - 439
  • [34] Bas-Relief Modeling from Normal Images with Intuitive Styles
    Ji, Zhongping
    Ma, Weiyin
    Sun, Xianfang
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2014, 20 (05) : 675 - 685
  • [35] Digital bas-relief from 3D scenes
    Weyrich, Tim
    Deng, Ha
    Barnes, Connelly
    Rusinkiewicz, Szymon
    Finkelstein, Adam
    ACM TRANSACTIONS ON GRAPHICS, 2007, 26 (03):
  • [36] Real-time Bas-Relief Generation from Depth-and-Normal Maps on GPU
    Ji, Zhongping
    Sun, Xianfang
    Li, Shi
    Wang, Yigang
    COMPUTER GRAPHICS FORUM, 2014, 33 (05) : 75 - 83
  • [37] A STONE CARVING IN BAS-RELIEF FROM THE UPPER GILA AREA
    Nesbitt, P. H.
    AMERICAN ANTIQUITY, 1937, 2 (04) : 264 - 266
  • [38] Visual saliency-based bas-relief generation with symmetry composition rule
    Li, Tingting
    Yang, Liying
    Wang, Meili
    Fan, Yuling
    Zhang, Feiyu
    Guo, Shihui
    Chang, Jian
    Zhang, Jian Jun
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2018, 29 (3-4)
  • [39] Isotropy, reciprocity and the generalized bas-relief ambiguity
    Tan, Ping
    Mallick, Satya P.
    Quan, Long
    Kriegman, David J.
    Zickler, Todd
    2007 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-8, 2007, : 1814 - +
  • [40] RUB A LANDMARK + REPRODUCING BAS-RELIEF ETCHINGS
    FIRESTEIN, CB
    HISTORIC PRESERVATION, 1978, 30 (04): : 14 - 19