3D human body reconstruction based on SMPL model

被引:0
|
作者
Dongyue Chen
Yuanyuan Song
Fangzheng Liang
Teng Ma
Xiaoming Zhu
Tong Jia
机构
[1] Northeastern University,Artificial Intelligence Laboratory
来源
The Visual Computer | 2023年 / 39卷
关键词
3D human reconstruction; SMPL; Pose estimation;
D O I
暂无
中图分类号
学科分类号
摘要
Recovering 3D human pose and body shape from a monocular image is a challenging task in computer vision. In this paper, we present an optimization-based algorithm and an innovative framework to reconstruct 3D human body from a single monocular image. All the evaluation tasks are established on the basis of the classic parametric 3D body model SMPL. Firstly, a new combined objective function of SMPL parameters is proposed to involve four loss terms on 2D joints, 3D joints, facial landmarks and pose priori, respectively, which increase the reliability of the evaluation results dramatically. Furthermore, we use the estimation results given by an end-to-end regression network as the initial values of the parameters, which has been proved to speed up the optimization process. The experiments on benchmark datasets Human 3.6 M, LSP and a wild dataset demonstrate that our model achieves an accurate and robust estimation of the 3D human body and outperforms the popular competing algorithms in precision and robustness.
引用
收藏
页码:1893 / 1906
页数:13
相关论文
共 50 条
  • [31] Stereo Matching based 3D Model Reconstruction
    Yuan, Lijie
    Tie, Yun
    Qi, Lin
    TENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2018), 2018, 10806
  • [32] Model-based 3D SAR Reconstruction
    Knight, Chad
    Gunther, Jake
    Moon, Todd
    ALGORITHMS FOR SYNTHETIC APERTURE RADAR IMAGERY XXI, 2014, 9093
  • [33] 3D shape reconstruction of trunk swaying human body segments
    Funatomi, Takuya
    Iiyama, Masaaki
    Kakusho, Koh
    Minoh, Michihiko
    ARTICULATED MOTION AND DEFORMABLE OBJECTS, PROCEEDINGS, 2006, 4069 : 100 - 109
  • [34] LaplacianFusion: Detailed 3D Clothed-Human Body Reconstruction
    Kim, Hyomin
    Nam, Hyeonseo
    Kim, Jungeon
    Park, Jaesik
    Lee, Seungyong
    ACM TRANSACTIONS ON GRAPHICS, 2022, 41 (06):
  • [35] Towards Accurate 3D Human Body Reconstruction from Silhouettes
    Smith, Brandon M.
    Chari, Visesh
    Agrawal, Amit
    Rehg, James M.
    Sever, Ram
    2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, : 279 - 288
  • [36] LCR-SMPL: Toward Real-time Human Detection and 3D Reconstruction from a Single RGB Image
    Pena-Tapia, Elena
    Hachiuma, Ryo
    Pasquali, Antoine
    Saito, Hideo
    ADJUNCT PROCEEDINGS OF THE 2020 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR-ADJUNCT 2020), 2020, : 211 - 212
  • [37] Accurate and efficient 3D reconstruction system for the human body with color texture based on DIC
    Li, Wenpan
    Zhang, Mingkai
    Liang, Jin
    Ren, Maodong
    Zong, Yulong
    Ye, Meitu
    Li, Youfu
    OPTICS AND LASERS IN ENGINEERING, 2020, 127
  • [38] Detailed 3D Human Body Reconstruction From a Single Image Based on Mesh Deformation
    Zhang, Sizhuo
    Xiao, Nanfeng
    IEEE ACCESS, 2021, 9 : 8595 - 8603
  • [39] 3D image reconstruction of architectural model based on 3D printing technology
    Hu, Ting
    Wang, Wei
    INTELLIGENT BUILDINGS INTERNATIONAL, 2023,
  • [40] Reconstruction of 3D Images from Human Activity by a Compound Reconstruction Model
    Hongna Zheng
    Li Yao
    Zhiying Long
    Cognitive Computation, 2022, 14 : 1509 - 1525