3D human body reconstruction based on SMPL model

被引:0
|
作者
Dongyue Chen
Yuanyuan Song
Fangzheng Liang
Teng Ma
Xiaoming Zhu
Tong Jia
机构
[1] Northeastern University,Artificial Intelligence Laboratory
来源
The Visual Computer | 2023年 / 39卷
关键词
3D human reconstruction; SMPL; Pose estimation;
D O I
暂无
中图分类号
学科分类号
摘要
Recovering 3D human pose and body shape from a monocular image is a challenging task in computer vision. In this paper, we present an optimization-based algorithm and an innovative framework to reconstruct 3D human body from a single monocular image. All the evaluation tasks are established on the basis of the classic parametric 3D body model SMPL. Firstly, a new combined objective function of SMPL parameters is proposed to involve four loss terms on 2D joints, 3D joints, facial landmarks and pose priori, respectively, which increase the reliability of the evaluation results dramatically. Furthermore, we use the estimation results given by an end-to-end regression network as the initial values of the parameters, which has been proved to speed up the optimization process. The experiments on benchmark datasets Human 3.6 M, LSP and a wild dataset demonstrate that our model achieves an accurate and robust estimation of the 3D human body and outperforms the popular competing algorithms in precision and robustness.
引用
收藏
页码:1893 / 1906
页数:13
相关论文
共 50 条
  • [1] 3D human body reconstruction based on SMPL model
    Chen, Dongyue
    Song, Yuanyuan
    Liang, Fangzheng
    Ma, Teng
    Zhu, Xiaoming
    Jia, Tong
    VISUAL COMPUTER, 2023, 39 (05): : 1893 - 1906
  • [2] 3D reconstruction of geological body based on tetrahedron model
    Shi X.
    Wang J.
    Sun W.
    Meitan Kexue Jishu/Coal Science and Technology (Peking), 2022, 50 (11): : 150 - 155
  • [3] Monocular 3D Reconstruction of Human Body
    Zhang, Yuqi
    Li, Dewei
    Jin, Bihui
    Ku, Yunwen
    Xue, Shibei
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 7889 - 7894
  • [4] 3D Human Body Reconstruction with Shadow
    Kang Y.
    Shi J.
    Ren L.
    Liu Y.
    Wu E.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2023, 35 (11): : 1643 - 1653
  • [5] A Model-Based Approach for Human Body Reconstruction from 3D Scanned Data
    Luginbuehl, Thibault
    Guerlain, Philippe
    Gagalowicz, Andre
    COMPUTER VISION/COMPUTER GRAPHICS COLLABORATION TECHNIQUES, PROCEEDINGS, 2009, 5496 : 332 - +
  • [6] 3D Human Model Reconstruction Based on Implicit Representation
    Liang, Kai-Wen
    Guo, You-Sheng
    Wang, Chien-Yao
    Le, Phuong Thi
    Putri, Wenny Ramadha
    Chen, Yung-Fang
    Chang, Pao-Chi
    Wang, Jia-Ching
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS-ICCSA 2024 WORKSHOPS, PT XI, 2024, 14825 : 386 - 397
  • [7] Human Action Transfer Based on 3D Model Reconstruction
    Guan, Shanyan
    Wen, Shuo
    Yang, Dexin
    Ni, Bingbing
    Zhang, Wendong
    Tang, Jun
    Yang, Xiaokang
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 8352 - 8359
  • [8] SMPL-Based 3D Pedestrian Pose Prediction
    Kunchala, Anil
    Bouroche, Melanie
    D'Arcy, Lorraine
    Schoen-Phelan, Bianca
    2021 16TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2021), 2021,
  • [9] 3D Reconstruction for Soft Tissue of the Human Body
    Zhu, Ling
    Li, Yandong
    Yu, Ying
    Zhang, Baoquan
    Wang, Lijing
    2016 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, 2016, : 1721 - 1725
  • [10] A 3D reconstruction system for human body modeling
    Gu, J
    Chang, T
    Mak, I
    Gopalsamy, S
    Shen, HC
    Yuen, MMF
    MODELLING AND MOTION CAPTURE TECHNIQUES FOR VIRTUAL ENVIRONMENTS, 1998, 1537 : 229 - 241