Real-Time 3D Model Reconstruction and Mapping for Fashion

被引:0
|
作者
Makarov, Ilya [1 ,2 ]
Chernyshev, Daniil [1 ]
机构
[1] Natl Res Univ Higher Sch Econ, Moscow, Russia
[2] Steklov Inst Math, Samsung PDMI Joint AI Ctr, St Petersburg Dept, St Petersburg, Russia
关键词
garment mapping; human body mesh generation; human pose estimation; image-based modeling; CONVOLUTIONAL NEURAL-NETWORKS; HUMAN POSE ESTIMATION;
D O I
10.1109/tsp49548.2020.9163542
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recent developments in the apparel market created new tasks for computer vision application. One such challenge is designing a system for trying on clothes virtually in real-time. Proposed solutions require setting up a special stationary system for body capture and mostly generate animated avatar instead of overlaying the garments in real-time. We propose a framework that utilizes state-of-the-art monocular-based 3D skeleton reconstruction and parametric body generation techniques allowing to operate under constrained resources, such as smartphones. In addition, we also consider the problem of dealing with visual artifacts as a result of 3D projection on a real-time image and design a solution to reduce them based on iterative closest point method.
引用
收藏
页码:133 / 138
页数:6
相关论文
共 50 条
  • [1] StereoScan: Dense 3d Reconstruction in Real-time
    Geiger, Andreas
    Ziegler, Julius
    Stiller, Christoph
    [J]. 2011 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2011, : 963 - 968
  • [2] Real-Time Active Multiview 3D Reconstruction
    Ide, Kai
    Sikora, Thomas
    [J]. PROCEEDINGS OF INTERNATIONAL CONFERENCE ON COMPUTER VISION IN REMOTE SENSING, 2012, : 203 - 208
  • [3] DenseMatch: a dataset for real-time 3D reconstruction
    Lombardi, Marco
    Savardi, Mattia
    Signoroni, Alberto
    [J]. DATA IN BRIEF, 2021, 39
  • [4] Real-Time Mobile 3D Temperature Mapping
    Vidas, Stephen
    Moghadam, Peyman
    Sridharan, Sridha
    [J]. IEEE SENSORS JOURNAL, 2015, 15 (02) : 1145 - 1152
  • [5] Real-time 3D cone beam reconstruction
    Stsepankou, D
    Kornmesser, K
    Hesser, J
    Männer, R
    [J]. 2004 IEEE NUCLEAR SCIENCE SYMPOSIUM CONFERENCE RECORD, VOLS 1-7, 2004, : 3648 - 3652
  • [6] Volumetric 3D Mapping in Real-Time on a CPU
    Steinbruecker, Frank
    Sturm, Juergen
    Cremers, Daniel
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2014, : 2021 - 2028
  • [7] Real-time active 3D shape reconstruction for 3D video
    Wu, X
    Matsuyama, T
    [J]. ISPA 2003: PROCEEDINGS OF THE 3RD INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS, PTS 1 AND 2, 2003, : 186 - 191
  • [8] Real-time 3D model acquisition
    Rusinkiewicz, S
    Hall-Holt, O
    Levoy, M
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2002, 21 (03): : 438 - 446
  • [9] REAL-TIME 3D FACE RECONSTRUCTION FROM ONE SINGLE IMAGE BY DISPLACEMENT MAPPING
    Wu, Tao
    Zhou, Fei
    Liao, Qingmin
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 2204 - 2208
  • [10] REAL-TIME 3D BODY RECONSTRUCTION FOR IIYIMERSIVE TV
    Waizenegger, W.
    Feldmann, I.
    Schreer, O.
    Kauff, P.
    Eisert, P.
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 360 - 364