Garment reconstruction from a single-view image based on pixel-aligned implicit function

被引:0
|
作者
Wentao He
Ning Zhang
Bingpeng Song
Ruru Pan
机构
[1] Jiangnan University,Key Laboratory of Eco
来源
关键词
Garments; Reconstruction; Implicit function; Single-view;
D O I
暂无
中图分类号
学科分类号
摘要
3D garment reconstruction has a wide range of applications in apparel design, digital human body, and virtual try-on. Reconstructing 3D shapes from single-view images is a completely undefined and challenging problem. Recent single-view methods require only single-view images of static or dynamic objects and mine the potential multi-view information in single-view images by statistical, geometric, and physical prior knowledge, which is tedious to obtain. In this paper, we use an implicit function of pixel alignment represented by a neural network to correlate 2D image pixels with the corresponding 3D clothing information for end-to-end training without any relevant prior model. The qualitative and quantitative analysis of the experimental results showed that our results reduced the relative error by an average of 2.6% and the chamfer distance by 2.37% compared to the previous method. Experiments show that our model can reasonably reconstruct the 3D model of garments from their collections of single-view images. Our method can not only capture the overall geometry of the garment but also extract the tiny but important wrinkle details of the fabric. Even with low-resolution input images, our model still achieves available results. In addition, experiments show that the reconstructed 3D models of garments can be used for texture migration and virtual fitting.
引用
收藏
页码:30247 / 30265
页数:18
相关论文
共 50 条
  • [1] Garment reconstruction from a single-view image based on pixel-aligned implicit function
    He, Wentao
    Zhang, Ning
    Song, Bingpeng
    Pan, Ruru
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (19) : 30247 - 30265
  • [2] TransPIFu: Combining Transformer and Pixel-Aligned Implicit Function for Single-view Clothed Human Reconstruction?
    Chen, Lifang
    Su, Jianghu
    Luo, Shiyong
    COMPUTERS & GRAPHICS-UK, 2023, 111 : 1 - 13
  • [3] IntegratedPIFu: Integrated Pixel Aligned Implicit Function for Single-View Human Reconstruction
    Chan, Kennard Yanting
    Lin, Guosheng
    Zhao, Haiyu
    Lin, Weisi
    COMPUTER VISION - ECCV 2022, PT II, 2022, 13662 : 328 - 344
  • [4] Fine Structure-Aware Sampling: A New Sampling Training Scheme for Pixel-Aligned Implicit Models in Single-View Human Reconstruction
    Chan, Kennard Yanting
    Liu, Fayao
    Lin, Guosheng
    Foo, Chuan Sheng
    Lin, Weisi
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 964 - 971
  • [5] Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstruction
    He, Tong
    Collomosse, John
    Jin, Hailin
    Soatto, Stefano
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [6] Skeleton-aware Implicit Function for single-view human reconstruction
    Liu, Pengpeng
    Zhang, Guixuan
    Zhang, Shuwu
    Li, Yuanhao
    Zeng, Zhi
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2023, 8 (02) : 379 - 389
  • [7] Physics-Inspired Garment Recovery from a Single-View Image
    Yang, Shan
    Pan, Zherong
    Amert, Tanya
    Wang, Ke
    Yu, Licheng
    Berg, Tamara
    Lin, Ming C.
    ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (05):
  • [8] PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization
    Saito, Shunsuke
    Huang, Zeng
    Natsume, Ryota
    Morishima, Shigeo
    Kanazawa, Angjoo
    Li, Hao
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2304 - 2314
  • [9] G2IFu: Graph-based implicit function for single-view 3D reconstruction
    Chen, Rongshan
    Yang, Yuancheng
    Tong, Chao
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 124
  • [10] Ethnic Style Representation Learning for Single-View 3D Garment Reconstruction
    Zhang Y.
    Liu L.
    Fu X.
    Liu L.
    Peng W.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2024, 36 (02): : 258 - 272