Garment reconstruction from a single-view image based on pixel-aligned implicit function

被引:0
|
作者
Wentao He
Ning Zhang
Bingpeng Song
Ruru Pan
机构
[1] Jiangnan University,Key Laboratory of Eco
来源
关键词
Garments; Reconstruction; Implicit function; Single-view;
D O I
暂无
中图分类号
学科分类号
摘要
3D garment reconstruction has a wide range of applications in apparel design, digital human body, and virtual try-on. Reconstructing 3D shapes from single-view images is a completely undefined and challenging problem. Recent single-view methods require only single-view images of static or dynamic objects and mine the potential multi-view information in single-view images by statistical, geometric, and physical prior knowledge, which is tedious to obtain. In this paper, we use an implicit function of pixel alignment represented by a neural network to correlate 2D image pixels with the corresponding 3D clothing information for end-to-end training without any relevant prior model. The qualitative and quantitative analysis of the experimental results showed that our results reduced the relative error by an average of 2.6% and the chamfer distance by 2.37% compared to the previous method. Experiments show that our model can reasonably reconstruct the 3D model of garments from their collections of single-view images. Our method can not only capture the overall geometry of the garment but also extract the tiny but important wrinkle details of the fabric. Even with low-resolution input images, our model still achieves available results. In addition, experiments show that the reconstructed 3D models of garments can be used for texture migration and virtual fitting.
引用
收藏
页码:30247 / 30265
页数:18
相关论文
共 50 条
  • [41] Reconstruction of Digital Surface Model of Single-view Remote Sensing Image by Semantic Segmentation Network
    Lu, Junyan
    Jia, Hongguang
    Gao, Fang
    Li, Wentao
    Lu, Qing
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2021, 43 (04): : 974 - 981
  • [42] Motion capture and human pose reconstruction from a single-view video sequence
    Gudukbay, Ugur
    Demir, Ibrahim
    Dedeoglu, Yigithan
    DIGITAL SIGNAL PROCESSING, 2013, 23 (05) : 1441 - 1450
  • [43] Reconstruction of Digital Surface Model of Single-view Remote Sensing Image by Semantic Segmentation Network
    Lu Junyan
    Jia Hongguang
    Gao Fang
    Li Wentao
    Lu Qing
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2021, 43 (04) : 974 - 981
  • [44] Perspective Reconstruction of Non-Rigid Surfaces from Single-View Videos
    Sepehrinour, Maryam
    Kasaei, Shohreh
    2017 25TH IRANIAN CONFERENCE ON ELECTRICAL ENGINEERING (ICEE), 2017, : 1452 - 1458
  • [45] DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstruction
    Wang, Weiyue
    Xu, Qiangeng
    Ceylan, Duygu
    Mech, Radomir
    Neumann, Ulrich
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [46] Reconstruction of 3D Information of Buildings from Single-View Images Based on Shadow Information
    Li, Zhixin
    Ji, Song
    Fan, Dazhao
    Yan, Zhen
    Wang, Fengyi
    Wang, Ren
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2024, 13 (03)
  • [47] DEPTH MAP ESTIMATION FROM SINGLE-VIEW IMAGE USING OBJECT CLASSIFICATION BASED ON BAYESIAN LEARNING
    Jung, Jae-Il
    Ho, Yo-Sung
    2010 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON 2010), 2010,
  • [48] 3D Reconstruction and Estimation from Single-view 2D Image by Deep Learning A Survey
    Shan, Yongfeng
    Liang, Christy Jie
    Xu, Min
    2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 1 - 7
  • [49] Single-view Cone beam CT reconstruction with Swin Transformer based deep learning
    Huang, Shien
    Song, Yonghong
    Rong, Junyan
    Liu, Tianshuai
    Huang, Dong
    Lu, Hongbing
    MEDICAL IMAGING 2023, 2023, 12464
  • [50] Cascaded Network-Based Single-View Bird 3D Reconstruction
    Su, Pei
    Zhao, Qijun
    Pan, Fan
    Gao, Fei
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT II, 2023, 14255 : 115 - 127