Garment reconstruction from a single-view image based on pixel-aligned implicit function

被引:0
|
作者
Wentao He
Ning Zhang
Bingpeng Song
Ruru Pan
机构
[1] Jiangnan University,Key Laboratory of Eco
来源
关键词
Garments; Reconstruction; Implicit function; Single-view;
D O I
暂无
中图分类号
学科分类号
摘要
3D garment reconstruction has a wide range of applications in apparel design, digital human body, and virtual try-on. Reconstructing 3D shapes from single-view images is a completely undefined and challenging problem. Recent single-view methods require only single-view images of static or dynamic objects and mine the potential multi-view information in single-view images by statistical, geometric, and physical prior knowledge, which is tedious to obtain. In this paper, we use an implicit function of pixel alignment represented by a neural network to correlate 2D image pixels with the corresponding 3D clothing information for end-to-end training without any relevant prior model. The qualitative and quantitative analysis of the experimental results showed that our results reduced the relative error by an average of 2.6% and the chamfer distance by 2.37% compared to the previous method. Experiments show that our model can reasonably reconstruct the 3D model of garments from their collections of single-view images. Our method can not only capture the overall geometry of the garment but also extract the tiny but important wrinkle details of the fabric. Even with low-resolution input images, our model still achieves available results. In addition, experiments show that the reconstructed 3D models of garments can be used for texture migration and virtual fitting.
引用
收藏
页码:30247 / 30265
页数:18
相关论文
共 50 条
  • [21] Pixel-Wise Fisheye Image Correction Method With Single-View Phase Target
    Cai, Jiaxu
    Yang, Kunling
    Cheng, Lei
    Wang, Yuwei
    IEEE PHOTONICS TECHNOLOGY LETTERS, 2022, 34 (19) : 1038 - 1041
  • [22] PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization
    Saito, Shunsuke
    Simon, Tomas
    Saragih, Jason
    Joo, Hanbyul
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 81 - 90
  • [23] UNSUPERVISED SEVERELY DEFORMED MESH RECONSTRUCTION (DMR) FROM A SINGLE-VIEW IMAGE FOR LONGLINE FISHING
    Mei, Jie
    Yu, Jingxi
    Romain, Suzanne
    Rose, Craig
    Magrane, Kelsey
    LeeSon, Graeme
    Hwang, Jenq-Neng
    2022 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (IEEE ICMEW 2022), 2022,
  • [24] SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion
    Ho, Hsuan-I
    Song, Jie
    Hilliges, Otmar
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 538 - 549
  • [25] 3D voxel reconstruction from single-view image based on cross-domain feature fusion
    Xiong, Wenjing
    Huang, Fang
    Zhang, Hao
    Jiang, Ming
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 256
  • [26] Enhancing single-view 3D mesh reconstruction with the aid of implicit surface learning
    Fahim, George
    Amin, Khalid
    Zarif, Sameh
    IMAGE AND VISION COMPUTING, 2022, 119
  • [27] Generating full-view face images from a single-view image
    Zhong, Lei
    Bai, ChangMin
    Li, Jianfeng
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [28] JIFF: Jointly-aligned Implicit Face Function for High Quality Single View Clothed Human Reconstruction
    Cao, Yukang
    Chen, Guanying
    Han, Kai
    Yang, Wenqi
    Wong, Kwan-Yee K.
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 2719 - 2729
  • [29] VIPNet: A Fast and Accurate Single-View Volumetric Reconstruction by Learning Sparse Implicit Point Guidance
    Du, Dong
    Zhang, Zhiyi
    Han, Xiaoguang
    Cui, Shuguang
    Liu, Ligang
    2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, : 553 - 562
  • [30] Generating full-view face images from a single-view image
    Zhong, Lei
    Bai, ChangMin
    Li, Jianfeng
    Proceedings of the International Joint Conference on Neural Networks, 2021, 2021-July