The rapid construction method of human body model for virtual try-on on mobile terminal based on MDD-Net

被引:3
|
作者
Fang, Naiyu [1 ]
Qiu, Lemiao [1 ]
Zhang, Shuyou [1 ]
Wang, Zili [1 ]
Gu, Ye [1 ]
Hu, Kerui [1 ]
机构
[1] Zhejiang Univ, State Key Lab Fluid Power Transmiss Control, Hangzhou 310027, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Human body shape estimation; Fuzzy anthropometric feature; Multi-perspective silhouette feature; Virtual try-on; MDD-Net; SHAPE; BODIES;
D O I
10.1007/s00500-022-07464-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Traditional anthropometric evaluation needs professional measuring tools and operations, and it is time-consuming, expensive, and not suitable for virtual try-on. As the mobile internet develops, the issue of human body reconstruction toward virtual try-on needs to be tackled. This paper proposes a rapid human body reconstruction method for virtual try-on based on multidimensional dense net (MDD-Net) on mobile terminal. MDD-Net takes fusion features as input and predicts 3D human body model. The acquisition of fusion features and the display of 3D human body are implemented on mobile toward virtual try-on. In the learning fuzzy anthropometric feature module, the example-guided fuzzy anthropometric feature matrix is acquired and default coding elements are interpolated. In the learning multi-perspective silhouette feature module, the fine human body shape features are learned based on DenseNet201. A related fusion feature data set is generated for the training and testing of MDD-Net. Compared to shape pose estimation models, the shape representation spaces of HMR and SMPLify are only 20.34% and 7.59% of our method, and their prediction accuracies are approximately 50% of our method. Compared to accurate shape estimation models, our method is more robust against the pose and perspective noise. The prediction accuracies of our method are improved by 13.34%, 55.77%, 34.6%, and 43.4%, 37.2% 9.0% on four test sets. Extensive experiments have demonstrated the superiority of our method for human body shape estimation toward virtual try-on.
引用
收藏
页码:12023 / 12039
页数:17
相关论文
共 3 条
  • [1] The rapid construction method of human body model for virtual try-on on mobile terminal based on MDD-Net
    Naiyu Fang
    Lemiao Qiu
    Shuyou Zhang
    Zili Wang
    Ye Gu
    Kerui Hu
    Soft Computing, 2022, 26 : 12023 - 12039
  • [2] An Example-based Human Body Modeling Method for Virtual Try-on System
    Jiang, Yan
    Ma, Kai
    PROCEEDINGS OF THE 2014 INTERNATIONAL CONFERENCE ON MECHATRONICS, ELECTRONIC, INDUSTRIAL AND CONTROL ENGINEERING, 2014, 5 : 335 - 339
  • [3] Incorporating Human Body Shape Guidance for Cloth Warping in Model to Person Virtual Try-on Problems
    Roy, Debapriya
    Santra, Sanchayan
    Chanda, Bhabatosh
    2020 35TH INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2020,