Revolutionizing online shopping with FITMI: a realistic virtual try-on solution

被引:0
|
作者
Tassneam M. Samy [1 ]
Beshoy I. Asham [1 ]
Salwa O. Slim [1 ]
Amr A. Abohany [2 ]
机构
[1] Helwan University,Department of Computer Science, Faculty of Computers and Artificial Intelligence
[2] Damanhour University,Department of Information Systems, Faculty of Computers and Information
[3] Kafrelsheikh University,Department of Information Systems, Faculty of Computers and Information
关键词
FITMI virtual try-on; Generative architectures; Latent diffusion models;
D O I
10.1007/s00521-024-10843-6
中图分类号
学科分类号
摘要
In today’s digital age, consumers increasingly rely on online shopping for convenience and accessibility. However, a significant drawback of online shopping is the inability to physically try on clothing before purchasing. This limitation often leads to uncertainty regarding fit and style, resulting in customer post-purchase dissatisfaction and higher return rates. Research indicates that online items are three times more likely to be returned than in-store ones, especially during the pandemic. To address this challenge, we propose a virtual try-on method called FITMI, an enhanced Latent Diffusion Textual Inversion model for virtual try-on purposes. The proposed architecture aims to bridge the gap between traditional in-store try-ons and online shopping by offering users a realistic and interactive virtual try-on experience. Although virtual try-on solutions already exist, recent advancements in artificial intelligence have significantly enhanced their capabilities, enabling more sophisticated and realistic virtual try-on experiences than ever before. Building on these advancements, FITMI surpasses ordinary virtual try-ons relying on generative adversarial networks, often producing unrealistic outputs. Instead, FITMI utilizes latent diffusion models to generate high-quality images with detailed textures. As a web application, FITMI facilitates virtual try-ons by seamlessly integrating images of users with garments from catalogs, providing a true-to-life representation of how the items would look. This approach differentiates us from competitors. FITMI is validated using two widely recognized benchmarks: the Dress-Code and Viton-HD datasets. Additionally, FITMI acts as a trusted style advisor, enhancing the shopping experience by recommending complementary items to elevate the chosen garment and suggesting similar options based on user preferences.
引用
收藏
页码:6125 / 6144
页数:19
相关论文
共 50 条
  • [1] Adoption of virtual try-on technology for online apparel shopping
    Kim, Jiyeon
    Forsythe, Sandra
    JOURNAL OF INTERACTIVE MARKETING, 2008, 22 (02) : 45 - 59
  • [2] Demo: On-Device Video Virtual Try-On for Mobile Shopping
    Ahn, Dongha
    Kang, Dong-Sig
    Baek, Eunsu
    Kim, Hyung-Sin
    PROCEEDINGS OF THE 2024 THE 22ND ANNUAL INTERNATIONAL CONFERENCE ON MOBILE SYSTEMS, APPLICATIONS AND SERVICES, MOBISYS 2024, 2024, : 610 - 611
  • [3] Disentangled Cycle Consistency for Highly-realistic Virtual Try-On
    Ge, Chongjian
    Song, Yibing
    Ge, Yuying
    Yang, Han
    Liu, Wei
    Luo, Ping
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 16923 - 16932
  • [4] Augmented Shopping: Virtual Try-On Applications in Eyewear E-retail
    Konarzewski, Bianca
    Reiner, Michael
    SYSTEMS, SOFTWARE AND SERVICES PROCESS IMPROVEMENT, EUROSPI 2023, PT II, 2023, 1891 : 289 - 299
  • [5] MIRROR: Towards Generalizable On-Device Video Virtual Try-On for Mobile Shopping
    Kang, Dong-Sig
    Baek, Eunsu
    Son, Sungwook
    Lee, Youngki
    Gong, Taesik
    Kim, Hyung-Sin
    PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2023, 7 (04):
  • [6] Avatar personalisation vs. privacy in a virtual try-on app for apparel shopping
    Ivanov, Alex
    Mou, Yi
    Tawira, Letwin
    INTERNATIONAL JOURNAL OF FASHION DESIGN TECHNOLOGY AND EDUCATION, 2023, 16 (01) : 100 - 109
  • [7] Toward Realistic Virtual Try-on Through Landmark-Guided Shape Matching
    Liu, Guoqiang
    Song, Dan
    Tong, Ruofeng
    Tang, Min
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2118 - 2126
  • [8] Towards Realistic Virtual Try-on for E-commerce by Sewing Pattern Estimation
    Matsushita, Nisho
    Sugiura, Shota
    Arai, Kohei
    PROCEEDINGS OF SIGGRAPH 2023 POSTERS, SIGGRAPH 2023, 2023,
  • [9] A Flow-Based Generative Network for Photo-Realistic Virtual Try-on
    Wang, Tao
    Gu, Xiaoling
    Zhu, Junkai
    IEEE ACCESS, 2022, 10 : 40899 - 40909
  • [10] SVTON: Simplified Virtual Try-On
    Islam, Tasin
    Miron, Alina
    Liu, XiaoHui
    Li, Yongmin
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 369 - 374