Revolutionizing online shopping with FITMI: a realistic virtual try-on solution

被引:0
|
作者
Tassneam M. Samy [1 ]
Beshoy I. Asham [1 ]
Salwa O. Slim [1 ]
Amr A. Abohany [2 ]
机构
[1] Helwan University,Department of Computer Science, Faculty of Computers and Artificial Intelligence
[2] Damanhour University,Department of Information Systems, Faculty of Computers and Information
[3] Kafrelsheikh University,Department of Information Systems, Faculty of Computers and Information
关键词
FITMI virtual try-on; Generative architectures; Latent diffusion models;
D O I
10.1007/s00521-024-10843-6
中图分类号
学科分类号
摘要
In today’s digital age, consumers increasingly rely on online shopping for convenience and accessibility. However, a significant drawback of online shopping is the inability to physically try on clothing before purchasing. This limitation often leads to uncertainty regarding fit and style, resulting in customer post-purchase dissatisfaction and higher return rates. Research indicates that online items are three times more likely to be returned than in-store ones, especially during the pandemic. To address this challenge, we propose a virtual try-on method called FITMI, an enhanced Latent Diffusion Textual Inversion model for virtual try-on purposes. The proposed architecture aims to bridge the gap between traditional in-store try-ons and online shopping by offering users a realistic and interactive virtual try-on experience. Although virtual try-on solutions already exist, recent advancements in artificial intelligence have significantly enhanced their capabilities, enabling more sophisticated and realistic virtual try-on experiences than ever before. Building on these advancements, FITMI surpasses ordinary virtual try-ons relying on generative adversarial networks, often producing unrealistic outputs. Instead, FITMI utilizes latent diffusion models to generate high-quality images with detailed textures. As a web application, FITMI facilitates virtual try-ons by seamlessly integrating images of users with garments from catalogs, providing a true-to-life representation of how the items would look. This approach differentiates us from competitors. FITMI is validated using two widely recognized benchmarks: the Dress-Code and Viton-HD datasets. Additionally, FITMI acts as a trusted style advisor, enhancing the shopping experience by recommending complementary items to elevate the chosen garment and suggesting similar options based on user preferences.
引用
收藏
页码:6125 / 6144
页数:19
相关论文
共 50 条
  • [41] A Mixed Reality Virtual Clothes Try-On System
    Yuan, Miaolong
    Khan, Ishtiaq Rasool
    Farbiz, Farzam
    Yao, Susu
    Niswar, Arthur
    Foo, Min-Hui
    IEEE TRANSACTIONS ON MULTIMEDIA, 2013, 15 (08) : 1958 - 1968
  • [42] Image-Based Virtual Try-On: A Survey
    Song, Dan
    Zhang, Xuanpu
    Zhou, Juan
    Nie, Weizhi
    Tong, Ruofeng
    Kankanhalli, Mohan
    Liu, An-An
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, : 2692 - 2720
  • [43] FashionTex: Controllable Virtual Try-on with Text and Texture
    Lin, Anran
    Zhao, Nanxuan
    Ning, Shuliang
    Qiu, Yuda
    Wang, Baoyuan
    Han, Xiaoguang
    PROCEEDINGS OF SIGGRAPH 2023 CONFERENCE PAPERS, SIGGRAPH 2023, 2023,
  • [44] Virtual Try-On Considering Temporal Consistency for Videoconferencing
    Shimizu, Daiki
    Yanai, Keiji
    MULTIMEDIA MODELING, MMM 2023, PT II, 2023, 13834 : 758 - 763
  • [45] Virtual Try-On: How to Enhance Consumer Experience?
    Bialkova, Svetlana
    Barr, Chloe
    2022 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS (VRW 2022), 2022, : 244 - 251
  • [46] Try On, Spied On?: Privacy Analysis of Virtual Try-On Websites and Android Apps
    Ragab, Abdelrahman
    Mannan, Mohammad
    Youssef, Amr
    COMPUTER SECURITY. ESORICS 2023 INTERNATIONAL WORKSHOPS, PT I, 2024, 14398 : 232 - 248
  • [47] Virtual Measurement Garment for Per-Garment Virtual Try-On
    Wu, Zaiqiang
    Liu, Jingyuan
    Chong, Toby
    Shen, I-Chao
    Igarashi, Takeo
    PROCEEDINGS OF THE 50TH GRAPHICS INTERFACE CONFERENCE, GI 2024, 2024,
  • [48] REALISTIC MONOCULAR-TO-3D VIRTUAL TRY-ON VIA MULTI-SCALE CHARACTERISTICS CAPTURE
    Du, Chenghu
    Yu, Feng
    Jiang, Minghua
    Zhao, Yaxin
    Wei, Xiong
    Peng, Tao
    Hu, Xinrong
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1735 - 1739
  • [49] Virtual Product Try-On Solution for E-Commerce Using Mobile Augmented Reality
    Welivita, Anuradha
    Nimalsiri, Nanduni
    Wickramasinghe, Ruchiranga
    Pathirana, Upekka
    Gamage, Chandana
    AUGMENTED REALITY, VIRTUAL REALITY, AND COMPUTER GRAPHICS, AVR 2017, PT I, 2017, 10324 : 438 - 447
  • [50] Self-supervised feature matched virtual try-on
    Jiang, Shiyi
    Xu, Yang
    Li, Danyang
    Fan, Runze
    JOURNAL OF COMPUTATIONAL DESIGN AND ENGINEERING, 2023, 10 (05) : 1958 - 1969