Real-time Image-based Virtual Try-on with Measurement Garment

Virtual try-on technology that replaces a customer's wearing with arbitrary garments can significantly improve the online cloth shopping experience [anonymous 2021; Han et al. 2018; Yang et al. 2020]. In this work, we present a real-time image-based virtual try-on system composed of two parts, i.e., photo-realistic clothed person image synthesis for the customers to experience the try-on result and garment capturing for the retailers to capture the rich deformations of the target garment. Distinguished from previous image-based virtual try-on works, we formulate the problem as a supervised image-to-image translation problem using a measurement garment, and we capture the training data with a custom actuated mannequin.