arrow
Return

Virtual Try-on Network With Attribute Transformation and Local Rendering

delete2021-01-01
delete12
PRE
AI
J
Jun Xu
普园媛 cover
普园媛 (Yuanyuan Pu) *
聂仁灿 cover
聂仁灿 (Rencan Nie)
D
Dan Xu
Z
Zhengpeng Zhao
W
Wenhua Qian
DOI:10.1109/TMM.2021.3070972delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
A virtual try-on network has gradually become a popular topic in recent years. It aims to transfer images of in-shop clothes onto the image of a target person. Owing to the diversity of clothing attributes, developing an image-based virtual try-on network is a complicated task for computers to perform and requires significant effort. Existing methods are unsatisfactory as they cannot preserve the characteristics of the clothes or the target person's identity well, thereby affecting the perception of the generated images; therefore, further research is required. To address this problem, we propose a novel try-on method that combines attribute transformation and local rendering. First, we employ pixel-level semantic segmentation to identify the try-on area and provide implementation conditions for local rendering. Second, we construct a learnable attribute transformation module to complete the try-on task for different attributes. Third, we use a learnable clothing warping module to fit the pose and figure of the target person well and establish a novel loss function, called modified style loss (M-SL), to handle clothes with rich details. Finally, we adopt a local rendering strategy, using which only renders the clothing area to ensure that the details of the non-target area are not lost. Extensive experiments are performed to test our method. The results demonstrate that our method outperforms other state-of-the-art methods.
Keywords:
Clothing
Rendering (computer graphics)
Three-dimensional displays
Task analysis
Two dimensional displays
Shape
Gallium nitride
Attribute transformation
computer vision
generative adversarial networks
local rendering
semantic segmentation
virtual try-on
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

Y
Yunnan University
Scholars:
1.6W
Papers: 9.9K
Citations: 13