arrow
返回

Cloth Interactive Transformer for Virtual Try-On

delete2023-12-11
delete6
delete
OA
AI
B
Bin Ren *
H
Hao Tang
F
Fanyang Meng
R
Runwei Ding
P
Philip H. S. Torr
N
Nicu Sebe
DOI:10.1145/3617374delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The 2D image-based virtual try-on has aroused increased interest from the multimedia and computer vision fields due to its enormous commercial value. Nevertheless, most existing image-based virtual try-on approaches directly combine the person-identity representation and the in-shop clothing items without taking their mutual correlations into consideration. Moreover, these methods are commonly established on pure convolutional neural networks (CNNs) architectures which are not simple to capture the long-range correlations among the input pixels. As a result, it generally results in inconsistent results. To alleviate these issues, in this article, we propose a novel two-stage cloth interactive transformer (CIT) method for the virtual try-on task. During the first stage, we design a CIT matching block, aiming at precisely capturing the long-range correlations between the cloth-agnostic person information and the in-shop cloth information. Consequently, it makes the warped in-shop clothing items look more natural in appearance. In the second stage, we put forth a CIT reasoning block for establishing global mutual interactive dependencies among person representation, the warped clothing item, and the corresponding warped cloth mask. The empirical results, based on mutual dependencies, demonstrate that the final try-on results are more realistic. Substantial empirical results on a public fashion dataset illustrate that the suggested CIT attains competitive virtual try-on performance.
Keyword:
Virtual try-on
transformer
garment transfer
cross attention

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

U
University of Trento
学者数:
8.8K
论文数: 9.0K
被引数: 1.2W
E
ETH Zurich
学者数:
3.0W
论文数: 2.4W
被引数: 8.4W
S
swiss federal institutes of technology domain
学者数:
9.0W
论文数: 8.0W
被引数: 163
P
Peng Cheng Laboratory
学者数:
1.7K
论文数: 1.8K
被引数: 2.0K
学者 查看更多机构
引用论文

引用论文

Transformers in Vision: A Survey视觉中的变形金刚: 一项调查
err2022-09-13
err1.1K
errOAAI
errKhan, Salman; Naseer, Muzammal; Hayat, Munawar; Zamir, Syed Waqas; Khan, Fahad Shahbaz; Shah, Mubarak
err分享
err收藏
Transform, Warp, and Dress: A New Transformation-guided Model for Virtual Try-on
err2022-02-16
err13
PREAI
errFincato, Matteo; Cornia, Marcella; Landi, Federico; Cesari, Fabio; Cucchiara, Rita
err分享
err收藏
Virtual Try-on Network With Attribute Transformation and Local Rendering
err2021-01-01
err12
PREAI
errXu, Jun; Pu, Yuanyuan; Nie, Rencan; Xu, Dan; Zhao, Zhengpeng; Qian, Wenhua
err分享
err收藏
Attention gated networks: Learning to leverage salient regions in medical images注意门控网络: 学习利用医学图像中的显着区域
err2019-04-01
err1.1K
errOAAI
errSchlemper, Jo; Oktay, Ozan; Schaap, Michiel; Heinrich, Mattias; Kainz, Bernhard; Glocker, Ben; Rueckert, Daniel
err分享
err收藏
Toward Multi-Modal Conditioned Fashion Image Translation
err2021-01-01
err12
errOAAI
errGu, Xiaoling; Yu, Jun; Wong, Yongkang; Kankanhalli, Mohan S.
err分享
err收藏
学者 查看更多内容