arrow
返回

Pattern-Based Cloth Registration and Sparse-View Animation

delete2022-11-30
delete8
PRE
AI
T
Tuur Stuyck
D
Donglai Xiang
T
Timur Bagautdinov
R
Ron Kimmel
T
Takaaki Shiratori
C
Chenglei Wu
Y
Yaser Sheikh
F
Fabián Prada
DOI:10.1145/3550454.3555448delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We propose a novel multi-view camera pipeline for the reconstruction and registration of dynamic clothing. Our proposed method relies on a specifically designed pattern that allows for precise video tracking in each camera view. We triangulate the tracked points and register the cloth surface in a fine-grained geometric resolution and low localization error. Compared to state-of-the-art methods, our registration exhibits stable correspondence, tracking the same points on the deforming cloth surface along the temporal sequence. As an application, we demonstrate how the use of our registration pipeline greatly improves state-of-the-art pose-based drivable cloth models. Furthermore, we propose a novel model, Garment Avatar, for driving cloth from a dense tracking signal which is obtained from two opposing camera views. The method produces realistic reconstructions which are faithful to the actual geometry of the deforming cloth. In this setting, the user wears a garment with our custom pattern which enables our driving model to reconstruct the geometry. Our code and data are available at https://github.com/HalimiOshri/Pattern-Based-Cloth-Registration-and-Sparse-View-Animation . The released data includes our pattern and registered mesh sequences containing four different subjects and 15k frames in total.
Keyword:
Garment Capture
Telepresence
Virtual Clothing
Machine Learning
Computer Vision
Registration
Cloth Animation

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.8K
被引数:
3.6W

机构

C
Carnegie Mellon University
学者数:
1.4W
论文数: 1.4W
被引数: 2.7W
T
Technion Israel Institute of Technology
学者数:
1.6W
论文数: 1.5W
被引数: 2.0W
引用论文

引用论文

SMPL: A Skinned Multi-Person Linear ModelSMPL: 一个蒙皮的多人线性模型
err2015-10-26
err2.5K
PREAI
errLoper, Matthew; Mahmood, Naureen; Romero, Javier; Pons-Moll, Gerard; Black, Michael J.
err分享
err收藏
err分享
err收藏
β-Adrenergic Receptor in Heart of Starved Rats
err1987-01-01
err0
errOAAI
errKOJI NAKAGAWA; MIYAO MATSUBARA; KAZUMASA AKIKAWA; MITSUMASA KUBO
err分享
err收藏
A geometric approach to robotic laundry folding
err2011-12-20
err181
PREAI
errMiller, Stephen; van den Berg, Jur; Fritz, Mario; Darrell, Trevor; Goldberg, Ken; Abbeel, Pieter
err分享
err收藏
A Resonant-Repetitive Control Scheme Applied to Uninterruptible Power Supplies (UPS)
err2013-04-17
err0
PREAI
errAurélio Tergolina Salton; Jeferson Vieira Flores; Luís Fernando Alves Pereira; Daniel Ferreira Coutinho
err分享
err收藏
err分享
err收藏
LiveCap: Real-Time Human Performance Capture From Monocular Video4LiveCap: 从单目Video4实时捕捉人类表现
err2019-03-13
err166
PREAI
errHabermann, Marc; Xu, Weipeng; Zollhofer, Michael; Pons-Moll, Gerard; Theobalt, Christian
err分享
err收藏
学者 查看更多内容