arrow
Return

Pattern-Based Cloth Registration and Sparse-View Animation

delete2022-11-30
delete8
PRE
AI
T
Tuur Stuyck
D
Donglai Xiang
T
Timur Bagautdinov
R
Ron Kimmel
T
Takaaki Shiratori
C
Chenglei Wu
Y
Yaser Sheikh
F
Fabián Prada
DOI:10.1145/3550454.3555448delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose a novel multi-view camera pipeline for the reconstruction and registration of dynamic clothing. Our proposed method relies on a specifically designed pattern that allows for precise video tracking in each camera view. We triangulate the tracked points and register the cloth surface in a fine-grained geometric resolution and low localization error. Compared to state-of-the-art methods, our registration exhibits stable correspondence, tracking the same points on the deforming cloth surface along the temporal sequence. As an application, we demonstrate how the use of our registration pipeline greatly improves state-of-the-art pose-based drivable cloth models. Furthermore, we propose a novel model, Garment Avatar, for driving cloth from a dense tracking signal which is obtained from two opposing camera views. The method produces realistic reconstructions which are faithful to the actual geometry of the deforming cloth. In this setting, the user wears a garment with our custom pattern which enables our driving model to reconstruct the geometry. Our code and data are available at https://github.com/HalimiOshri/Pattern-Based-Cloth-Registration-and-Sparse-View-Animation . The released data includes our pattern and registered mesh sequences containing four different subjects and 15k frames in total.
Keywords:
Garment Capture
Telepresence
Virtual Clothing
Machine Learning
Computer Vision
Registration
Cloth Animation

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

C
Carnegie Mellon University
Scholars:
1.4W
Papers: 1.4W
Citations: 2.7W
T
Technion Israel Institute of Technology
Scholars:
1.6W
Papers: 1.5W
Citations: 2.0W
Cited Papers

Cited Papers

SMPL: A Skinned Multi-Person Linear Model
err2015-10-26
err2.5K
PREAI
errLoper, Matthew; Mahmood, Naureen; Romero, Javier; Pons-Moll, Gerard; Black, Michael J.
errShare
errSave
errShare
errSave
β-Adrenergic Receptor in Heart of Starved Rats
err1987-01-01
err0
errOAAI
errKOJI NAKAGAWA; MIYAO MATSUBARA; KAZUMASA AKIKAWA; MITSUMASA KUBO
errShare
errSave
A geometric approach to robotic laundry folding
err2011-12-20
err181
PREAI
errMiller, Stephen; van den Berg, Jur; Fritz, Mario; Darrell, Trevor; Goldberg, Ken; Abbeel, Pieter
errShare
errSave
A Resonant-Repetitive Control Scheme Applied to Uninterruptible Power Supplies (UPS)
err2013-04-17
err0
PREAI
errAurélio Tergolina Salton; Jeferson Vieira Flores; Luís Fernando Alves Pereira; Daniel Ferreira Coutinho
errShare
errSave
errShare
errSave
LiveCap: Real-Time Human Performance Capture From Monocular Video4
err2019-03-13
err166
PREAI
errHabermann, Marc; Xu, Weipeng; Zollhofer, Michael; Pons-Moll, Gerard; Theobalt, Christian
errShare
errSave
researcher View more