arrow
Return

Weakly supervised 2D human pose transfer

delete2021-10-26
delete0
PRE
AI
Q
Qian Zheng
Y
Yajie Liu
Z
Zhizhao Lin
D
Dani Lischinski
D
Daniel Cohen‐Or
H
Hui Huang *
DOI:10.1007/s11432-021-3301-5delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We present a novel method for pose transfer between two 2D human skeletons. When the bone lengths and proportions between the two skeletons are significantly different, pose transfer becomes a challenging task, which cannot be accomplished by simply copying the joint positions or the bone directions. Our data-driven approach utilizes a deep neural network trained, in a weakly supervised fashion, to encode a skeleton into two separate latent codes, one representing its pose, and another representing the skeleton's proportions (skeleton-ID). The network is given two skeletons, and learns to combine the pose of one with the skeleton-ID of the other. Lacking supervision on the poses, we develop a novel loss that qualitatively compares poses of different skeletons. We evaluate the performance of our method on a large set of poses. The advantages of avoiding supervision are demonstrated by showing transfer of extreme poses, as well as between uncommon skeleton proportions.
Keywords:
pose transfer
weak supervision
human skeleton
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Science China Information Sciences cover
Science China Information Sciences
IF:
7.6
Papers:
4.9K
Citations:
8.9K

Organization

S
shenzhen university
Scholars:
4.6W
Papers: 3.4W
Citations: 72
H
Hebrew University of Jerusalem
Scholars:
2.8W
Papers: 2.3W
Citations: 2.7W
Cited Papers

Cited Papers

Skeleton-Aware Networks for Deep Motion Retargeting
err2020-08-12
err99
errOAAI
errAberman, Kfir; Li, Peizhuo; Lischinski, Dani; Sorkine-Hornung, Olga; Cohen-Or, Daniel; Chen, Baoquan
errShare
errSave
A cohort study of tobacco use, diet, occupation, and lung cancer mortality
err1992-05-01
err0
PREAI
errWong-Ho Chow; Leonard M. Schuman; Joseph K. McLaughlin; Erik Bjelke; Gloria Gridley; Sholom Wacholder; Harvey T. Co Chien; William J. Blot
errShare
errSave
Photoacoustic Imaging With a Commercial Ultrasound System and a Custom Probe
err2011-03-01
err0
errOAAI
errXueding Wang; J. Brian Fowlkes; Jonathan M. Cannata; Changhong Hu; Paul L. Carson
errShare
errSave
Cold acclimation reduces hepatic protein Kinase B and AMP-activated protein kinase phosphorylation and increases gluconeogenesis in Rats
err2018-03-04
err0
errOAAI
errDiane M. Sepa-Kishi; Glen Katsnelson; George Bikopoulos; Ayesha Iqbal; Rolando B. Ceddia
errShare
errSave
Use of a soil moisture network for drought monitoring in the Czech Republic
err2011-06-09
err0
PREAI
errMartin Mozny; Mirek Trnka; Zdenek Zalud; Petr Hlavinka; Jiri Nekovar; Vera Potop; Michal Virag
errShare
errSave
researcher View more