arrow
返回

Pose- and Attribute-consistent Person Image Synthesis

delete2023-02-17
delete8
delete
OA
AI
C
Cheng Xu
J
Jiajie Mai
徐
徐雪妙 (Xuemiao Xu) *
S
Shengfeng He *
DOI:10.1145/3554739delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Person Image Synthesis aims at transferring the appearance of the source person image into a target pose. Existing methods cannot handle large pose variations and therefore suffer from two critical problems: (1) synthesis distortion due to the entanglement of pose and appearance information among different body components and (2) failure in preserving original semantics (e.g., the same outfit). In this article, we explicitly address these two problems by proposing a Pose- and Attribute-consistent Person Image Synthesis Network (PAC-GAN). To reduce pose and appearance matching ambiguity, we propose a component-wise transferring model consisting of two stages. The former stage focuses only on synthesizing target poses, while the latter renders target appearances by explicitly transferring the appearance information from the source image to the target image in a component-wise manner. In this way, source-target matching ambiguity is eliminated due to the component-wise disentanglement of pose and appearance synthesis. Second, to maintain attribute consistency, we represent the input image as an attribute vector and impose a high-level semantic constraint using this vector to regularize the target synthesis. Extensive experimental results on the DeepFashion dataset demonstrate the superiority of our method over the state of the art, especially for maintaining pose and attribute consistencies under large pose variations.
Keyword:
Image synthesis
image editing
pose transfer
generative adversarial network

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
引用论文

引用论文

Robust and Efficient Graph Correspondence Transfer for Person Re-Identification
err2021-01-01
err13
errOAAI
errZhou, Qin; Fan, Heng; Yang, Hua; Su, Hang; Zheng, Shibao; Wu, Shuang; Ling, Haibin
err分享
err收藏
Apolipoprotein J/Clusterin Is a Novel Structural Component of Human Erythrocytes and a Biomarker of Cellular Stress and Senescence
err2011-10-06
err0
errOAAI
errMarianna H. Antonelou; Anastasios G. Kriebardis; Konstantinos E. Stamoulis; Ioannis P. Trougakos; Issidora S. Papassideri
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
WHY URBAN GEOCHEMISTRY?
err2012-12-28
err0
PREAI
errW. B. Lyons; R. S. Harmon
err分享
err收藏
PoNA: Pose-Guided Non-Local Attention for Human Pose Transfer
err2020-01-01
err39
errOAAI
errLi, Kun; Zhang, Jinsong; Liu, Yebin; Lai, Yu-Kun; Dai, Qionghai
err分享
err收藏
err分享
err收藏
没有更多内容