arrow
返回

Weakly-supervised pre-training for 3D human pose estimation via perspective knowledge

delete2023-07-01
delete13
delete
OA
AI
K
Kai Qiu
傅建龙 封面图
傅建龙 (Jianlong Fu)
D
Dongmei Fu *
DOI:10.1016/j.patcog.2023.109497delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Modern deep learning-based 3D pose estimation approaches require plenty of 3D pose annotations. How-ever, existing 3D datasets lack diversity, which limits the performance of current methods and their gen-eralization ability. Although existing methods utilize 2D pose annotations to help 3D pose estimation, they mainly focus on extracting 2D structural constraints from 2D poses, ignoring the 3D information hidden in the images. In this paper, we propose a novel method to extract weak 3D information di-rectly from 2D images without 3D pose supervision. Firstly, we utilize 2D pose annotations and perspec-tive prior knowledge to generate the relative depth of human joints. Then, we collect a 2D pose dataset (MCPC) and generate relative depth labels. Based on MCPC, we propose a weakly-supervised pre-training (WSP) strategy to distinguish the depth relationship between two points in an image. WSP enables the learning of the relative depth of two keypoints on lots of in-the-wild images, which is more capable of predicting depth and generalization ability for 3D human pose estimation. After fine-tuning the pose model on 3D pose datasets, WSP achieves state-of-the-art results on two widely-used benchmarks.(c) 2023 Elsevier Ltd. All rights reserved.
Keyword:
Human pose estimation
Pre -training
Relative depth
Weakly -supervised
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

M
Microsoft Research Asia
学者数:
421
论文数: 407
被引数: 2
引用论文

引用论文

Evolution of ungulate mating systems: Integrating social and environmental factors
err2020-04-15
err0
errOAAI
errR. Terry Bowyer; Dale R. McCullough; Janet L. Rachlow; Simone Ciuti; Jericho C. Whiting
err分享
err收藏
Multimodal Deep Autoencoder for Human Pose Recovery
err2015-12-01
err520
PREAI
errHong, Chaoqun; Yu, Jun; Wan, Jian; Tao, Dacheng; Wang, Meng
err分享
err收藏
XNect: Real-time Multi-Person 3D Motion Capture with a Single RGB Camera
err2020-08-12
err207
errOAAI
errMehta, Dushyant; Sotnychenko, Oleksandr; Mueller, Franziska; Xu, Weipeng; Elgharib, Mohamed; Fua, Pascal; Seidel, Hans-Peter; Rhodin, Helge; Pons-Moll, Gerard; Theobalt, Christian
err分享
err收藏
Single image based 3D human pose estimation via uncertainty learning
err2022-12-01
err21
PREAI
errHan, Chuchu; Yu, Xin; Gao, Changxin; Sang, Nong; Yang, Yi
err分享
err收藏
3D pose estimation and future motion prediction from 2D images基于2D图像的3D姿态估计和未来运动预测
err2022-04-01
err13
errOAAI
errYang, Ji; Ma, Youdong; Zuo, Xinxin; Wang, Sen; Gong, Minglun; Cheng, Li
err分享
err收藏
2-D Skeleton-Based Action Recognition via Two-Branch Stacked LSTM-RNNs
err2020-10-01
err57
PREAI
errAvola, Danilo; Cascio, Marco; Cinque, Luigi; Foresti, Gian Luca; Massaroni, Cristiano; Rodola, Emanuele
err分享
err收藏
err分享
err收藏
学者 查看更多内容