arrow
返回

GLPose: Global-Local Representation Learning for Human Pose Estimation

delete2022-10-06
delete5
PRE
AI
Y
Yingying Jiao
H
Haipeng Chen *
R
Runyang Feng *
H
Haoming Chen
S
Sifan Wu
Y
Yifang Yin
Z
Zhenguang Liu
DOI:10.1145/3519305delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-frame human pose estimation is at the core of many computer vision tasks. Although state-of-the-art approaches have demonstrated remarkable results for human pose estimation on static images, their performances inevitably come short when being applied to videos. A central issue lies in the visual degeneration of video frames induced by rapid motion and pose occlusion in dynamic environments. This problem, by nature, is insurmountable for a single frame. Therefore, incorporating complementary visual cues from other video frames becomes an intuitive paradigm. Current state-of-the-art methods usually leverage information from adjacent frames, which unfortunately place excessive focus on only the temporally nearby frames. In this paper, we argue that combining global semantically similar information and local temporal visual context will deliver more comprehensive and more robust representations for human pose estimation. Towards this end, we present an effective framework, namely global-local enhanced pose estimation (GLPose) network. Our framework consists of a feature processing module that conditionally incorporates global semantic information and local visual context to generate a robust human representation and a feature enhancement module that excavates complementary information from this aggregated representation to enhance keyframe features for precise estimation. We empirically find that the proposed GLpose outperforms existing methods by a large margin and achieves new state-of-the-art results on large benchmark datasets.
Keyword:
Human pose estimation
feature aggregation
pose estimation
global-local representation

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

Z
Zhejiang Gongshang University
学者数:
6.6K
论文数: 4.9K
被引数: 8.1K
A
a*star - institute for infocomm research (i2r)
学者数:
869
论文数: 880
被引数: 1
A
agency for science technology & research (a*star)
学者数:
2.2W
论文数: 1.9W
被引数: 57
J
Jilin University
学者数:
8.7W
论文数: 5.6W
被引数: 8.9K
学者 查看更多机构
引用论文

引用论文

Discovery of compounds that protect tyrosine hydroxylase activity through different mechanisms
err2015-09-01
err0
PREAI
errMagnus Hole; Jarl Underhaug; Hector Diez; Ming Ying; Åsmund Kjendseth Røhr; Ana Jorge-Finnigan; Noèlia Fernàndez-Castillo; Angels García-Cazorla; K. Kristoffer Andersson; Knut Teigen; Aurora Martinez
err分享
err收藏
Liver transection using vascular stapler: a review
errHPB
IF0
err2008-08-01
err0
errOAAI
errPeter Schemmer; Helge Bruns; Jürgen Weitz; J.A.N. Schmidt; Markus W. Büchler
err分享
err收藏
err分享
err收藏
学者 查看更多内容