arrow
返回

Keypoint-based contextual representations for hand pose estimation

delete2023-09-14
delete0
PRE
AI
李玮玮 封面图
李玮玮 (Weiwei Li) *
R
Rong Du
陈曙东 封面图
陈曙东 (Shudong Chen)
DOI:10.1007/s11042-023-15713-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Most current methods for the hand pose estimation ignore the pixel-level relationship of hand keypoints, e.g. four specific keypoints in the same finger can form a semantically continuous area at pixel level. To make full use of pixel-level semantic information extracted from the origin RGB image, we propose a novel keypoint-based contextual representation(KCR) scheme for hand pose estimation, which can leverage pixel-level continuous contextual features based on the hand structure without using any additional labeling information. To extract hand structure information from the contextual features, we creatively design a novel keypoint representation and finger representation scheme by fusing the keypoints feature in a specific group. Then, the cross-attention mechanism is used to calculate the relation between the finger representations and contextual features to improve the feature integration. The augmented feature contains more hand structure information for the final hand pose estimation. Experimental results demonstrate that our method achieves competitive performance on various 2D and 3D hand pose estimation benchmarks.
Keyword:
Hand pose estimation
Gesture recognition
Relational context
Keypoint heatmap
Object Detection

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
2.0W
被引数:
3.2W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
err分享
err收藏
P250 Elevated faecal calprotectin predicts disease progression in Crohn's disease
err2013-02-01
err0
errOAAI
errN.A. Kennedy; J. Chang; M.H. Guy; T. Smith; J.T. Loh; D. Haunschmidt; M. Muscat; F. Fascí Spurio; H.E. Drummond; K. Kingstone; C.L. Noble; A.G. Shand; J. Satsangi; I.D. Arnott; C.W. Lees
err分享
err收藏
Characteristics of headache in relation to the manifestation of Susac syndrome
err2017-01-01
err0
errOAAI
errDiana Obelienienė; Raminta Macaitytė; Renata Balnytė; Rūta Pėstininkaitė; Rymantė Gleiznienė; Jūratė Balčiūnienė
err分享
err收藏
Experimental investigations of the microscale concentrated photovoltaic/thermal system based on a solar parabolic trough concentrator
err2023-07-01
err0
errOAAI
errKrzysztof Sornek; Maciej Żołądek; Karolina Papis-Frączek; Maciej Szram; Mariusz Filipowicz
err分享
err收藏
学者 查看更多内容