arrow
Return

Cofopose: Conditional 2D Pose Estimation with Transformers

delete2022-09-09
delete3
delete
OA
AI
E
Evans Aidoo
X
Xun Wang *
Z
Zhenguang Liu
E
Edwin Kwadwo Tenagyei
K
Kwabena Owusu‐Agyemang
S
Seth Larweh Kodjiku
V
Victor Nonso Ejianya
E
Esther Stacy E. B. Aggrey
DOI:10.3390/s22186821delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Human pose estimation has long been a fundamental problem in computer vision and artificial intelligence. Prominent among the 2D human pose estimation (HPE) methods are the regression-based approaches, which have been proven to achieve excellent results. However, the ground-truth labels are usually inherently ambiguous in challenging cases such as motion blur, occlusions, and truncation, leading to poor performance measurement and lower levels of accuracy. In this paper, we propose Cofopose, which is a two-stage approach consisting of a person and keypoint detection transformers for 2D human pose estimation. Cofopose is composed of conditional cross-attention, a conditional DEtection TRansformer (conditional DETR), and an encoder-decoder in the transformer framework; this allows it to achieve person and keypoint detection. In a significant departure from other approaches, we use conditional cross-attention and fine-tune conditional DETR for our person detection, and encoder-decoders in the transformers for our keypoint detection. Cofopose was extensively evaluated using two benchmark datasets, MS COCO and MPII, achieving an improved performance with significant margins over the existing state-of-the-art frameworks.
Keywords:
DETR
human pose estimation
conditional DETR
convolutional neural network (CNN)
detection
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Sensors cover
Sensors
IF:
3.5
Papers:
7.1W
Citations:
20.9W

Organization

Z
Zhejiang Gongshang University
Scholars:
6.6K
Papers: 4.9K
Citations: 8.1K