arrow
Return

Exploiting spatio-temporal representation for 3D human action recognition from depth map sequences

delete2021-09-01
delete29
delete
OA
AI
X
Xiaopeng Ji
Q
Qingsong Zhao
J
Jun Cheng *
C
Chenfei Ma
DOI:10.1016/j.knosys.2021.107040delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Human action recognition based on 3D data is attracting increasing attention because it could provide more abundant spatial and temporal information compared with RGB videos. The challenge of the depth map based method is to capture the cues between spatial appearances and temporal motions. In this paper, we propose a straightforward and efficient framework for modeling the human action based on depth map sequences, considering the short-term and long-term dependencies. A frame-level feature, termed depth-oriented gradient vector (DOGV), is developed to capture the appearance and motion in a short-term duration. For a long-term dependence, we construct convolutional neural networks (CNNs) based backbone to aggregate frame-level features in the space and time sequence. The proposed method is comprehensively evaluated on four public benchmark datasets, including NTU RGB+D, NTU RGB+D 120, PKU-MMD and UOW LSC. The experimental results demonstrate that the proposed approach can solve the problem of 3D human action recognition in an efficient way and achieve the state-of-the-art performance. (C) 2021 Elsevier B.V. All rights reserved.
Keywords:
3D human action recognition
Depth map sequences
Short-term modeling
Depth-oriented gradient vector
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

S
shenzhen institute of advanced technology, cas
Scholars:
5.6K
Papers: 4.5K
Citations: 7
C
chinese academy of sciences
Scholars:
56.5W
Papers: 44.9W
Citations: 704
Z
zhejiang university
Scholars:
17.6W
Papers: 12.1W
Citations: 152
researcher View more organizations