arrow
Return

Tensor-based linear dynamical systems for action recognition from 3D skeletons

delete2018-05-01
delete36
PRE
AI
K
Kai Liu *
E
Evgeny Belyaev
F
Fei Cheng
DOI:10.1016/j.patcog.2017.12.004delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recent years have seen a growth in interest in skeleton-based human behavior recognition. Skeleton sequences can be expressed naturally as high-order tensor time series, and in this paper we report on the modeling and analysis of such time series using a linear dynamical system (LDS). Owing to their relative simplicity and efficiency, LDSs are the most common tool used in various disciplines for encoding spatiotemporal time series data. However, conventional LDSs process the latent and observed states at each frame of a video as a column vector, a representation that fails to take into account valuable structural information associated with human action. To correct this, we propose a tensor-based linear dynamical system (tLDS) for modeling tensor observations in time series and employ Tucker decomposition to estimate the parameters of the LDS model as action descriptors. In this manner, an action can be expressed as a subspace corresponding to a point on a Grassmann manifold on which classification can be performed using dictionary learning and sparse coding. Experiments using the MSR Action3D, UCF Kinect, and Northwestern-UCLA Multiview Action3D datasets demonstrate the excellent performance of our proposed method. (C) 2017 Elsevier Ltd. All rights reserved.
Keywords:
Skeleton joints
Action recognition
Subspace learning
Tensor learning
Grassmann manifold
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

T
Tampere University
Scholars:
1.4W
Papers: 1.3W
Citations: 1.4W
X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K