arrow
返回

Skeleton-based action recognition with hierarchical spatial reasoning and temporal stack learning network

delete2020-11-01
delete62
PRE
AI
C
Chenyang Si
Y
Ya Jing
王薇 封面图
王薇 (Wei Wang) *
王亮 封面图
王亮 (Liang Wang)
T
Tieniu Tan
DOI:10.1016/j.patcog.2020.107511delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Skeleton-based action recognition aims to recognize human actions by exploring the inherent characteristics from the given skeleton sequences and has attracted far more attention due to its great important potentials in practical applications. Previous methods have illustrated that learning discriminative spatial and temporal features from the skeleton sequences is a crucial factor to recognize human actions. Nevertheless, how to model spatio-temporal evolutions is still a challenging problem. In this work, we propose a novel model with hierarchical spatial reasoning and temporal stack learning network (HSR-TSL) to explore the discriminative spatial and temporal features for human action recognition, which consists of a hierarchical spatial reasoning network (HSRN) and a temporal stack learning network (TSLN). Specifically, the HSRN employs a hierarchical residual graph neural network to capture two-level spatial features: intra spatial information of each part and body-level structural information between each part. The TSLN models the detailed temporal dynamics of skeleton sequences by a composition of multiple skip-clip LSTMs. During training, we develop a clip-based incremental loss to effectively optimize the model. We perform extensive experiments on five challenging benchmarks to verify the effectiveness of each component of our model. The comparison results illustrate that our approach significantly boosts the performances for skeleton-based action recognition. (C) 2020 Elsevier Ltd. All rights reserved.
Keyword:
Skeleton-based action recognition
Hierarchical spatial reasoning
Temporal stack learning
Clip-based incremental loss
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Optimized mismatch negativity paradigm reflects deficits in schizophrenia patients
err2008-02-01
err0
PREAI
errH. Thönnessen; M. Zvyagintsev; K.C. Harke; F. Boers; J. Dammers; Ch. Norra; K. Mathiak
err分享
err收藏
Effective Active Skeleton Representation for Low Latency Human Action Recognition
err2016-02-01
err73
PREAI
errCai, Xingyang; Zhou, Wengang; Wu, Lei; Luo, Jiebo; Li, Houqiang
err分享
err收藏
学者 查看更多内容