arrow
返回

Multi-stream deep networks for human action classification with sequential tensor decomposition

delete2017-11-01
delete13
PRE
AI
H
Huiwen Guo
X
Xinyu Wu *
W
Wei Feng
DOI:10.1016/j.sigpro.2017.05.022delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Effective spatial-temporal representation of motion information is crucial to human action classification. In spite of the attempt of most existing methods capturing spatial-temporal structure and learning motion representations with deep neural networks, such representations are failing to model action at their full temporal extent. To address this problem, this paper proposes a global motion representation by using sequential low-rank tensor decomposition. Specifically, we model an action sequence as a third-order tensor with spatiotemporal structure. Then, by using low-rank tensor decomposition, partial motion of objects in global context were preserved which will be feeding into deep architecture to automatically learning global-term motion features. To simultaneously exploit static spatial features, short-term motion and global-term motion in the video, we describe a multi-stream framework with recurrent convolutional architectures which is end-to-end trainable. Gated Recurrent Unit (GRU) is used as our recurrent unit which have fewer parameters than Long Short-Term Memory (LSTM). Extensive experiments were conducted on two challenging dataset: HMDB51 and UCF101. Experimental results show that our method achieves state-of-the-art performance on the HMDB51 dataset, and is comparable to the state-of-the-art methods on the UCF101 dataset. (C) 2017 Elsevier B.V. All rights reserved.
Keyword:
Action classification
Global motion
Tensor decomposition
Gated Recurrent Unit
Recurrent Neural network
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Signal Processing 封面图
Signal Processing
IF:
3.6
论文数:
10.0K
被引数:
1.7W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Multimodal Deep Autoencoder for Human Pose Recovery
err2015-12-01
err520
PREAI
errHong, Chaoqun; Yu, Jun; Wan, Jian; Tao, Dacheng; Wang, Meng
err分享
err收藏
Titanium Aneurysm Clips: Part I-Mechanical, Radiological, and Biocompatibility Testing
err1996-06-01
err0
PREAI
errMichael T. Lawton; James C. Ho; William D. Bichard; Stephen W. Coons; Joseph M. Zabramski; Robert F. Spetzler
err分享
err收藏
Multiview Hessian regularized logistic regression for action recognition
err2015-05-01
err63
errOAAI
errLiu, Weifeng; Liu, Hongli; Tao, Dapeng; Wang, Yanjiang; Lu, Ke
err分享
err收藏
err分享
err收藏
Temporal Variance Analysis for Action Recognition
err2015-12-01
err14
PREAI
errMiao, Jie; Xu, Xiangmin; Qiu, Shuoyang; Qing, Chunmei; Tao, Dacheng
err分享
err收藏
学者 查看更多内容