arrow
返回

Learning Clip Representations for Skeleton-Based 3D Action Recognition

delete2018-06-01
delete194
PRE
AI
Q
Qiuhong Ke *
M
Mohammed Bennamoun
S
Senjian An
F
Ferdous Sohel
F
Farid Boussaïd
DOI:10.1109/TIP.2018.2812099delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper presents a new representation of skeleton sequences for 3D action recognition. Existing methods based on hand-crafted features or recurrent neural networks cannot adequately capture the complex spatial structures and the long-term temporal dynamics of the skeleton sequences, which are very important to recognize the actions. In this paper, we propose to transform each channel of the 3D coordinates of a skeleton sequence into a clip. Each frame of the generated clip represents the temporal information of the entire skeleton sequence and one particular spatial relationship between the skeleton joints. The entire clip incorporates multiple frames with different spatial relationships, which provide useful spatial structural information of the human skeleton. We also propose a multitask convolutional neural network (MTCNN) to learn the generated clips for action recognition. The proposed MTCNN processes all the frames of the generated clips in parallel to explore the spatial and temporal information of the skeleton sequences. The proposed method has been extensively tested on six challenging benchmark datasets. Experimental results consistently demonstrate the superiority of the proposed clip representation and the feature learning method for 3D action recognition compared to the existing techniques.
Keyword:
Clip representation
CNN
multi-task learning
3D action recognition
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
University of Western Australia
学者数:
2.9W
论文数: 3.0W
被引数: 46
M
Murdoch University
学者数:
5.3K
论文数: 5.4K
被引数: 8.4K
引用论文

引用论文

Demolition Means Progress
err
IF0
err2015-01-01
err0
PREAI
errAndrew R. Highsmith
err分享
err收藏
Acoustic Collision Detection and Localization for Robot Manipulators
err2020-10-24
err0
PREAI
errXiaoran Fan; Daewon Lee; Yuan Chen; Colin Prepscius; Volkan Isler; Larry Jackel; H. Sebastian Seung; Daniel Lee
err分享
err收藏
Decomposition of RNA methylome reveals co-methylation patterns induced by latent enzymatic regulators of the epitranscriptome
err2015-01-01
err0
errOAAI
errLian Liu; Shao-Wu Zhang; Yu-Chen Zhang; Hui Liu; Lin Zhang; Runsheng Chen; Yufei Huang; Jia Meng
err分享
err收藏
Skeleton-Based Human Action Recognition With Global Context-Aware Attention LSTM Networks
err2018-04-01
err423
errOAAI
errLiu, Jun; Wang, Gang; Duan, Ling-Yu; Abdiyeva, Kamila; Kot, Alex C.
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
学者 查看更多内容