arrow
返回

Deep learning-based multi-view 3D-human action recognition using skeleton and depth data

delete2022-11-18
delete3
PRE
AI
S
Sampat Kumar Ghosh
M
M. Rashmi *
B
Biju R. Mohan
R
Ram Mohana Reddy Guddeti
DOI:10.1007/s11042-022-14214-ydelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Human Action Recognition (HAR) is a fundamental challenge that smart surveillance systems must overcome. With the rising affordability of capturing human actions with more advanced depth cameras, HAR has garnered increased interest over the years, however the majority of these efforts have been on single-view HAR. Recognizing human actions from arbitrary viewpoints is more challenging, as the same action is observed differently from different angles. This paper proposes a multi-stream Convolutional Neural Network (CNN) model for multi-view HAR using depth and skeleton data. We also propose a novel and efficient depth descriptor, Edge Detected-Motion History Image (ED-MHI), based on Canny Edge Detection and Motion History Image. Also, the proposed skeleton descriptor, Motion and Orientation of Joints (MOJ), represent the appropriate action by using joint motion and orientation. Experimental results on two datasets of human actions: NUCLA Multiview Action3D and NTU RGB-D using a Cross-subject evaluation protocol demonstrated that the proposed system exhibits the superior performance as compared to the state-of-the-art works with 93.87% and 85.61% accuracy, respectively.
Keyword:
Convolutional neural networks
Deep learning
Feature fusion
Human action recognition
Score fusion

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
2.0W
被引数:
3.2W

机构

N
national institute of technology (nit system)
学者数:
4.0W
论文数: 3.7W
被引数: 31
引用论文

引用论文

Incentive mechanisms for smartphone collaboration in data acquisition and distributed computing
err2012-03-01
err0
PREAI
errLingjie Duan; Takeshi Kubo; Kohei Sugiyama; Jianwei Huang; Teruyuki Hasegawa; Jean Walrand
err分享
err收藏
Plant-derived Bioactives
err
IF0
err2020-01-01
err0
PREAI
err
err分享
err收藏
Recommendation system for immunization coverage and monitoring
err2017-11-10
err57
errOAAI
errBhatti, Uzair Aslam; Huang, Mengxing; Wang, Hao; Zhang, Yu; Mehmood, Anum; Di, Wu
err分享
err收藏
Decomposition of RNA methylome reveals co-methylation patterns induced by latent enzymatic regulators of the epitranscriptome
err2015-01-01
err0
errOAAI
errLian Liu; Shao-Wu Zhang; Yu-Chen Zhang; Hui Liu; Lin Zhang; Runsheng Chen; Yufei Huang; Jia Meng
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Recommendation system using feature extraction and pattern recognition in clinical care systems
err2018-12-26
err129
PREAI
errBhatti, Uzair Aslam; Huang, Mengxing; Wu, Di; Zhang, Yu; Mehmood, Anum; Han, Huirui
err分享
err收藏
A framework of human action recognition using length control features fusion and weighted entropy-variances based feature selection基于长度控制特征融合和基于加权熵方差的特征选择的人体动作识别框架
err2021-02-01
err104
PREAI
errAfza, Farhat; Khan, Muhammad Attique; Sharif, Muhammad; Kadry, Seifedine; Manogaran, Gunasekaran; Saba, Tanzila; Ashraf, Imran; Damasevicius, Robertas
err分享
err收藏
学者 查看更多内容