.png){kind=icon}
Return
Deep learning-based multi-view 3D-human action recognition using skeleton and depth data
.png){kind=icon}
PRE
AI
DOI：10.1007/s11042-022-14214-y.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Human Action Recognition (HAR) is a fundamental challenge that smart surveillance systems must overcome. With the rising affordability of capturing human actions with more advanced depth cameras, HAR has garnered increased interest over the years, however the majority of these efforts have been on single-view HAR. Recognizing human actions from arbitrary viewpoints is more challenging, as the same action is observed differently from different angles. This paper proposes a multi-stream Convolutional Neural Network (CNN) model for multi-view HAR using depth and skeleton data. We also propose a novel and efficient depth descriptor, Edge Detected-Motion History Image (ED-MHI), based on Canny Edge Detection and Motion History Image. Also, the proposed skeleton descriptor, Motion and Orientation of Joints (MOJ), represent the appropriate action by using joint motion and orientation. Experimental results on two datasets of human actions: NUCLA Multiview Action3D and NTU RGB-D using a Cross-subject evaluation protocol demonstrated that the proposed system exhibits the superior performance as compared to the state-of-the-art works with 93.87% and 85.61% accuracy, respectively.
Keywords:
Convolutional neural networks
Deep learning
Feature fusion
Human action recognition
Score fusion
Journal
IF:
3
Papers:
2.0W
Citations:
3.2W
Organization
Cited Papers
Incentive mechanisms for smartphone collaboration in data acquisition and distributed computing
.png){kind=icon}
PREAI
ShareSaveShareSave
ShareSaveShareSaveRecommendation system using feature extraction and pattern recognition in clinical care systems
PREAI
ShareSave
View more