Gesture recognition based on skeletonization algorithm and CNN with ASL database

Du Jiang

doi:10.1007/s11042-018-6748-0

Return

Gesture recognition based on skeletonization algorithm and CNN with ASL database

2018-10-06

140

PRE

DOI：10.1007/s11042-018-6748-0

Original

Original request for help

Save

Abstract

En 中文

In the field of human-computer interaction, vision-based gesture recognition methods are widely studied. However, its recognition effect depends to a large extent on the performance of the recognition algorithm. The skeletonization algorithm and convolutional neural network (CNN) for the recognition algorithm reduce the impact of shooting angle and environment on recognition effect, and improve the accuracy of gesture recognition in complex environments. According to the influence of the shooting angle on the same gesture recognition, the skeletonization algorithm is optimized based on the layer-by-layer stripping concept, so that the key node information in the hand skeleton diagram is extracted. The gesture direction is determined by the spatial coordinate axis of the hand. Based on this, gesture segmentation is implemented to overcome the influence of the environment on the recognition effect. In order to further improve the accuracy of gesture recognition, the ASK gesture database is used to train the convolutional neural network model. The experimental results show that compared with SVM method, dictionary learning + sparse representation, CNN method and other methods, the recognition rate reaches 96.01%.

Keywords:

Layer-by-layer stripping theory

Skeletonization algorithm

Convolutional neural network

Gesture recognition

Big data

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.