arrow
Return

Sequentially Supervised Long Short-Term Memory for Gesture Recognition

delete2016-03-10
delete19
PRE
AI
王培松 (Peisong Wang)
Q
Qiang Song
H
Hua Han
J
Jian Cheng *
DOI:10.1007/s12559-016-9388-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Gesture recognition has been suffering from long-term dependencies and complex variations in both spatial and temporal dimensions. Many traditional methods use hand cropping and sliding window scheme in the spatial and temporal space, respectively. In this paper, we propose a sequentially supervised long short-term memory architecture, which allows using pose information to guide the learning process of gesture recognition using variable length inputs. Technically, we add supervision at each frame using human joint positions. Our proposed methods can solve gesture recognition and pose estimation problems simultaneously using only RGB videos without hand cropping. Experimental results on two benchmark datasets demonstrate the effectiveness of the proposed framework compared with the state-of-the-art methods.
Keywords:
Gesture recognition
Pose estimation
LSTM
Sequential classification
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Cognitive Computation cover
Cognitive Computation
IF:
4.3
Papers:
1.6K
Citations:
3.6K

Organization

C
chinese academy of sciences
Scholars:
56.4W
Papers: 44.9W
Citations: 704