arrow
Return

Multi-Model Long Short-Term Memory Network for Gait Recognition Using Window-Based Data Segment

delete2021-01-01
delete44
delete
OA
AI
L
Lam Tran *
T
Thang Hoang
T
Thuc D. Nguyen
H
Hyunil Kim
D
Deokjai Choi
DOI:10.1109/ACCESS.2021.3056880delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Inertial Measurement Units (IMUs)-based gait analysis is a promising and attractive approach for user recognition. Recently, the adoption of deep learning techniques has gained significant performance improvement. However, most existing studies focused on exploiting the spatial information of gait data (using Convolutional Neural Network (CNN)) while the temporal part received little attention. In this study, we propose a new multi-model Long Short-term Memory (LSTM) network for learning the gait temporal features. First, we observe that LSTM is able to capture the pattern hidden inside the gait data sequences that are out-of-synchronization. Thus, instead of using the gait cycle-based segment, our model accepts the gait cycle-free segment (i.e., fixed-length window) as the input. By this, the classification task does not depend on the gait cycle detection task, which usually suffers from noise and bias. Second, we propose a new LSTM network architecture, in which, one LSTM is used for each gait data channel and a group of consecutive signals is processed in each step. This strategy allows the network to effectively handle the long input data sequence and achieve improved performance compared to existing LSTM-based gait models. In addition, besides using the LSTM alone, we extend it by combining with a CNN model to construct a hybrid network, which further improves the recognition performance. We evaluated our LSTM and hybrid networks under different settings using the whuGAIT and OU-ISIR datasets. The experiments showed that our LSTM network outperformed the existing LSTM networks, and its combination with CNN established new state-of-the-art performance on both the verification and identification tasks.
Keywords:
Gait recognition
Task analysis
Feature extraction
Gyroscopes
Legged locomotion
Data mining
Computer vision
Gait authentication
gait recognition
wearable sensor data
recurrent neural network
LSTM network
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

State University System of Florida cover
State University System of Florida
Scholars:
12.7W
Papers: 10.9W
Citations: 130
U
university of south florida
Scholars:
1.5W
Papers: 1.2W
Citations: 9
C
Chonnam National University
Scholars:
1.7W
Papers: 1.6W
Citations: 1.4W
researcher View more organizations