arrow
Return

Open Set User Identification Using Gait Pattern Analysis Based on Ensemble Deep Neural Network

delete2022-09-01
delete7
PRE
AI
J
Jucheol Moon
J
Jinwon Jung
E
Eunice Kang
S
Sang‐Il Choi *
DOI:10.1109/JSEN.2022.3188527delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The human gait is a unique biological characteristic of human beings and can be used for recognition task. Collecting gait information using wearable devices and identifying people with this data has been widely researched in recent times. Though many gait recognition studies have been conducted, few studies address the open set recognition problem where an unknown sample may be input into the system during the testing phase. A working model that overcomes this problem should correctly recognize whether a sample has never been seen before during training while maintaining high classification accuracy of known samples. We address the open set gait recognition problem by proposing a system that maps multi-modal unit step data gathered from insoles to an embedding vector in a latent space. Specifically, we collected the the time-series using sensor equipped insoles, and we process the raw multi-modal time-series into unit fragments by slicing them so that they can be used as input for an ensemble network made up of a convolutional neural network, recurrent neural network, and self-attention network. The proposed ensemble network is trained with the additive angular margin loss. The resulting embedding vector is used to recognize which subject the unit step belongs to through a decision function derived using a one-class support vector machine that requires only a few unit steps per subject for few-shot training. This decision function also determines whether a unit step does not belong to any of the subjects used to train the one-class support vector machine. We show that our model maintains high classification accuracy for known unit step subjects while correctly recognizing which unit steps were never used in the training phase. We demonstrate the performance of our proposed system in an experimental study using multi-modal sensing data.
Keywords:
Gait recognition
Convolutional neural networks
Sensors
Support vector machines
Pressure sensors
Footwear
Training
Multi-modal feature
gait analysis
multi-modal sensors
smart insole
user identification
wearable sensor

Journal

IEEE Sensors Journal cover
IEEE Sensors Journal
IF:
4.5
Papers:
2.1W
Citations:
7.3W

Organization

California State University System cover
California State University System
Scholars:
2.8W
Papers: 2.4W
Citations: 457
California State University, Long Beach cover
California State University, Long Beach
Scholars:
1.2K
Papers: 968
Citations: 2.1K