arrow
Return

Sensor-Based Human Activity Recognition with Spatio-Temporal Deep Learning

delete2021-03-18
delete83
delete
OA
AI
O
Ohoud Nafea *
W
Wadood Abdul
G
Ghulam Muhammad *
M
Mansour Alsulaiman
DOI:10.3390/s21062141delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Human activity recognition (HAR) remains a challenging yet crucial problem to address in computer vision. HAR is primarily intended to be used with other technologies, such as the Internet of Things, to assist in healthcare and eldercare. With the development of deep learning, automatic high-level feature extraction has become a possibility and has been used to optimize HAR performance. Furthermore, deep-learning techniques have been applied in various fields for sensor-based HAR. This study introduces a new methodology using convolution neural networks (CNN) with varying kernel dimensions along with bi-directional long short-term memory (BiLSTM) to capture features at various resolutions. The novelty of this research lies in the effective selection of the optimal video representation and in the effective extraction of spatial and temporal features from sensor data using traditional CNN and BiLSTM. Wireless sensor data mining (WISDM) and UCI datasets are used for this proposed methodology in which data are collected through diverse methods, including accelerometers, sensors, and gyroscopes. The results indicate that the proposed scheme is efficient in improving HAR. It was thus found that unlike other available methods, the proposed method improved accuracy, attaining a higher score in the WISDM dataset compared to the UCI dataset (98.53% vs. 97.05%).
Keywords:
human activity recognition
local spatio-temporal features
deep learning
convolution neural networks
Bi-directional LSTM

Journal

Sensors cover
Sensors
IF:
3.5
Papers:
7.3W
Citations:
20.9W

Organization

K
King Saud University
Scholars:
3.4W
Papers: 3.8W
Citations: 815
T
taibah university
Scholars:
3.1K
Papers: 3.4K
Citations: 1
Cited Papers

Cited Papers

A Comparative Analysis of Hybrid Deep Learning Models for Human Activity Recognition
errSENSORS
IF3.5
err2020-10-07
err42
errOAAI
errAbbaspour, Saedeh; Fotouhi, Faranak; Sedaghatbaf, Ali; Fotouhi, Hossein; Vahabi, Maryam; Linden, Maria
errShare
errSave
Deep learning for sensor-based activity recognition: A survey
err2019-03-01
err1.1K
errOAAI
errWang, Jindong; Chen, Yiqiang; Hao, Shuji; Peng, Xiaohui; Hu, Lisha
errShare
errSave
LSTM-CNN Architecture for Human Activity Recognition
err2020-01-01
err442
errOAAI
errXia, Kun; Huang, Jianguang; Wang, Hanyu
errShare
errSave
Human Action Recognition by Learning Spatio-Temporal Features With Deep Neural Networks
err2018-01-01
err82
errOAAI
errWang, Lei; Xu, Yangyang; Cheng, Jun; Xia, Haiying; Yin, Jianqin; Wu, Jiaji
errShare
errSave
errShare
errSave
Imaging and fusing time series for wearable sensor-based human activity recognition
err2020-01-01
err167
PREAI
errQin, Zhen; Zhang, Yibo; Meng, Shuyu; Qin, Zhiguang; Choo, Kim-Kwang Raymond
errShare
errSave
Deep Learning for Activity Recognition in Older People Using a Pocket-Worn Smartphone
errSENSORS
IF3.5
err2020-12-15
err20
errOAAI
errNan, Yashi; Lovell, Nigel H.; Redmond, Stephen J.; Wang, Kejia; Delbaere, Kim; van Schooten, Kimberley S.
errShare
errSave
researcher View more