返回
An eXplainable Self-Attention-Based Spatial–Temporal Analysis for Human Activity Recognition
DOI:10.1109/JSEN.2023.3335449.png)
摘要
En 中文
Human activity recognition (HAR) from inertial sensors has been a hot topic of research in recent years. Recognition of human activities from smartphone sensors poses a significant challenge because of the complexity of sensor data. In this work, a novel self-attention convolutional neural network-long short-term memory (CNN-LSTM) module is proposed by using the sensor data from inbuilt inertial sensors in smartphones. The experiment includes the results on the well-known HAR public datasets, namely, University of California HAR Dataset (UCI-HAR), University of California Human Activities and Postural Transitions (UCI-HAPT), and Sanitation datasets. The performance evaluation of the proposed model confirmed its effectiveness, as it achieved high accuracy rates across all tested datasets. Furthermore, ablation studies performed on the depth and number of hyperparameters used in the model demonstrate its effectiveness in achieving higher classification accuracy. The model was also evaluated using other metrics and was found to be cost effective in terms of the number of floating-point operations per second (FLOPs). In addition, a 1-D gradient-weighted class activation mapping (GradCAM) was implemented on the self-attention layer of the proposed model to determine and visualize the features responsible for the predicted activities. Our proposed model demonstrated superior performance on each individual dataset and achieved the best results on the UCI-HAR dataset. Specifically, for the UCI-HAR dataset, our model achieved an accuracy score of 0.9829, precision of 0.9833, recall of 0.9840, and ${F}1$ score of 0.9836 on the test data. Furthermore, the Matthews correlation coefficient (MCC) and Kappa score were calculated as 0.9795 and 0.9794, respectively.
Keyword:
Sensors
Feature extraction
Human activity recognition
Convolutional neural networks
Computer architecture
Biomedical monitoring
Computational modeling
1-D gradient-weighted class activation mapping (GradCAM)
explainability
human activity recognition (HAR)
long short-term memory (LSTM)
self-attention
sensors
smartphones
期刊
IF:
4.5
论文数:
2.2W
被引数:
7.3W
机构
引用论文
A Novel Feature Extraction Method for Preimpact Fall Detection System Using Deep Learning and Wearable Sensors基于深度学习和可穿戴传感器的碰撞前跌倒检测系统特征提取方法
IEEE SENSORS JOURNAL
IF4.5

