arrow
返回

An eXplainable Self-Attention-Based Spatial–Temporal Analysis for Human Activity Recognition

delete2024-01-01
delete6
PRE
AI
T
Tanushree Meena
K
Kishor Sarawadekar *
DOI:10.1109/JSEN.2023.3335449delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Human activity recognition (HAR) from inertial sensors has been a hot topic of research in recent years. Recognition of human activities from smartphone sensors poses a significant challenge because of the complexity of sensor data. In this work, a novel self-attention convolutional neural network-long short-term memory (CNN-LSTM) module is proposed by using the sensor data from inbuilt inertial sensors in smartphones. The experiment includes the results on the well-known HAR public datasets, namely, University of California HAR Dataset (UCI-HAR), University of California Human Activities and Postural Transitions (UCI-HAPT), and Sanitation datasets. The performance evaluation of the proposed model confirmed its effectiveness, as it achieved high accuracy rates across all tested datasets. Furthermore, ablation studies performed on the depth and number of hyperparameters used in the model demonstrate its effectiveness in achieving higher classification accuracy. The model was also evaluated using other metrics and was found to be cost effective in terms of the number of floating-point operations per second (FLOPs). In addition, a 1-D gradient-weighted class activation mapping (GradCAM) was implemented on the self-attention layer of the proposed model to determine and visualize the features responsible for the predicted activities. Our proposed model demonstrated superior performance on each individual dataset and achieved the best results on the UCI-HAR dataset. Specifically, for the UCI-HAR dataset, our model achieved an accuracy score of 0.9829, precision of 0.9833, recall of 0.9840, and ${F}1$ score of 0.9836 on the test data. Furthermore, the Matthews correlation coefficient (MCC) and Kappa score were calculated as 0.9795 and 0.9794, respectively.
Keyword:
Sensors
Feature extraction
Human activity recognition
Convolutional neural networks
Computer architecture
Biomedical monitoring
Computational modeling
1-D gradient-weighted class activation mapping (GradCAM)
explainability
human activity recognition (HAR)
long short-term memory (LSTM)
self-attention
sensors
smartphones

期刊

IEEE Sensors Journal 封面图
IEEE Sensors Journal
IF:
4.5
论文数:
2.2W
被引数:
7.3W

机构

B
banaras hindu university (bhu)
学者数:
9.5K
论文数: 7.7K
被引数: 8
引用论文

引用论文

err分享
err收藏
ST-DeepHAR: Deep Learning Model for Human Activity Recognition in IoHT Applications
err2021-03-15
err75
PREAI
errAbdel-Basset, Mohamed; Hawash, Hossam; Chakrabortty, Ripon K.; Ryan, Michael; Elhoseny, Mohamed; Song, Houbing
err分享
err收藏
A Novel IoT-Perceptive Human Activity Recognition (HAR) Approach Using Multihead Convolutional Attention
err2020-02-01
err127
PREAI
errZhang, Haoxi; Xiao, Zhiwen; Wang, Juan; Li, Fei; Szczerbicki, Edward
err分享
err收藏
Deep CNN-LSTM With Self-Attention Model for Human Activity Recognition Using Wearable Sensor
err2022-01-01
err102
errOAAI
errKhatun, Mst Alema; Abu Yousuf, Mohammad; Ahmed, Sabbir; Uddin, Md Zia; Alyami, Salem A.; Al-Ashhab, Samer; Akhdar, Hanan F.; Khan, Asaduzzaman; Azad, Akm; Moni, Mohammad Ali
err分享
err收藏
Implementing a strategy successfully
err2001-12-01
err0
PREAI
errJoseph A. De Feo; Alexander Janssen
err分享
err收藏
LSTM-CNN Architecture for Human Activity Recognition
err2020-01-01
err442
errOAAI
errXia, Kun; Huang, Jianguang; Wang, Hanyu
err分享
err收藏
High-Frequency Patterns in the Abundance of Benthic Species near a Cold-Seep – An Internet Operated Vehicle Application
err2016-10-12
err0
errOAAI
errDamianos Chatzievangelou; Carolina Doya; Laurenz Thomsen; Autun Purser; Jacopo Aguzzi
err分享
err收藏
学者 查看更多内容