arrow
返回

Sensor-based Human Activity Recognition Using Graph LSTM and Multi-task Classification Model

delete2022-10-31
delete13
PRE
AI
曹
曹杰 (Jie Cao)
王
王有权 (Youquan Wang) *
H
Haicheng Tao
X
Xiang Guo
DOI:10.1145/3561387delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper explores human activities recognition from sensor-based multi-dimensional streams. Recently, deep learning-based methods such as LSTM and CNN have achieved important progress in practical application scenarios. However, in most previous deep learning-based methods exist potential challenges such as class imbalance and multi-modal heterogeneity with time and sensor signals. To handle those problems, we propose a graph LSTM and Metric Learning model (GLML) with multiple construction graph fusion by modeling the sensor-aspect signals and the graph-aspect activities. GLML is a semi-supervised co-training architecture, which can be seen as several iteratively pseudo-labels sampling processing in the unlabeled data. Specifically, we construct three graphs to capture the different relations in each timestamp. Meanwhile, the graph attention model and attention mechanism are proposed to integrate multiple graph interactions for different sensor signals. Furthermore, to obtain a fixed representation of hidden state units and their neighboring nodes, we introduce the Graph LSTM to learn the graph-aspect relations from graph-structured constructed graphs. Notably, we propose a multi-task classification model combining loss function for classification distribution with deep metric learning to enhance the representation ability of the multi-modal sensor data. Experimental results on three public datasets demonstrate that our proposed GLML model has at least 2.44% improved in average against the state-of-the-art methods.
Keyword:
Human activity recognition
graph LSTM
pseudo-labeling
graph structure learning
multiple graph fusion

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

H
hefei university of technology
学者数:
2.5W
论文数: 1.7W
被引数: 35
W
wuhan university
学者数:
8.1W
论文数: 5.8W
被引数: 70
引用论文

引用论文

Mining intricate temporal rules for recognizing complex activities of daily living under uncertainty
err2016-12-01
err20
PREAI
errLiu, Li; Wang, Shu; Peng, Yuxin; Huang, Zigang; Liu, Ming; Hu, Bin
err分享
err收藏
err分享
err收藏
Observations of nanoscopic, face centered cubic Ti and TiH x
err2008-10-19
err0
PREAI
errPer Erik Vullum; Mark Pitt; John Walmsley; Bjørn Hauback; Randi Holmestad
err分享
err收藏
A Comprehensive Survey on Community Detection With Deep Learning基于深度学习的社区发现研究综述
err2024-04-01
err198
errOAAI
errSu, Xing; Xue, Shan; Liu, Fanzhen; Wu, Jia; Yang, Jian; Zhou, Chuan; Hu, Wenbin; Paris, Cecile; Nepal, Surya; Jin, Di; Sheng, Quan Z.; Yu, Philip S.
err分享
err收藏
Unsupervised Human Activity Recognition Using the Clustering Approach: A Review使用聚类方法进行无监督的人类活动识别: 综述
errSENSORS
IF3.5
err2020-05-09
err39
errOAAI
errAriza Colpas, Paola; Vicario, Enrico; De-La-Hoz-Franco, Emiro; Pineres-Melo, Marlon; Oviedo-Carrascal, Ana; Patara, Fulvio
err分享
err收藏
学者 查看更多内容