arrow
返回

A General Multistage Deep Learning Framework for Sensor-Based Human Activity Recognition Under Bounded Computational Budget

delete2024-01-01
delete0
PRE
AI
X
Xing Wang
L
Lei Zhang *
D
Dongzhou Cheng
Y
Yin Tang
S
Shuoyuan Wang
武浩 封面图
武浩 (Hao Wu)
A
Aiguo Song
DOI:10.1109/TIM.2024.3481549delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In recent years, sliding windows have been widely employed for sensor-based human activity recognition (HAR) due to their implementational simplicity. In this article, inspired by the fact that not all time intervals in a window are activity-relevant, we propose a novel multistage HAR framework named MS-HAR by implementing a sequential decision procedure to progressively process a sequence of relatively small intervals, i.e., reduced input, which is automatically cropped from the original window with reinforcement learning. Such a design naturally facilitates dynamic inference at runtime, which may be terminated at an arbitrary time once the network obtains sufficiently high confidence about its current prediction. Compared to most existing works that directly handle the whole window, our method allows for very precisely controlling the computational budget online by setting confidence thresholds, which forces the network to spend more computation on a difficult activity while spending less computation on an easy activity under a finite computational budget. Extensive experiments on four benchmark HAR datasets consisting of WISMD, PAMAP2, USC-HAD, and one weakly labeled dataset demonstrate that our method is considerably more flexible and efficient than the competitive baselines. Particularly, our proposed framework is general since it is compatible with most mainstream backbone networks.
Keyword:
Deep learning
Human activity recognition
Computational efficiency
Accuracy
Proposals
Reinforcement learning
Predictive models
Power demand
Heuristic algorithms
Data models
early exit
human activity recognition (HAR)
reinforcement learning
sensors
sequential decision

期刊

IEEE Transactions on Instrumentation and Measurement 封面图
IEEE Transactions on Instrumentation and Measurement
IF:
5.9
论文数:
2.0W
被引数:
5.8W

机构

C
Central South University
学者数:
10.0W
论文数: 7.2W
被引数: 10.9W
Y
Yunnan University
学者数:
1.6W
论文数: 9.9K
被引数: 13
S
southeast university - china
学者数:
5.3W
论文数: 4.9W
被引数: 57
N
Nanjing Normal University
学者数:
1.7W
论文数: 1.3W
被引数: 1.9W
学者 查看更多机构
引用论文

引用论文

Tourism industry impact on Efik's culture, Nigeria
err2010-10-12
err0
PREAI
errA.M. Ogaboh Agba; Moses U. Ikoh; Antigha O. Bassey; Ekwuore M. Ushie
err分享
err收藏
CapsGaNet: Deep Neural Network Based on Capsule and GRU for Human Activity Recognition
err2022-12-01
err21
PREAI
errSun, Xiaojie; Xu, Hongji; Dong, Zheng; Shi, Leixin; Liu, Qiang; Li, Juan; Li, Tiankuo; Fan, Shidi; Wang, Yuhao
err分享
err收藏
TSPO over-expression increases motility, transmigration and proliferation properties of C6 rat glioma cells
err2008-02-01
err0
errOAAI
errMariarosa Rechichi; Alessandra Salvetti; Beatrice Chelli; Barbara Costa; Eleonora Da Pozzo; Francesca Spinetti; Annalisa Lena; Monica Evangelista; Giuseppe Rainaldi; Claudia Martini; Vittorio Gremigni; Leonardo Rossi
err分享
err收藏
Efficient dense labelling of human activity sequences from wearables using fully convolutional networks
err2018-06-01
err76
PREAI
errYao, Rui; Lin, Guosheng; Shi, Qinfeng; Ranasinghe, Damith C.
err分享
err收藏
Deep learning for sensor-based activity recognition: A survey
err2019-03-01
err1.1K
errOAAI
errWang, Jindong; Chen, Yiqiang; Hao, Shuji; Peng, Xiaohui; Hu, Lisha
err分享
err收藏
The Ib Phase of Ventricular Arrhythmias in Ischemic In Situ Porcine Heart Is Related to Changes in Cell-to-Cell Electrical Coupling
err1995-11-15
err0
PREAI
errWilliam T. Smith; William F. Fleet; Timothy A. Johnson; Connie L. Engle; Wayne E. Cascio
err分享
err收藏
学者 查看更多内容