arrow
返回

An Efficient Diverse-Branch Convolution Scheme for Sensor-Based Human Activity Recognition

delete2023-01-01
delete4
PRE
AI
C
Chaolei Han
L
Lei Zhang *
S
Shige Xu
X
Xing Wang
武浩 封面图
武浩 (Hao Wu) *
A
Aiguo Song
DOI:10.1109/TIM.2023.3265128delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep convolutional networks have recently achieved significant success in sensor-based human activity recognition (HAR). Existing works are mainly devoted to extracting multiscale activity features from sensor time series by increasing network depth or width, which are not friendly to mobile devices with limited computing resources. It still remains a challenging issue to strike an ideal tradeoff between activity recognition performance and inference-time costs, e.g., the latency and memory footprint. To address this issue, we propose a diverse-branch convolution (DBC) scheme, which could strengthen the representation capacity of vanilla convolution via exploiting diverse branches of different scales and complexities to enrich activity feature space. Then, DBC could be equivalently transformed into a single convolution layer after training for HAR deployment. In such a manner, DBC only complicates training-time microstructure while preserving inference-time macrostructure, where the model performance can be boosted to a higher level and then converted back to its original inference-time structure for activity recognition. Extensive experiments are conducted on three publicly available benchmark datasets, i.e., OPPORTUNITY, UniMiB-SHAR, Wireless Sensor Data Mining (WISDM), and a self-collected weakly labeled HAR dataset, which verify that our method can give a lift in performance while maintaining the same number of parameters and FLOPs as baselines. Finally, the actual inference-time cost is evaluated for HAR deployment on a Raspberry Pi platform.
Keyword:
Convolution
Feature extraction
Kernel
Costs
Computational modeling
Mobile handsets
Performance evaluation
Activity recognition
deep learning
diverse-branch
sensor
structural reparameterization

期刊

IEEE Transactions on Instrumentation and Measurement 封面图
IEEE Transactions on Instrumentation and Measurement
IF:
5.9
论文数:
2.0W
被引数:
5.8W

机构

Y
Yunnan University
学者数:
1.6W
论文数: 9.9K
被引数: 13
S
southeast university - china
学者数:
5.3W
论文数: 4.9W
被引数: 57
N
Nanjing Normal University
学者数:
1.7W
论文数: 1.3W
被引数: 1.9W
学者 查看更多机构
引用论文

引用论文

Video-Based Heart Rate Measurement: Recent Advances and Future Prospects
err2019-10-01
err131
PREAI
errChen, Xun; Cheng, Juan; Song, Rencheng; Liu, Yu; Ward, Rabab; Wang, Z. Jane
err分享
err收藏
A Novel IoT-Perceptive Human Activity Recognition (HAR) Approach Using Multihead Convolutional Attention
err2020-02-01
err127
PREAI
errZhang, Haoxi; Xiao, Zhiwen; Wang, Juan; Li, Fei; Szczerbicki, Edward
err分享
err收藏
Improving Photoplethysmographic Measurements Under Motion Artifacts Using Artificial Neural Network for Personal Healthcare
err2018-12-01
err49
errOAAI
errRoy, Monalisa Singha; Gupta, Rajarshi; Chandra, Jayanta K.; Das Sharma, Kaushik; Talukdar, Arunansu
err分享
err收藏
Recent advances in convolutional neural networks卷积神经网络的最新进展
err2018-05-01
err3.8K
errOAAI
errGu, Jiuxiang; Wang, Zhenhua; Kuen, Jason; Ma, Lianyang; Shahroudy, Amir; Shuai, Bing; Liu, Ting; Wang, Xingxing; Wang, Gang; Cai, Jianfei; Chen, Tsuhan
err分享
err收藏
err分享
err收藏
err分享
err收藏
Deep learning for sensor-based activity recognition: A survey
err2019-03-01
err1.1K
errOAAI
errWang, Jindong; Chen, Yiqiang; Hao, Shuji; Peng, Xiaohui; Hu, Lisha
err分享
err收藏
学者 查看更多内容