arrow
返回

A Multidimensional Parallel Convolutional Connected Network Based on Multisource and Multimodal Sensor Data for Human Activity Recognition

delete2023-08-15
delete8
PRE
AI
Y
Yuhao Wang
H
Hongji Xu
L
Lina Zheng
G
Guozhen Zhao
Z
Zhi Liu *
S
Shuang Zhou
M
Mengmeng Wang
许
许杰 (Jie Xu)
DOI:10.1109/JIOT.2023.3265937delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Human activity recognition (HAR) technology based on wearables has received increasing attention in recent years. The traditional methods have used hand-crafted features to recognize human activities, resulting in shallow feature extraction. With the development of deep learning, an increasing number of researchers have focused on studying deep learning methods. To achieve higher recognition accuracy, the majority of the current HAR research involves multisource and multimodal sensors (MMSs) data. However, due to the limitations in the receptive fields of single-dimensional convolutional kernels, these networks are still infeasible for extracting spatiotemporal features. In this study, a multidimensional parallel convolutional connected (MPCC) deep learning network based on MMS data for HAR is proposed that fully utilizes the advantages of multidimensional convolutional kernels. Moreover, multiscale residual convolutional squeeze-and-excitation (MRCSE) modules are proposed to enrich the diversity of feature information by combining squeeze and-excitation (SE) blocks. A daily home activity (DHA) data set is constructed based on the requirements for HAR in certain scenarios, such as smart home, and we conduct experiments on the optimal combination of sensor locations on the DHA data set according to a weighted F1 (FW)-score. Both tenfold and leave-one-subject-out (LOSO) cross-validations (CVs) are used to evaluate the performance of the proposed network. The MPCCMRCSE network achieves FW-scores of 98.33% and 95.42% on the physical activity monitoring for aging people (PAMAP2) and OPPORTUNITY data sets using tenfold CVs, respectively, and achieves FW-scores of 81.47% on the PAMAP2 when applying an LOSO CV.
Keyword:
Feature extraction
Internet of Things
Deep learning
Monitoring
Data mining
Convolutional neural networks
Wearable computers
human activity recognition (HAR)
leave-one-subject-out (LOSO) cross-validation (CV)
multisource and multimodal sensor (MMS) data
squeeze-and-excitation (SE) blocks
tenfold CV

期刊

IEEE Internet of Things Journal 封面图
IEEE Internet of Things Journal
IF:
8.9
论文数:
1.4W
被引数:
7.8W

机构

S
shandong university
学者数:
9.5W
论文数: 6.4W
被引数: 94
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Deep CNN-LSTM With Self-Attention Model for Human Activity Recognition Using Wearable Sensor
err2022-01-01
err102
errOAAI
errKhatun, Mst Alema; Abu Yousuf, Mohammad; Ahmed, Sabbir; Uddin, Md Zia; Alyami, Salem A.; Al-Ashhab, Samer; Akhdar, Hanan F.; Khan, Asaduzzaman; Azad, Akm; Moni, Mohammad Ali
err分享
err收藏
TMMF: Temporal Multi-Modal Fusion for Single-Stage Continuous Gesture Recognition
err2021-01-01
err29
errOAAI
errGammulle, Harshala; Denman, Simon; Sridharan, Sridha; Fookes, Clinton
err分享
err收藏
err分享
err收藏
err分享
err收藏
Effects of a Multidisciplinary Care Program on Disability, Autonomy, and Nursing Needs in Subjects Recovering From Acute Respiratory Failure in a Chronic Ventilator Facility
err2014-12-01
err0
errOAAI
errMichele Vitacca; Mara Paneroni; Roberta Peroni; Luca Barbano; Valmira Dodaj; Giancarlo Piaggi; Fabio Vanoglio; Alberto Luisa; Amerigo Giordano; Piero Ceriana
err分享
err收藏
学者 查看更多内容