.png){kind=icon}
返回
A Hybrid Transformer Framework for Efficient Activity Recognition Using Consumer Electronics
.png){kind=icon}
PRE
AI
DOI：10.1109/TCE.2024.3373824.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In the field of research on wireless visual sensor networks, human activity recognition (HAR) using consumer electronics is now an emerging research area in both the academic and industrial sectors, with a diverse range of applications. However, the implementation of HAR through computer vision methods is highly challenging on consumer electronic devices, due to their limited computational capabilities. This means that mainstream approaches in which computationally complex contextual networks and variants of recurrent neural networks are used to learn long-range spatiotemporal dependencies have achieved limited performance. To address these challenges, this paper presents an efficient framework for robust HAR for consumer electronics devices, which is divided into two main stages. In the first stage, convolutional features from the multiply_17 layer of a lightweight MobileNetV3 are employed to balance the computational complexity and extract the most salient contextual features ( $7\times 7\times 576\times 30$ ) from each video. In the second stage, a sequential residual transformer network (SRTN) is designed in a residual fashion to effectively learn the long-range temporal dependencies across multiple video frames. The temporal multi-head self-attention module and residual strategy of the SRTN enable the proposed method to discard non-relevant features and to optimise the spatiotemporal feature vector for efficient HAR. The performance of the proposed model is evaluated on three challenging HAR datasets, and is found to yield high levels of accuracy of 76.1428%, 96.6399%, and 97.3130% on the HMDB51, UCF101, and UCF50 datasets, respectively, outperforming a state-of-the-art method for HAR.
Keyword:
Feature extraction
Consumer electronics
Human activity recognition
Computational modeling
Transformers
Visualization
Computer architecture
Human action recognition
wireless visual sensor networks
consumer electronics
video classification
surveillance system
transformer network
期刊
IF:
10.9
论文数:
5.3K
被引数:
6.8K
机构
引用论文
Low-light aware framework for human activity recognition via optimized dual stream parallel network
OAAI
OAAI分享收藏ARCH: Adaptive recurrent-convolutional hybrid networks for long-term action recognition.png)
NEUROCOMPUTINGOAAI
NEUROCOMPUTINGIF6.5
OAAI分享收藏分享收藏Human action recognition using convolutional LSTM and fully-connected LSTM with different attentions基于不同注意力的卷积LSTM和全连接LSTM的人体动作识别NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏分享收藏
查看更多内容