返回
Improving Small-Scale Human Action Recognition Performance Using a 3D Heatmap Volume
DOI:10.3390/s23146364.png)
摘要
En 中文
In recent years, skeleton-based human action recognition has garnered significant research attention, with proposed recognition or segmentation methods typically validated on large-scale coarse-grained action datasets. However, there remains a lack of research on the recognition of small-scale fine-grained human actions using deep learning methods, which have greater practical significance. To address this gap, we propose a novel approach based on heatmap-based pseudo videos and a unified, general model applicable to all modality datasets. Leveraging anthropometric kinematics as prior information, we extract common human motion features among datasets through an ad hoc pre-trained model. To overcome joint mismatch issues, we partition the human skeleton into five parts, a simple yet effective technique for information sharing. Our approach is evaluated on two datasets, including the public Nursing Activities and our self-built Tai Chi Action dataset. Results from linear evaluation protocol and fine-tuned evaluation demonstrate that our pre-trained model effectively captures common motion features among human actions and achieves steady and precise accuracy across all training settings, while mitigating network overfitting. Notably, our model outperforms state-of-the-art models in recognition accuracy when fusing joint and limb modality features along the channel dimension.
Keyword:
fine-grained action recognition
small-scale dataset
Tai Chi action
heatmap volume
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.5
论文数:
7.2W
被引数:
20.9W
机构
引用论文
Increase in superoxide dismutase activity concomitant with a decrease in lipid peroxidation of liver during post partum development
FEBS Letters
IF0
Assessing the impact of online postal self-sampling for sexually transmitted infections on health inequalities, access to care and clinical outcomes in the UK: protocol for ASSIST, a realist evaluation评估在线邮政自采样在性传播感染中的应用对英国健康不平等、医疗服务获取和临床结局的影响:ASSIST现实性评估方案
BMJ Open
IF0
Fusing Higher-Order Features in Graph Neural Networks for Skeleton-Based Action Recognition融合高阶特征的图神经网络骨架动作识别
Evaluation of the Effect of Systolic Blood Pressure and Pulse Pressure on Cognitive Function: The Women's Health and Aging Study II
PLoS ONE
IF0

