arrow
返回

Improving Small-Scale Human Action Recognition Performance Using a 3D Heatmap Volume

delete2023-07-13
delete3
delete
OA
AI
L
Lin Yuan *
Z
Zhen He
王
王强 (Qiang Wang)
L
Leiyang Xu
X
Xiang Ma
DOI:10.3390/s23146364delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In recent years, skeleton-based human action recognition has garnered significant research attention, with proposed recognition or segmentation methods typically validated on large-scale coarse-grained action datasets. However, there remains a lack of research on the recognition of small-scale fine-grained human actions using deep learning methods, which have greater practical significance. To address this gap, we propose a novel approach based on heatmap-based pseudo videos and a unified, general model applicable to all modality datasets. Leveraging anthropometric kinematics as prior information, we extract common human motion features among datasets through an ad hoc pre-trained model. To overcome joint mismatch issues, we partition the human skeleton into five parts, a simple yet effective technique for information sharing. Our approach is evaluated on two datasets, including the public Nursing Activities and our self-built Tai Chi Action dataset. Results from linear evaluation protocol and fine-tuned evaluation demonstrate that our pre-trained model effectively captures common motion features among human actions and achieves steady and precise accuracy across all training settings, while mitigating network overfitting. Notably, our model outperforms state-of-the-art models in recognition accuracy when fusing joint and limb modality features along the channel dimension.
Keyword:
fine-grained action recognition
small-scale dataset
Tai Chi action
heatmap volume
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Sensors 封面图
Sensors
IF:
3.5
论文数:
7.2W
被引数:
20.9W

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
引用论文

引用论文

Incentive mechanisms for smartphone collaboration in data acquisition and distributed computing
err2012-03-01
err0
PREAI
errLingjie Duan; Takeshi Kubo; Kohei Sugiyama; Jianwei Huang; Teruyuki Hasegawa; Jean Walrand
err分享
err收藏
Kinetic Mechanism of Human Histone Acetyltransferase P/CAF
err2000-09-07
err0
PREAI
errKirk G. Tanner; Michael R. Langer; John M. Denu
err分享
err收藏
err分享
err收藏
Evaluation of the Effect of Systolic Blood Pressure and Pulse Pressure on Cognitive Function: The Women's Health and Aging Study II
err2011-12-09
err0
errOAAI
errSevil Yasar; Jean Y. Ko; Stephanie Nothelle; Michelle M. Mielke; Michelle C. Carlson
err分享
err收藏
Decomposition of RNA methylome reveals co-methylation patterns induced by latent enzymatic regulators of the epitranscriptome
err2015-01-01
err0
errOAAI
errLian Liu; Shao-Wu Zhang; Yu-Chen Zhang; Hui Liu; Lin Zhang; Runsheng Chen; Yufei Huang; Jia Meng
err分享
err收藏
学者 查看更多内容