.png){kind=icon}
返回
Structural Knowledge Distillation for Efficient Skeleton-Based Action Recognition
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2021.3056895.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Skeleton data have been extensively used for action recognition since they can robustly accommodate dynamic circumstances and complex backgrounds. To guarantee the action-recognition performance, we prefer to use advanced and time-consuming algorithms to get more accurate and complete skeletons from the scene. However, this may not be acceptable in time- and resource-stringent applications. In this paper, we explore the feasibility of using low-quality skeletons, which can be quickly and easily estimated from the scene, for action recognition. While the use of low-quality skeletons will surely lead to degraded action-recognition accuracy, in this paper we propose a structural knowledge distillation scheme to minimize this accuracy degradations and improve recognition model's robustness to uncontrollable skeleton corruptions. More specifically, a teacher which observes high-quality skeletons obtained from a scene is used to help train a student which only sees low-quality skeletons generated from the same scene. At inference time, only the student network is deployed for processing low-quality skeletons. In the proposed network, a graph matching loss is proposed to distill the graph structural knowledge at an intermediate representation level. We also propose a new gradient revision strategy to seek a balance between mimicking the teacher model and directly improving the student model's accuracy. Experiments are conducted on Kenetics400, NTU RGB+D and Penn action recognition datasets and the comparison results demonstrate the effectiveness of our scheme.
Keyword:
Skeleton
Training
Pose estimation
Feature extraction
Videos
Joints
Knowledge engineering
Skeleton-based action recognition
structural knowledge distillation
graph matching loss
graph convolutional network
gradient revision
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
Glutathione Recycling and Antioxidant Enzyme Activities in Erythrocytes of Term and Preterm Newborns at Birth.png)
Neonatology
NeonatologyIF0
PREAI
分享收藏Evaluation of the Effect of Systolic Blood Pressure and Pulse Pressure on Cognitive Function: The Women's Health and Aging Study IIPLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏Colorimetric detection of pesticides based on calixarene modified silver nanoparticles in water
PREAI
分享收藏
查看更多内容