arrow
返回

Action Behavior Learning Based on a New Multi-Scale Interactive Perception Network

delete2023-01-01
delete0
delete
OA
AI
J
Jun Gu
S
Sheng Xu *
DOI:10.1109/ACCESS.2023.3341035delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Action recognition is a fundamental research topic in the field of video understanding, but classical action recognition relies on a large amount of manually annotated video data, which limits its development. Small sample action recognition is a promising topic that can overcome the dependence on large-scale annotated data. However, the current small sample action recognition has a series of shortcomings such as temporal singularity and a lack of perception of global information. Therefore, this work proposes an interactive perception network by designing a multi-scale temporal feature extraction module to capture global temporal dependencies between all frames and local temporal information between frames. Then the algorithm proposes a cross scale matching strategy to achieve robust matching between videos with different motion speeds, maximizing the consistency between local and global features of the same type of action. Finally, the experimental results on the SSV2 dataset and the HMDB51 dataset show that the proposed method outperforms the current mainstream methods. Compared with the backbone network, which is the most advanced method of ResNet, this method achieved performance improvements of 0.8% and 0.4% on HMDB51 and SSV2, respectively.
Keyword:
Action recognition
small sample learning
video understanding
meta learning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

N
Nanjing Forestry University
学者数:
2.0W
论文数: 1.6W
被引数: 3.2W
Jiangsu Second Normal University 封面图
Jiangsu Second Normal University
学者数:
488
论文数: 437
被引数: 357
引用论文

引用论文

Time-dependent depolarization of aligned HD molecules
err2009-01-01
err0
errOAAI
errNate C.-M. Bartlett; Daniel J. Miller; Richard N. Zare; Andrew J. Alexander; Dimitris Sofikitis; T. Peter Rakitzis
err分享
err收藏
Autoimmune Endocrine Disease
err1985-01-01
err0
PREAI
errJohn B. Buse; George S. Eisenbarth
err分享
err收藏
Potential role of ticks as vectors of bluetongue virus
err2010-04-01
err0
errOAAI
errChantal Bouwknegt; Piet A. van Rijn; Jacqueline J. M. Schipper; Dennis Hölzel; Jan Boonstra; Ard M. Nijhof; Eugène M. A. van Rooij; Frans Jongejan
err分享
err收藏
Influence of exurban development on bird species richness and diversity
err2010-11-23
err0
PREAI
errMarcela Suarez-Rubio; Peter Leimgruber; Swen C. Renner
err分享
err收藏
The effect of hydrogen on the magnetic properties of the Nd–Fe–B–H compound
err1999-05-01
err0
PREAI
errJ Tejada; J.M Hernandez; M Duran; E Krotenko; J.L Morenza; G Sardin; E.M Chudnovsky
err分享
err收藏
Nucleotide sequence-based identification of a novel circovirus of canaries
err2010-06-17
err0
errOAAI
errD. Todd; J. Weston; N. W. Ball; B. J. Borghmans; J. A. Smyth; L. Gelmini; A. Lavazza
err分享
err收藏
学者 查看更多内容