arrow
返回

Complete Video-Level Representations for Action Recognition

delete2021-01-01
delete2
delete
OA
AI
M
Min Li *
R
Ruwen Bai
B
Bo Meng
J
Junxing Ren
M
Miao Jiang
杨洋 封面图
杨洋 (Yang Yang)
L
Linghan Li
H
Hong Du
DOI:10.1109/ACCESS.2021.3058998delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In most of the existing work for activity recognition, 3D ConvNets show promising performance for learning spatiotemporal features of videos. However, most methods sample fixed-length frames from the original video, which are cropped to a fixed size and fed into the model for training. In this manner, two problems limit the model performance for recognition. First, the cropped video clips are incomplete or even distorted in appearance, resulting in a large gap between the feature representation and semantics of human activity. Second, the useful features of longer video frame sequences are weakened by the repeated stacking of 3D convolution over deep networks due to the limitations of GPU memory and computing ability. This article proposes a method based on a 3D backbone network for multi scale spatial feature representation, which uses a pyramid pooling layer to allow the input of video frames at different scales, and then aggregates short-term spatial-temporal features into a long-term video-level representation. Objection detection is used as a component of model testing to explore the improvement of activity recognition considering the large amount of space-time redundancy in real life videos. An experiment is performed on the principal video dataset, UCF101, and the proposed method presents a competitive performance.
Keyword:
Videos
Three-dimensional displays
Feature extraction
Activity recognition
Convolution
Two dimensional displays
Task analysis
3D ConvNets
activity recognition
video-level feature representation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

B
Beijing Jiaotong University
学者数:
2.2W
论文数: 1.7W
被引数: 1.2W
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Climate policy: Steps to China's carbon peak气候政策: 迈向中国碳峰值的步骤
err2015-06-17
err0
errOAAI
errZhu Liu; Dabo Guan; Scott Moore; Henry Lee; Jun Su; Qiang Zhang
err分享
err收藏
err分享
err收藏
Detection of proliferative responses to ESAT-6 and CFP-10 by FASCIA assay for diagnosis of Mycobacterium tuberculosis infection通过筋膜试验检测对ESAT-6和CFP-10的增殖反应以诊断结核分枝杆菌感染
err2011-07-01
err0
PREAI
errEmilie Borgström; Peter Andersen; Lena Andersson; Inger Julander; Gunilla Källenius; Markus Maeurer; Maria Norrby; Ida Rosenkrands; Teghesti Tecleab; Judith Bruchfeld; Hans Gaines
err分享
err收藏
A new general method for protection of the hydroxyl function
err1976-03-01
err0
PREAI
errE.J. Corey; Jean-Louis Gras; Peter Ulrich
err分享
err收藏
学者 查看更多内容