arrow
Return

Exploiting inter-frame regional correlation for efficient action recognition

delete2021-09-01
delete7
delete
OA
AI
Y
Yuecong Xu *
J
Jianfei Yang
K
Kezhi Mao
J
Jianxiong Yin
S
Simon See
DOI:10.1016/j.eswa.2021.114829delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
ABSTR A C T Temporal feature extraction is an important issue in video-based action recognition. Optical flow is a popular method to extract temporal feature, which produces excellent performance thanks to its capacity of capturing pixel-level correlation information between consecutive frames. However, such a pixel-level correlation is extracted at the cost of high computational complexity and large storage resource. In this paper, we propose a novel temporal feature extraction method, Attentive Correlated Temporal Feature (ACTF), by exploring inter-frame correlation within a certain region. The proposed ACTF exploits both bilinear and linear correlations between successive frames on the regional level. Our method has the advantage of achieving performance comparable to or better than optical flow-based methods while avoiding the introduction of optical flow. Experimental results demonstrate our proposed method achieves the competitive performances of 96.3% on UCF101 and 76.3% on HMDB51 benchmark datasets.
Keywords:
Action recognition
Inter-frame correlation
Feature extraction
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W