arrow
Return

Action recognition and localization with spatial and temporal contexts

delete2019-03-01
delete21
PRE
AI
W
Wanru Xu *
Z
Zhenjiang Miao
于剑 (Jian Yu)
Q
Qiang Ji
DOI:10.1016/j.neucom.2019.01.008delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Locating human action in spatio-temporal domain among untrimmed videos is an important but challenging task. Recent works have shown that incorporating contextual information leads to a significant improvement in action recognition, but there is still no existing work taking full advantage of context for action localization. While the popular target-centered methods have achieved promising results, they fail to exploit contexts and capture temporal dynamics in actions. In this paper, we propose a principled dynamic model, called spatio-temporal context model (STCM), to simultaneously locate and recognize actions. The STCM integrates various kinds of contexts, including the temporal context that consists of the sequences before and after action as well as the spatial context in the surrounding of target. Meanwhile, a novel dynamic programming approach is introduced to accumulate evidences collected at a small set of candidates in order to detect the spatio-temporal location of action effectively and efficiently. We report encouraging results on the UCF-Sports and UCF-101. It demonstrates that the contextual information is not only helpful for action recognition, but also contributes to action localization. (C) 2019 Elsevier B.V. All rights reserved.
Keywords:
Action recognition
Action localization
Dynamic graphical model
Spatio-temporal contexts

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

B
Beijing Jiaotong University
Scholars:
2.2W
Papers: 1.7W
Citations: 1.2W
R
rensselaer polytechnic institute
Scholars:
7.0K
Papers: 6.5K
Citations: 6