arrow
Return

Exploring Action Centers for Temporal Action Localization

delete2023-01-01
delete6
PRE
AI
K
Kun Xia
王
王乐 (Le Wang) *
Y
Yichao Shen
G
Gang Hua
W
Wei Tang
DOI:10.1109/TMM.2023.3252176delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Temporal action localization aims at detecting the temporal intervals of human actions in untrimmed videos. Most previous methods rely on locating and matching the start and end times of actions. However, action boundaries are ambiguous and uncertain in nature, which leads to inaccurate action localization and a lot of false positives. In this paper, we introduce a new framework for temporal action localization. It explicitly models temporal action centers to reduce unreliable action detection results caused by ambiguous action boundaries. Since action centers are highly related to semantic actions, they can be detected more reliably than the conventional action boundaries. As a result, our framework can exclude false positives and promote high-quality proposals. Based on action centers, we propose a triplet feature fusion mechanism. It performs neural message passing among the boundaries and the center as well as contextual regions outside of the proposal to enrich its representation. In addition, we introduce a centerness scoring method to suppress proposals deviating from the centers of action instances. Consequently, our network can retrieve high-quality action proposals and locate actions more precisely. Experimental results show our method outperforms state-of-the-art methods on the THUMOS14 and ActivityNet v1.3 datasets.
Keywords:
Proposals
Location awareness
Videos
Feature extraction
Visualization
Reliability
Object detection
Temporal action detection
temporal action localization
temporal action proposal generation

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.6K
Citations:
2.4W

Organization

X
xi'an jiaotong university
Scholars:
9.3W
Papers: 6.7W
Citations: 75
U
University of Illinois Chicago
Scholars:
1.7W
Papers: 1.4W
Citations: 3.0W
University of Illinois System cover
University of Illinois System
Scholars:
6.9W
Papers: 6.2W
Citations: 644
researcher View more organizations
Cited Papers

Cited Papers

Relationship Between Amyloid β Protein and Melatonin Metabolite in a Study of Electric Utility Workers
err2002-08-01
err0
PREAI
errCurtis W. Noonan; John S. Reif; James B. Burch; Travers Y. Ichinose; Michael G. Yost; Kathy Magnusson
errShare
errSave
Timekeeping in genetically programmed aging
err1993-03-01
err0
PREAI
errP.E. Kloeden; R. Rössler; O.E. Rössler
errShare
errSave
Excellent microwave absorption of Y2Fe15.5Co0.5Si/paraffin composites by tuning powder particle size
err2024-01-01
err0
PREAI
errH.X. Xu; X.C. Zhong; J.W. Hu; N. He; H.N. Zhang; Z.Y. Wu; L. Ma; Z.W. Liu; R.V. Ramanujan
errShare
errSave
Hydrogen diffusivity in high purity alpha iron
err1982-08-01
err0
PREAI
errM. Nagano; Y. Hayashi; N. Ohtani; M. Isshiki; K. Igaki
errShare
errSave
Space-Time Tree Ensemble for Action Recognition and Localization
err2017-02-02
err11
PREAI
errMa, Shugao; Zhang, Jianming; Sclaroff, Stan; Ikizler-Cinbis, Nazli; Sigal, Leonid
errShare
errSave
Structure and lattice dynamics of titanium hydrides due to thermobaric treatment
err1995-10-01
err0
PREAI
errI. O. Bashkin; A. I. Kolesnikov; E. G. Ponyatovsky
errShare
errSave
errShare
errSave
researcher View more