arrow
返回

Exploring Action Centers for Temporal Action Localization

delete2023-01-01
delete6
PRE
AI
K
Kun Xia
王
王乐 (Le Wang) *
Y
Yichao Shen
G
Gang Hua
W
Wei Tang
DOI:10.1109/TMM.2023.3252176delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Temporal action localization aims at detecting the temporal intervals of human actions in untrimmed videos. Most previous methods rely on locating and matching the start and end times of actions. However, action boundaries are ambiguous and uncertain in nature, which leads to inaccurate action localization and a lot of false positives. In this paper, we introduce a new framework for temporal action localization. It explicitly models temporal action centers to reduce unreliable action detection results caused by ambiguous action boundaries. Since action centers are highly related to semantic actions, they can be detected more reliably than the conventional action boundaries. As a result, our framework can exclude false positives and promote high-quality proposals. Based on action centers, we propose a triplet feature fusion mechanism. It performs neural message passing among the boundaries and the center as well as contextual regions outside of the proposal to enrich its representation. In addition, we introduce a centerness scoring method to suppress proposals deviating from the centers of action instances. Consequently, our network can retrieve high-quality action proposals and locate actions more precisely. Experimental results show our method outperforms state-of-the-art methods on the THUMOS14 and ActivityNet v1.3 datasets.
Keyword:
Proposals
Location awareness
Videos
Feature extraction
Visualization
Reliability
Object detection
Temporal action detection
temporal action localization
temporal action proposal generation

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.7K
被引数:
2.4W

机构

X
xi'an jiaotong university
学者数:
9.3W
论文数: 6.7W
被引数: 75
U
University of Illinois Chicago
学者数:
1.7W
论文数: 1.4W
被引数: 3.0W
University of Illinois System 封面图
University of Illinois System
学者数:
6.9W
论文数: 6.2W
被引数: 644
学者 查看更多机构
引用论文

引用论文

Relationship Between Amyloid β Protein and Melatonin Metabolite in a Study of Electric Utility Workers
err2002-08-01
err0
PREAI
errCurtis W. Noonan; John S. Reif; James B. Burch; Travers Y. Ichinose; Michael G. Yost; Kathy Magnusson
err分享
err收藏
Timekeeping in genetically programmed aging
err1993-03-01
err0
PREAI
errP.E. Kloeden; R. Rössler; O.E. Rössler
err分享
err收藏
Excellent microwave absorption of Y2Fe15.5Co0.5Si/paraffin composites by tuning powder particle size
err2024-01-01
err0
PREAI
errH.X. Xu; X.C. Zhong; J.W. Hu; N. He; H.N. Zhang; Z.Y. Wu; L. Ma; Z.W. Liu; R.V. Ramanujan
err分享
err收藏
Hydrogen diffusivity in high purity alpha iron
err1982-08-01
err0
PREAI
errM. Nagano; Y. Hayashi; N. Ohtani; M. Isshiki; K. Igaki
err分享
err收藏
Space-Time Tree Ensemble for Action Recognition and Localization用于动作识别和定位的时空树集成
err2017-02-02
err11
PREAI
errMa, Shugao; Zhang, Jianming; Sclaroff, Stan; Ikizler-Cinbis, Nazli; Sigal, Leonid
err分享
err收藏
Structure and lattice dynamics of titanium hydrides due to thermobaric treatment
err1995-10-01
err0
PREAI
errI. O. Bashkin; A. I. Kolesnikov; E. G. Ponyatovsky
err分享
err收藏
err分享
err收藏
学者 查看更多内容