.png){kind=icon}
返回
Background-Aware Robust Context Learning for Weakly-Supervised Temporal Action Localization
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2022.3183789.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Weakly supervised temporal action localization (WTAL) aims to localize temporal intervals of actions in an untrimmed video using only video-level action labels. Although the learning of the background is an important issue in WTAL, most previous studies have not utilized an effective background. In this study, we propose a novel method for robustly separating contexts, e.g., action-like background, from the foreground to more accurately localize the action intervals. First, we detect background segments based on their probabilities to minimize the impact of background estimation errors. Second, we define the entropy boundary of the foreground and the positive distance between the boundary and background entropy. The background probability and entropy boundary allow the segment-level classifier to robustly learn the background. Third, we improve the performance of the overall actionness model based on a consensus of the RGB and flow features. The results of extensive experiments demonstrate that the proposed method learns the context separately from the action, consequently achieving new state-of-the-art results on the THUMOS-14 and ActivityNet-1.2 benchmarks. We also confirm that using feature adaptation helps overcome the limitation of a pretrained feature extractor on datasets that contain many backgrounds, such as THUMOS-14.
Keyword:
Entropy
Feature extraction
Location awareness
Context modeling
Annotations
Training
Reliability
Temporal action localization
entropy maximization
context learning
feature adaptation
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
分享收藏分享收藏A survey on activity recognition and behavior understanding in video surveillance.png)
VISUAL COMPUTER
VISUAL COMPUTERIF2.9
PREAI
分享收藏
查看更多内容