.png){kind=icon}
返回
Weakly-supervised temporal action localization using multi-branch attention weighting
.png){kind=icon}
PRE
AI
DOI：10.1007/s00530-024-01445-2.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Weakly-supervised temporal action localization aims to train an accurate and robust localization model using only video-level labels. Due to the lack of frame-level temporal annotations, existing weakly-supervised temporal action localization methods typically rely on multiple instance learning mechanisms to localize and classify all action instances in an untrimmed video. However, these methods focus only on the most discriminative regions that contribute to the classification task, neglecting a large number of ambiguous background and context snippets in the video. We believe that these controversial snippets have a significant impact on the localization results. To mitigate this issue, we propose a multi-branch attention weighting network (MAW-Net), which introduces an additional non-action class and integrates a multi-branch attention module to generate action and background attention, respectively. In addition, considering the correlation among context, action, and background, we use the difference of action and background attention to construct context attention. Finally, based on these three types of attention values, we obtain three new class activation sequences that distinguish action, background, and context. This enables our model to effectively remove background and context snippets in the localization results. Extensive experiments were performed on the THUMOS-14 and Activitynet1.3 datasets. The experimental results show that our method is superior to other state-of-the-art methods, and its performance is comparable to those of fully-supervised approaches.
Keyword:
Multi-branch attention weighting
Temporal action localization
Weak supervision
Action-context separation attention modeling
期刊
IF:
3.1
论文数:
2.8K
被引数:
2.7K
机构
引用论文
.png){kind=icon}
分享收藏Duplex n- and p-Type Chromia Grown on Pure Chromium: A Photoelectrochemical and Microscopic Study
PREAI
分享收藏分享收藏
查看更多内容