arrow
返回

Temporal Dropout for Weakly Supervised Action Localization

delete2023-02-25
delete5
PRE
AI
C
Chi Xie
Z
Zikun Zhuang
S
Shengjie Zhao
梁
梁胜德 (Shuang Liang) *
DOI:10.1145/3567827delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Weakly supervised action localization is a challenging problem in video understanding and action recognition. Existing models usually formulate the training process as direct classification using video-level supervision. They tend to only locate the most discriminative parts of action instances and produce temporally incomplete detection results. A natural solution for this problem, the adversarial erasing strategy, is to remove such parts from training so that models can attend to complementary parts. Previous works do it in an offline and heuristic way. They adopt a multi-stage pipeline, where discriminative regions are determined and erased under the guidance of detection results from last stage. Such a pipeline can be both ineffective and inefficient, possibly hindering the overall performance. On the contrary, we combine adversarial erasing with dropout mechanism and propose a Temporal Dropout Module that learns where to remove in a data-driven and online manner. This plug-and-play module is trained without iterative stages, which not only simplifies the pipeline but also makes the regularization during training easier and more adaptive. Experiments show that the proposed method outperforms previous erasing-based methods by a large margin. More importantly, it achieves universal improvement when plugged into various direct classification methods and obtains state-of-the-art performance.
Keyword:
Weakly supervised
temporal action localization
adversarial erasing
adaptive dropout

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

T
tongji university
学者数:
7.9W
论文数: 6.0W
被引数: 98
引用论文

引用论文

Timekeeping in genetically programmed aging
err1993-03-01
err0
PREAI
errP.E. Kloeden; R. Rössler; O.E. Rössler
err分享
err收藏
Proposal Complementary Action Detection建议补充动作检测
err2020-06-21
err3
PREAI
errZhu, Suguo; Yang, Xiaoxian; Yu, Jun; Fang, Zhenying; Wang, Meng; Huang, Qingming
err分享
err收藏
Association between comorbidities and dementia in diabetes mellitus patients: population-based retrospective cohort study
err2015-11-01
err0
PREAI
errShu-Chen Kuo; Shih-Wei Lai; Hung-Chang Hung; Chih-Hsin Muo; Shih-Chang Hung; Ling-Ling Liu; Chia-Wei Chang; Yueh-Juen Hwu; Shieh-Liang Chen; Fung-Chung Sung
err分享
err收藏
err分享
err收藏
A new general method for protection of the hydroxyl function
err1976-03-01
err0
PREAI
errE.J. Corey; Jean-Louis Gras; Peter Ulrich
err分享
err收藏
学者 查看更多内容