.png){kind=icon}
.png){kind=icon}
Return
Action Shuffling for Weakly Supervised Temporal Localization
.png){kind=icon}
OA
AI
DOI：10.1109/TIP.2022.3185485.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Weakly supervised action localization is a challenging task with extensive applications, which aims to identify actions and the corresponding temporal intervals with only video-level annotations available. This paper analyzes the order-sensitive and location-insensitive properties of actions, and embodies them into a self-augmented learning framework to improve the weakly supervised action localization performance. To be specific, we propose a novel two-branch network architecture with intra/inter-action shuffling, referred to as ActShufNet. The intra-action shuffling branch lays out a self-supervised order prediction task to augment the video representation with inner-video relevance, whereas the inter-action shuffling branch imposes a reorganizing strategy on the existing action contents to augment the training set without resorting to any external resources. Furthermore, the global-local adversarial training is presented to enhance the model's robustness to irrelevant noises. Extensive experiments are conducted on three benchmark datasets, and the results clearly demonstrate the efficacy of the proposed method.
Keywords:
Feature extraction
Location awareness
Training
Task analysis
Annotations
Semantics
Network architecture
Temporal action localization
self-supervised
inter-action
intra-action
Journal
IF:
13.7
Papers:
1.0W
Citations:
8.4W