arrow
Return

Action Shuffling for Weakly Supervised Temporal Localization

delete2022-01-01
delete5
delete
OA
AI
X
Xiaoyu Zhang
H
Haichao Shi *
C
Changsheng Li
X
Xinchu Shi
DOI:10.1109/TIP.2022.3185485delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Weakly supervised action localization is a challenging task with extensive applications, which aims to identify actions and the corresponding temporal intervals with only video-level annotations available. This paper analyzes the order-sensitive and location-insensitive properties of actions, and embodies them into a self-augmented learning framework to improve the weakly supervised action localization performance. To be specific, we propose a novel two-branch network architecture with intra/inter-action shuffling, referred to as ActShufNet. The intra-action shuffling branch lays out a self-supervised order prediction task to augment the video representation with inner-video relevance, whereas the inter-action shuffling branch imposes a reorganizing strategy on the existing action contents to augment the training set without resorting to any external resources. Furthermore, the global-local adversarial training is presented to enhance the model's robustness to irrelevant noises. Extensive experiments are conducted on three benchmark datasets, and the results clearly demonstrate the efficacy of the proposed method.
Keywords:
Feature extraction
Location awareness
Training
Task analysis
Annotations
Semantics
Network architecture
Temporal action localization
self-supervised
inter-action
intra-action

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

U
university of chinese academy of sciences, cas
Scholars:
4.1W
Papers: 3.8W
Citations: 75
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

A segmentation approach for the reproducible extraction and quantification of knickpoints from river long profiles
err2019-02-18
err0
errOAAI
errBoris Gailleton; Simon M. Mudd; Fiona J. Clubb; Daniel Peifer; Martin D. Hurst
errShare
errSave
Strain-tunable electronic, elastic, and optical properties of CaI2monolayer: first-principles study
err2020-04-17
err0
PREAI
errXiao-Fang Chen; Li Wang; Zhao-Yi Zeng; Xiang-Rong Chen; Qi-Feng Chen
errShare
errSave
Ion beam induced phase transformation and krypton bubble formation in monoclinic zirconium oxide
err2018-09-01
err0
PREAI
errP. Balasaritha; S. Amirthapandian; P. Magudapathy; R.M. Sarguna; S.K. Srivastava; B.K. Panigrahi
errShare
errSave
errShare
errSave
Defining Molecular Signature of Pro-Immunogenic Radiotherapy Targets in Human Prostate Cancer Cells
err2014-08-01
err0
errOAAI
errMolykutty J. Aryankalayil; Adeola Y. Makinde; Sofia R. Gameiro; James W. Hodge; Patricia P. Rivera-Solis; Sanjeewani T. Palayoor; Mansoor M. Ahmed; C. Norman Coleman
errShare
errSave
Detection of proliferative responses to ESAT-6 and CFP-10 by FASCIA assay for diagnosis of Mycobacterium tuberculosis infection
err2011-07-01
err0
PREAI
errEmilie Borgström; Peter Andersen; Lena Andersson; Inger Julander; Gunilla Källenius; Markus Maeurer; Maria Norrby; Ida Rosenkrands; Teghesti Tecleab; Judith Bruchfeld; Hans Gaines
errShare
errSave
A new general method for protection of the hydroxyl function
err1976-03-01
err0
PREAI
errE.J. Corey; Jean-Louis Gras; Peter Ulrich
errShare
errSave
Breaking Winner-Takes-All: Iterative-Winners-Out Networks for Weakly Supervised Temporal Action Localization
err2019-12-01
err75
PREAI
errZeng, Runhao; Gan, Chuang; Chen, Peihao; Huang, Wenbing; Wu, Qingyao; Tan, Mingkui
errShare
errSave
researcher View more