arrow
Return

Semi-Supervised Temporal Action Proposal Generation via Exploiting 2-D Proposal Map

delete2022-01-01
delete6
PRE
AI
王卫宁 (Weining Wang)
T
Tianwei Lin
D
Dongliang He
F
Fu Li
王亮 cover
王亮 (Liang Wang)
刘静 (Jing Liu) *
DOI:10.1109/TMM.2021.3104398delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Temporal action proposal generation aims to generate temporal video segments containing human actions in untrimmed videos, which is always a preliminary for such video understanding tasks as action localization and temporally description grounding, etc. Fully-supervised solutions, though proven to be effective, suffer much from heavy data annotation overhead. To address this problem, this paper focuses on a rarely investigated yet practical problem of semi-supervised learning for temporal action proposal generation. Firstly, we propose a Proposal Map oriented Mean-Teacher (PM-MT) model, which can use both labeled and unlabeled data for end-to-end model training. Secondly, a Suppression-and-Re-Generation (SRG) strategy is designed to generate high-quality pseudo labels for unlabeled data, which are then used to finetune the model. Extensive experiments demonstrate the effectiveness of our proposed method, by achieving the state-of-the-art results on two public benchmark datatsets on the task of semi-supervised action proposal generation and outperforming fully-supervised learning methods with only a portion of labeled data.
Keywords:
Proposals
Data models
Task analysis
Semisupervised learning
Training
Supervised learning
Predictive models
Semi-supervised learning
proposal map oriented mean-teacher
pseudo label

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

B
baidu
Scholars:
577
Papers: 470
Citations: 1
C
chinese academy of sciences
Scholars:
56.1W
Papers: 44.8W
Citations: 704