arrow
Return

Collaborative Local-Global Learning for Temporal Action Proposal

delete2021-09-23
delete2
PRE
AI
Y
Yisheng Zhu
H
Hu Han
G
Guangcan Liu *
刘青山 cover
刘青山 (Qingshan Liu)
DOI:10.1145/3466181delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Temporal action proposal generation is an essential and challenging task in video understanding, which aims to locate the temporal intervals that likely contain the actions of interest. Although great progress has been made, the problem is still far from being well solved. In particular, prevalent methods can handle well only the local dependencies (i.e., short-term dependencies) among adjacent frames but are generally powerless in dealing with the global dependencies (i.e., long-term dependencies) between distant frames. To tackle this issue, we propose CLGNet, a novel Collaborative Local-Global Learning Network for temporal action proposal. The majority of CLGNet is an integration of Temporal Convolution Network and Bidirectional Long Short-Term Memory, in which Temporal Convolution Network is responsible for local dependencies while Bidirectional Long Short-Term Memory takes charge of handling the global dependencies. Furthermore, an attention mechanism called the background suppression module is designed to guide our model to focus more on the actions. Extensive experiments on two benchmark datasets, THUMOS'14 and ActivityNet-1.3, show that the proposed method can outperform state-of-the-art methods, demonstrating the strong capability of modeling the actions with varying temporal durations.
Keywords:
Temporal action proposal generation
untrimmed videos
long short-term memory
attention mechanism

Journal

ACM Transactions on Intelligent Systems and Technology cover
ACM Transactions on Intelligent Systems and Technology
IF:
6.6
Papers:
1.5K
Citations:
6.2K

Organization

I
institute of computing technology, cas
Scholars:
1.0K
Papers: 878
Citations: 1
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Relationship Between Amyloid β Protein and Melatonin Metabolite in a Study of Electric Utility Workers
err2002-08-01
err0
PREAI
errCurtis W. Noonan; John S. Reif; James B. Burch; Travers Y. Ichinose; Michael G. Yost; Kathy Magnusson
errShare
errSave
errShare
errSave
Association between comorbidities and dementia in diabetes mellitus patients: population-based retrospective cohort study
err2015-11-01
err0
PREAI
errShu-Chen Kuo; Shih-Wei Lai; Hung-Chang Hung; Chih-Hsin Muo; Shih-Chang Hung; Ling-Ling Liu; Chia-Wei Chang; Yueh-Juen Hwu; Shieh-Liang Chen; Fung-Chung Sung
errShare
errSave
errShare
errSave
Microstructure and magnetic properties of sintered NdFeB magnets with improved impact toughness
err2005-05-10
err0
PREAI
errJ. F. Liu; P. Vora; M. H. Walmer; E. Kottcamp; S. A. Bauser; A. Higgins; S. Liu
errShare
errSave
A new general method for protection of the hydroxyl function
err1976-03-01
err0
PREAI
errE.J. Corey; Jean-Louis Gras; Peter Ulrich
errShare
errSave
researcher View more