arrow
返回

Collaborative Local-Global Learning for Temporal Action Proposal

delete2021-09-23
delete2
PRE
AI
Y
Yisheng Zhu
H
Hu Han
G
Guangcan Liu *
刘青山 封面图
刘青山 (Qingshan Liu)
DOI:10.1145/3466181delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Temporal action proposal generation is an essential and challenging task in video understanding, which aims to locate the temporal intervals that likely contain the actions of interest. Although great progress has been made, the problem is still far from being well solved. In particular, prevalent methods can handle well only the local dependencies (i.e., short-term dependencies) among adjacent frames but are generally powerless in dealing with the global dependencies (i.e., long-term dependencies) between distant frames. To tackle this issue, we propose CLGNet, a novel Collaborative Local-Global Learning Network for temporal action proposal. The majority of CLGNet is an integration of Temporal Convolution Network and Bidirectional Long Short-Term Memory, in which Temporal Convolution Network is responsible for local dependencies while Bidirectional Long Short-Term Memory takes charge of handling the global dependencies. Furthermore, an attention mechanism called the background suppression module is designed to guide our model to focus more on the actions. Extensive experiments on two benchmark datasets, THUMOS'14 and ActivityNet-1.3, show that the proposed method can outperform state-of-the-art methods, demonstrating the strong capability of modeling the actions with varying temporal durations.
Keyword:
Temporal action proposal generation
untrimmed videos
long short-term memory
attention mechanism

期刊

ACM Transactions on Intelligent Systems and Technology 封面图
ACM Transactions on Intelligent Systems and Technology
IF:
6.6
论文数:
1.5K
被引数:
6.2K

机构

I
institute of computing technology, cas
学者数:
1.0K
论文数: 878
被引数: 1
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Relationship Between Amyloid β Protein and Melatonin Metabolite in a Study of Electric Utility Workers
err2002-08-01
err0
PREAI
errCurtis W. Noonan; John S. Reif; James B. Burch; Travers Y. Ichinose; Michael G. Yost; Kathy Magnusson
err分享
err收藏
err分享
err收藏
Association between comorbidities and dementia in diabetes mellitus patients: population-based retrospective cohort study
err2015-11-01
err0
PREAI
errShu-Chen Kuo; Shih-Wei Lai; Hung-Chang Hung; Chih-Hsin Muo; Shih-Chang Hung; Ling-Ling Liu; Chia-Wei Chang; Yueh-Juen Hwu; Shieh-Liang Chen; Fung-Chung Sung
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
Microstructure and magnetic properties of sintered NdFeB magnets with improved impact toughness
err2005-05-10
err0
PREAI
errJ. F. Liu; P. Vora; M. H. Walmer; E. Kottcamp; S. A. Bauser; A. Higgins; S. Liu
err分享
err收藏
A new general method for protection of the hydroxyl function
err1976-03-01
err0
PREAI
errE.J. Corey; Jean-Louis Gras; Peter Ulrich
err分享
err收藏
学者 查看更多内容