返回
Content Temporal Relation Network for temporal action proposal generation
DOI:10.1016/j.patcog.2023.110245.png)
摘要
En 中文
Temporal action proposal generation is an essential step for untrimmed video analysis and gains much attention from academia. However, most of the prior works predict the confidence score of each proposal separately and neglect the relations between proposals, limiting their performance. In this work, we design a novel Content Temporal Relation Network (CTRNet) to generate temporal action proposals by exploring the content and temporal semantic relations between proposals simultaneously. Specifically, we design a proposal feature map generation layer to convert the temporal semantic relations of proposals into spatial relations. Based on the proposal feature map, we propose a content-temporal relation module, which applies a novel adaptive -dilated convolution to model the temporal semantic relations between proposals and designs a content-adaptive convolution operation to explore the content semantic relation between proposals. Considering the temporal and content semantic relations between proposals, CTRNet has learned discriminative proposal features to improve performance. Extensive experiments are performed on two mainstream temporal action detection datasets, and CTRNet significantly outperforms the previous state-of-the-art methods. The codes are available at https://github.com/YanZhang-bit/CTRNet.
Keyword:
Temporal action proposal generation
Temporal action detection
Untrimmed video analysis
Proposal-proposal relations
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Video representation learning for temporal action detection using global-local attention
PATTERN RECOGNITION
IF7.6
Crystalline‐State Reaction with Allosteric Effect in Spin‐Crossover, Interpenetrated Networks with Magnetic and Optical Bistability具有磁和光学双稳态的自旋交叉,互穿网络中具有变构效应的晶态反应
Structure of ATP citrate lyase from rat liver. Physicochemical studies and proteolytic modification.

