.png){kind=icon}
返回
Proposal Semantic Relationship Graph Network for Temporal Action Detection
.png){kind=icon}
OA
AI
DOI：10.1145/3702233.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Temporal action detection, a critical task in video activity understanding, is typically divided into two stages: proposal generation and classification. However, most existing methods overlook the importance of information transfer among proposals during classification, often treating each proposal in isolation, which hampers accurate label prediction. In this article, we propose a novel method for inferring semantic relationships both within and between action proposals, guiding the fusion of action proposal features accordingly. Building on this approach, we introduce the Proposal Semantic Relationship Graph Network (PSRGN), an end-to-end model that leverages intra-proposal semantic relationship graphs to extract cross-scale temporal context and an interproposal semantic relationship graph to incorporate complementary neighboring information, significantly improving proposal feature quality and overall detection performance. This is the first method to apply graph structure learning in temporal action detection, adaptively constructing the inter-proposal semantic graph. Extensive experiments on two datasets demonstrate the effectiveness of our approach, achieving state-of-the-art (SOTA). Code and results are available at http://github.com/Riiick2011/PSRGN.
Keyword:
Temporal action detection
proposal semantic relationship graph
graph convolutional network
graph structure learning
期刊
IF:
6.6
论文数:
1.5K
被引数:
6.2K
机构
引用论文
A prospective study of surgical margin status in oral squamous cell carcinoma: A preliminary report
.png){kind=icon}
PREAI
分享收藏
查看更多内容