.png){kind=icon}
返回
Video Visual Relation Detection via 3D Convolutional Neural Network
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2022.3154423.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Video visual relation detection, which aims to detect the visual relations between objects in the form of relation triplet (e.g., person-ride-bike, dog-toward-car, etc.), is a significant and fundamental task in computer vision. However, most of the existing works about visual relation instances are focused on static images. Modeling the non-static relationships in videos has drawn little attention due to lacking large-scale video dataset support. In our work, we propose a video dataset named Video Predicate Detection and Reasoning (VidPDR) for dynamic video visual relation detection, which consists of 1,000 videos with dense manually dynamic labeled annotations on 21 object classes and 37 predicates classes. Moreover, we propose a novel spatio-temporal feature extraction framework with 3D Convolutional Neural Networks (ST3DCNN), which includes three modules 1) object trajectory, 2) short-term relation prediction, and 3) greedy relational association. We conducted appropriate experiments on public datasets and our own dataset (VidPDR). Results demonstrate that our proposed method has a great improvement in comparison to the state-of-the-art baselines.
Keyword:
Visualization
Feature extraction
Trajectory
Three-dimensional displays
Convolutional neural networks
Task analysis
Object detection
Computer vision
3D convolutional neural network
video visual relation detection
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Photoperiodic effects in the Djungarian hamster: one minute of light during darktime mimics influence of long photoperiods on testicular recrudescence, body weight and pelage colour.png)
Experientia
ExperientiaIF0
PREAI
分享收藏Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations视觉基因组: 使用众包密集图像注释连接语言和视觉
OAAI
OAAI分享收藏
查看更多内容