.png){kind=icon}
返回
Global Memory and Local Continuity for Video Object Detection
.png){kind=icon}
PRE
AI
DOI：10.1109/TMM.2022.3164253.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
To deal with the challenges in video object detection (VOD), such as occlusion and motion blur, many state-of-the-art video object detectors adopt a feature aggregation module to encode the long-range contextual information to support the current frame. The main drawbacks of these detectors are three-folds: first, the frame-wise detection slows down the detection speed; second, the frame-wise detection usually ignores the local continuity of the objects in a video, resulting in temporal inconsistent detection; third, the feature aggregation module usually encodes temporal features either from a local video clip or a single video, without exploiting the features in other videos. In this work, we develop an online VOD algorithm, aiming at a balanced high-speed and high-accuracy, by exploiting the global memory and local continuity. In the algorithm, an effective and efficient global memory bank (GMB) is designed to deposit and update object class features, which enables us to exploit the support features in other videos to enhance object features in the current video frames. Besides, to further speed up the detection, we design an object tracker to perform object detection for non-key frames based on the detection results of the key frame by leveraging the local continuity property of the video. Considering the trade-off between detection accuracy and speed, the proposed framework achieves superior performance on the ImageNet VID dataset. Source codes will be released to the public via our GitHub website.
Keyword:
Feature extraction
Object detection
Detectors
Proposals
Target tracking
Signal processing algorithms
Costs
Video object detection
global memory bank
feature aggregation
local continuity
object tracker
期刊
IF:
9.7
论文数:
4.5K
被引数:
2.4W
机构
引用论文
Al doped ZnO based metal–semiconductor–metal and metal–insulator–semiconductor–insulator–metal UV sensors.png)
Optik
OptikIF0
PREAI
分享收藏Thermal comfort, perceived air quality, and cognitive performance when personally controlled air movement is used by tropically acclimatized persons当热带适应的人使用个人控制的空气运动时，热舒适性，感知的空气质量和认知表现Indoor Air
OAAI
Indoor AirIF0
OAAI分享收藏分享收藏
查看更多内容