.png){kind=icon}
.png){kind=icon}
Return
Efficient Semisupervised Object Segmentation for Long-Term Videos Using Adaptive Memory Network
.png){kind=icon}
PRE
AI
DOI：10.1109/TCDS.2024.3385849.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Video object segmentation (VOS) uses the first annotated video mask to achieve consistent and precise segmentation in subsequent frames. Recently, memory-based methods have received significant attention owing to their substantial performance enhancements. However, these approaches rely on a fixed global memory strategy, which poses a challenge to segmentation accuracy and speed in the context of longer videos. To alleviate this limitation, we propose a novel semisupervised VOS model, founded on the principles of the adaptive memory network. Our proposed model adaptively extracts object features by focusing on the object area while effectively filtering out extraneous background noise. An identification mechanism is also thoughtfully applied to discern each object in multiobject scenarios. To further reduce storage consumption without compromising the saliency of object information, the outdated features residing in the memory pool are compressed into salient features through the employment of a self-attention mechanism. Furthermore, we introduce a local matching module, specifically devised to refine object features by fusing the contextual information from historical frames. We demonstrate the efficiency of our approach through experiments, substantially augmenting both the speed and precision of segmentation for long-term videos, while maintaining comparable performance for short videos.
Keywords:
Feature extraction
Videos
Object recognition
Data mining
Adaptation models
Adaptive systems
Video sequences
Long-term videos
memory network
object segmentation
semisupervised learning
Journal
IF:
4.9
Papers:
1.0K
Citations:
3.5K
Organization
View more organizations